00000001:02000400:1.0F:1787560321.601875:0:3297:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1787560330.040117:0:3500:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1787560331.132689:0:3561:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1319 MB/s 00000001:01000000:0.0:1787560331.383003:0:3561:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1679 MB/s 00000001:01000000:0.0:1787560331.632516:0:3561:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10339 MB/s 00000020:02000000:2.0:1787560331.963752:0:3592:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_82_g4029ffa 00000400:02000000:0.0:1787560332.348007:0:3607:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.129@tcp [8/256/0/180] 00008000:02000000:0.0:1787560335.995299:0:3756:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1787560407.926949:0:5725:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787560426.285652:0:6476:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787560426.285657:0:6476:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1787560426.285659:0:6476:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787560426.285801:0:6476:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000009521a4a0 00000080:02000400:0.0:1787560426.285811:0:6476:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1787560426.312044:0:6476:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1787560426.312058:0:6476:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787560426.312097:0:6476:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000bc1492e9) 00000020:00000080:0.0:1787560426.314615:0:6476:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787560426.416647:0:6476:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787560426.416724:0:6476:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1787560426.454788:0:6476:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787560426.454982:0:6476:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787560426.454989:0:6476:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787560426.455000:0:6476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4642c20bf2f337a9 00000020:01000004:2.0:1787560426.455006:0:6476:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1787560426.455010:0:6476:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787560426.455013:0:6476:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009521a4a0 from MGS 00000020:01000004:2.0:1787560426.455018:0:6476:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787560426.455036:0:6476:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000cb3f6cec) 00000020:00000080:2.0:1787560426.455048:0:6476:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787560426.456701:0:6476:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009521a4a0 from MGS, refs=2 00080000:01000000:0.0:1787560426.456714:0:6476:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787560426.456721:0:6476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4642c20bf2f337b7 00000100:00100000:0.0:1787560426.456851:0:6476:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787560426.457001:0:6476:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787560426.457008:0:6476:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787560426.457739:0:6476:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787560426.457746:0:6476:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787560426.459147:0:6476:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787560426.459318:0:6476:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787560426.459324:0:6476:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787560426.460302:0:6476:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787560426.460311:0:6476:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787560426.467416:0:6476:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787560426.467452:0:6476:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0F:1787560426.473322:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560426.473334:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560426.473336:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560426.481622:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560426.481629:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560426.481631:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560426.482225:0:6476:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787560426.484694:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1787560426.735991:0:6476:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1240 MB/s 00000001:01000000:0.0:1787560426.985477:0:6476:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 1055 MB/s 00000001:01000000:3.0:1787560427.242815:0:6476:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 198 MB/s 00000001:01000000:3.0:1787560427.493446:0:6476:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 407 MB/s 00080000:10000000:3.0:1787560427.507274:0:6476:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:0.0:1787560427.508531:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787560427.534533:0:6476:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1787560427.537140:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787560427.537287:0:6476:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787560427.537337:0:6476:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1787560427.537568:0:6476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787560427.537592:0:6476:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787560427.541347:0:6476:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787560427.541698:0:6476:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787560427.541704:0:6476:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787560427.545149:0:6476:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787560427.545165:0:6476:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787560427.545639:0:6476:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787560427.545646:0:6476:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787560427.547648:0:6476:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787560427.547676:0:6476:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.129@tcp' 00000020:01000004:1.0:1787560427.547679:0:6476:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787560427.547730:0:6476:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.129@tcp (typ=mgc) 00000020:00000080:1.0:1787560427.547756:0:6476:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.129@tcp (00000000d02c207a) 00000100:00080000:2.0:1787560427.548365:0:6495:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1787560427.548417:0:6476:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787560427.548590:0:6476:0:(ldlm_lib.c:102:import_set_conn()) imp 000000000cd9b8ba@MGC192.168.203.129@tcp: add connection 192.168.203.129@tcp at head 00010000:00010000:1.0:1787560427.548748:0:6476:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.129@tcp-0 is initialized 00000040:01000000:1.0:1787560427.548755:0:6476:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 1 is initialized 10000000:01000000:2.0:1787560427.563462:0:6497:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787560427.563585:0:6476:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.129@tcp (uuid f30da5a7-84ca-46bc-bf14-dc2a954107e6) 00000020:00000080:1.0:1787560427.563613:0:6476:0:(genops.c:1385:class_connect()) connect: client f30da5a7-84ca-46bc-bf14-dc2a954107e6, cookie 0x4642c20bf2f337c5 00000100:00080000:1.0:1787560427.563626:0:6476:0:(import.c:510:import_select_connection()) MGC192.168.203.129@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787560427.563632:0:6476:0:(import.c:624:import_select_connection()) MGC192.168.203.129@tcp: import 000000000cd9b8ba using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1787560427.563688:0:6476:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ed267aee x1874392862687360/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787560427.563718:0:6476:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f30da5a7-84ca-46bc-bf14-dc2a954107e6->MGS 00000020:01000004:1.0:1787560427.563738:0:6476:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787560427.563759:0:6476:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787560427.563788:0:6476:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000007a66617f) 00000020:00000080:1.0:1787560427.563800:0:6476:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787560427.570171:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ed267aee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3622:1874392862687360:0@lo:250: 00000100:00100000:0.0:1787560427.570275:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560427.571400:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862687360 00000100:00100000:2.0:1787560427.571410:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862687360 00000100:00100000:2.0:1787560427.571456:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787560427.571463:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa9f6620 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3622:x1874392862687360:12345-0@lo:250: 00010000:00080000:2.0:1787560427.571486:0:6492:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f30da5a7-84ca-46bc-bf14-dc2a954107e6@0@lo t0 exp 0000000000000000 cur 146 last 0 00000020:00000080:2.0:1787560427.571526:0:6492:0:(genops.c:1385:class_connect()) connect: client f30da5a7-84ca-46bc-bf14-dc2a954107e6, cookie 0x4642c20bf2f337d3 00000100:00080000:2.0:1787560427.571649:0:6492:0:(import.c:65:import_set_state_nolock()) 000000002723cfde : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787560427.571723:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa9f6620 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+5:3622:x1874392862687360:12345-0@lo:250: Request processed in 259us (1448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560427.571730:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787560427.574161:0:3622:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.129@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787560427.574189:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.129@tcp: connect to target with instance 0 00000100:00080000:0.0:1787560427.574198:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.129@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787560427.574203:0:3622:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787560427.574207:0:3622:0:(import.c:65:import_set_state_nolock()) 000000000cd9b8ba MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787560427.574212:0:3622:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787560427.574231:0:3622:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787560427.574239:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ed267aee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3622:1874392862687360:0@lo:250: 00000100:00100000:3.0:1787560427.606534:0:6476:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787560427.606729:0:6476:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787560427.606735:0:6476:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787560427.612923:0:6476:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787560427.612944:0:6476:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787560427.614571:0:6476:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787560427.614583:0:6476:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787560427.615317:0:6476:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787560427.615547:0:6476:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787560427.615552:0:6476:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787560427.616136:0:6476:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787560427.616143:0:6476:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787560427.685201:0:6476:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787560427.685501:0:6476:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787560427.685508:0:6476:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787560427.687070:0:6476:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787560427.687084:0:6476:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787560427.689120:0:6476:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787560427.689356:0:6476:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787560427.689363:0:6476:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787560427.690966:0:6476:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787560427.690977:0:6476:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787560427.692109:0:6476:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787560427.692363:0:6476:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787560427.692370:0:6476:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787560427.693553:0:6476:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787560427.693625:0:6476:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787560427.694654:0:6476:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787560427.697396:0:6476:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787560427.697405:0:6476:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787560427.703379:0:6476:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787560427.703413:0:6476:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787560427.738180:0:6476:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787560427.738425:0:6476:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787560427.739654:0:6476:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787560427.754050:0:6476:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787560427.754216:0:6476:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787560427.755330:0:6476:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787560427.755340:0:6476:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787560427.756666:0:6476:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787560427.756696:0:6476:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1787560427.756702:0:6476:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.129@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787560427.756817:0:6476:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787560427.756853:0:6476:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.129@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1787560427.756857:0:6476:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787560427.756858:0:6476:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787560427.756860:0:6476:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560427.756861:0:6476:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560427.756861:0:6476:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560427.756863:0:6476:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560427.756863:0:6476:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787560427.756865:0:6476:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787560427.756866:0:6476:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787560427.756867:0:6476:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787560427.756868:0:6476:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560427.756869:0:6476:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787560427.756871:0:6476:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1787560427.756873:0:6476:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787560427.756874:0:6476:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787560427.756875:0:6476:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560427.756876:0:6476:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560427.756877:0:6476:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560427.756878:0:6476:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560427.756879:0:6476:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787560427.756880:0:6476:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787560427.756881:0:6476:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787560427.756886:0:6476:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787560427.756887:0:6476:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560427.756888:0:6476:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787560427.756920:0:6476:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787560427.756936:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008763f026 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6476:1874392862687488:0@lo:253: 00000100:00100000:2.0:1787560427.757016:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560427.757076:0:6476:0:(client.c:2715:ptlrpc_set_wait()) set 000000001bded78f going to sleep for 11 seconds 00000100:00100000:3.0:1787560427.757224:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862687488 00000100:00100000:3.0:1787560427.757233:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862687488 00000100:00100000:3.0:1787560427.757297:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787560427.757312:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd7c658f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+5:6476:x1874392862687488:12345-0@lo:253: 20000000:01000000:3.0:1787560427.757365:0:6494:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787560427.757368:0:6494:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1787560427.758019:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787560427.758078:0:6494:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1787560427.758364:0:6494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787560427.763290:0:6515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1787560427.763719:0:6494:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787560427.763723:0:6494:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1787560427.763729:0:6494:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1787560427.763732:0:6494:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1787560427.763742:0:6494:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1787560427.763934:0:6494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787560427.764088:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1787560427.764102:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787560427.764116:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1787560427.764128:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1787560427.764141:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1787560427.764186:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1787560427.764193:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1787560427.764203:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1787560427.764207:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1787560427.764216:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1787560427.764219:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1787560427.764229:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1787560427.764240:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1787560427.764262:0:6494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787560427.764266:0:6494:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1787560427.764272:0:6494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787560427.764729:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1787560427.764740:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787560427.764755:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1787560427.764838:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1787560427.764853:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1787560427.764861:0:6494:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1787560427.764897:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1787560427.764905:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787560427.764918:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1787560427.764930:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1787560427.764956:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1787560427.764967:0:6494:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1787560427.764990:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1787560427.764998:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1787560427.765010:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1787560427.765025:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1787560427.765084:0:6494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1787560427.765111:0:6494:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1787560427.765117:0:6494:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1787560427.770011:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1787560427.770338:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1787560427.770368:0:6494:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.129@tcp for mdt 20000000:01000000:3.0:1787560427.770370:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.129@tcp (null) (null) (null) 00000040:00080000:3.0:1787560427.770385:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1787560427.770401:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787560427.770415:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1787560427.770420:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.129@tcp (null) (null) 00000040:00080000:3.0:1787560427.770465:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1787560427.770474:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1787560427.770486:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1787560427.770499:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1787560427.770525:0:6494:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787560427.770528:0:6494:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787560427.770532:0:6494:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787560427.770587:0:6494:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787560427.770590:0:6494:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787560427.773076:0:6517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1787560427.773348:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1787560427.773377:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1787560427.773407:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1787560427.773420:0:6494:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787560427.773423:0:6494:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787560427.774081:0:6518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1787560427.774231:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1787560427.774262:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1787560427.774280:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1787560427.774319:0:6494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787560427.774322:0:6494:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1787560427.774327:0:6494:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787560427.774330:0:6494:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787560427.774334:0:6494:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1787560427.774340:0:6494:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787560427.775951:0:6519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1787560427.776073:0:6494:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1787560427.793727:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1787560427.793777:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1787560427.793797:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1787560427.793815:0:6494:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787560427.793837:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000219b95b9/0x4642c20bf2f337da lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560427.793853:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000219b95b9/0x4642c20bf2f337da lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560427.793863:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000219b95b9/0x4642c20bf2f337da lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560427.793869:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000219b95b9/0x4642c20bf2f337da lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560427.793876:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000219b95b9/0x4642c20bf2f337da lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560427.793898:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000219b95b9/0x4642c20bf2f337da lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560427.793903:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000219b95b9 already unused, calling callback (0000000018131874) 00010000:00010000:2.0:1787560427.793906:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000219b95b9/0x4642c20bf2f337da lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560427.793914:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000219b95b9/0x4642c20bf2f337da lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560427.793926:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000219b95b9/0x4642c20bf2f337da lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560427.793933:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000219b95b9/0x4642c20bf2f337da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560427.793938:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000219b95b9/0x4642c20bf2f337da lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787560427.793954:0:6494:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787560427.821138:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd7c658f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+5:6476:x1874392862687488:12345-0@lo:253: Request processed in 63825us (64114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560427.821159:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787560427.821606:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008763f026 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6476:1874392862687488:0@lo:253: 10000000:01000000:2.0:1787560427.821624:0:6476:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787560427.821627:0:6476:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787560427.821629:0:6476:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787560427.821630:0:6476:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560427.821631:0:6476:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1787560427.821633:0:6476:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560427.821634:0:6476:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560427.821635:0:6476:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787560427.821637:0:6476:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787560427.821638:0:6476:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787560427.821653:0:6476:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560427.821655:0:6476:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787560427.821673:0:6476:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009521a4a0 from lustre-MDT0000 10000000:01000000:2.0:1787560427.821703:0:6476:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787560427.821706:0:6476:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787560427.821711:0:6476:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9cafe06b3370 10000000:01000000:2.0:1787560427.821715:0:6476:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787560427.821722:0:6476:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9cafe06b3370 from 1 10000000:01000000:2.0:1787560427.821725:0:6476:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787560427.821778:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 00000000219b95b9/0x4642c20bf2f337e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560427.821787:0:6476:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 00000000219b95b9/0x4642c20bf2f337e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560427.821796:0:6476:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 00000000219b95b9/0x4642c20bf2f337e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560427.821813:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008763f026 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6476:1874392862687616:0@lo:101: 00000100:00100000:2.0:1787560427.821850:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560427.821911:0:6476:0:(client.c:2715:ptlrpc_set_wait()) set 000000002a698e16 going to sleep for 11 seconds 00000100:00100000:0.0:1787560427.822027:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862687616 00000100:00100000:0.0:1787560427.822035:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862687616 00000100:00100000:0.0:1787560427.822082:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787560427.822090:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000bb0bba5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+5:6476:x1874392862687616:12345-0@lo:101: 00010000:00010000:0.0:1787560427.822100:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560427.822112:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f39b93b9/0x4642c20bf2f337e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f337e1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560427.822131:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f39b93b9/0x4642c20bf2f337e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f337e1 expref: 6 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560427.822139:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f39b93b9/0x4642c20bf2f337e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f337e1 expref: 6 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560427.822147:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f39b93b9, rc 0) 00000100:00100000:0.0:1787560427.822185:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000bb0bba5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+6:6476:x1874392862687616:12345-0@lo:101: Request processed in 96us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560427.822198:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787560427.822270:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008763f026 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6476:1874392862687616:0@lo:101: 00010000:00010000:1.0:1787560427.822282:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 00000000219b95b9/0x4642c20bf2f337e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f337e8 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560427.822301:0:6476:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 00000000219b95b9/0x4642c20bf2f337e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f337e8 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560427.822361:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009268eb90 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6476:1874392862687744:0@lo:501: 00000100:00100000:1.0:1787560427.822418:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560427.822612:0:6476:0:(client.c:2715:ptlrpc_set_wait()) set 000000009c251eed going to sleep for 11 seconds 00000100:00100000:0.0:1787560427.822665:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862687744 00000100:00100000:0.0:1787560427.822670:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862687744 00000100:00100000:0.0:1787560427.822702:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787560427.822707:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5a19947 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+6:6476:x1874392862687744:12345-0@lo:501: 00000100:00100000:0.0:1787560427.822798:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5a19947 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+6:6476:x1874392862687744:12345-0@lo:501: Request processed in 90us (379us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787560427.822804:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787560427.822868:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009268eb90 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6476:1874392862687744:0@lo:501: 10000000:01000000:3.0:1787560427.822897:0:6476:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787560427.822913:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 00000000219b95b9/0x4642c20bf2f337e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f337e8 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560427.822921:0:6476:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 00000000219b95b9/0x4642c20bf2f337e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f337e8 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560427.822928:0:6476:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cb000817800 10000000:01000000:3.0:1787560427.822932:0:6476:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787560427.822936:0:6476:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9cb000817800 10000000:01000000:3.0:1787560427.822938:0:6476:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787560427.822940:0:6476:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9cb000817800 from 1 10000000:01000000:3.0:1787560427.822942:0:6476:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787560427.822971:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 000000001f69bc56/0x4642c20bf2f337ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560427.822977:0:6476:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 000000001f69bc56/0x4642c20bf2f337ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560427.822994:0:6476:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 000000001f69bc56/0x4642c20bf2f337ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560427.823007:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ea323bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6476:1874392862687872:0@lo:101: 00000100:00100000:3.0:1787560427.823035:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560427.823047:0:6476:0:(client.c:2715:ptlrpc_set_wait()) set 000000005ae9b039 going to sleep for 11 seconds 00000100:00100000:0.0:1787560427.823141:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862687872 00000100:00100000:0.0:1787560427.823146:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862687872 00000100:00100000:0.0:1787560427.823164:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787560427.823169:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f157d9e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+6:6476:x1874392862687872:12345-0@lo:101: 00010000:00010000:0.0:1787560427.823176:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560427.823185:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000025b60759/0x4642c20bf2f337f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f337ef expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560427.823199:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000025b60759/0x4642c20bf2f337f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f337ef expref: 7 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560427.823206:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000025b60759/0x4642c20bf2f337f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f337ef expref: 7 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560427.823212:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000025b60759, rc 0) 00000100:00100000:0.0:1787560427.823282:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f157d9e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+7:6476:x1874392862687872:12345-0@lo:101: Request processed in 112us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560427.823287:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787560427.824179:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ea323bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6476:1874392862687872:0@lo:101: 00010000:00010000:3.0:1787560427.824196:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 000000001f69bc56/0x4642c20bf2f337ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f337f6 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560427.824205:0:6476:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 000000001f69bc56/0x4642c20bf2f337ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f337f6 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560427.824219:0:6476:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787560427.824225:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 000000001f69bc56/0x4642c20bf2f337ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f337f6 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560427.824231:0:6476:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 000000001f69bc56/0x4642c20bf2f337ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f337f6 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560427.824237:0:6476:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787560427.824242:0:6476:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787560427.824246:0:6476:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9cb000817800 10000000:01000000:3.0:1787560427.824248:0:6476:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787560427.824251:0:6476:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787560427.824253:0:6476:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787560427.824270:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 00000000ab9165b8/0x4642c20bf2f337fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560427.824296:0:6476:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 00000000ab9165b8/0x4642c20bf2f337fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560427.824303:0:6476:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 00000000ab9165b8/0x4642c20bf2f337fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560427.824553:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ea323bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6476:1874392862688000:0@lo:101: 00000100:00100000:3.0:1787560427.824591:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560427.824621:0:6476:0:(client.c:2715:ptlrpc_set_wait()) set 000000005ae9b039 going to sleep for 11 seconds 00000100:00100000:1.0:1787560427.824678:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862688000 00000100:00100000:1.0:1787560427.824684:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862688000 00000100:00100000:1.0:1787560427.824726:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787560427.824733:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096e8c42e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+7:6476:x1874392862688000:12345-0@lo:101: 00010000:00010000:1.0:1787560427.824743:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560427.824755:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001f4dd5ed/0x4642c20bf2f33804 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f337fd expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560427.824788:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001f4dd5ed/0x4642c20bf2f33804 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f337fd expref: 8 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560427.824806:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001f4dd5ed/0x4642c20bf2f33804 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f337fd expref: 8 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560427.824812:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001f4dd5ed, rc 0) 00000100:00100000:1.0:1787560427.824850:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096e8c42e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+8:6476:x1874392862688000:12345-0@lo:101: Request processed in 118us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560427.824857:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787560427.825102:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ea323bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6476:1874392862688000:0@lo:101: 00010000:00010000:3.0:1787560427.825113:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 00000000ab9165b8/0x4642c20bf2f337fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33804 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560427.825120:0:6476:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 00000000ab9165b8/0x4642c20bf2f337fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33804 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560427.825168:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ea323bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6476:1874392862688128:0@lo:501: 00000100:00100000:3.0:1787560427.825192:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560427.825246:0:6476:0:(client.c:2715:ptlrpc_set_wait()) set 000000005ae9b039 going to sleep for 11 seconds 00000100:00100000:2.0:1787560427.829935:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862688128 00000100:00100000:2.0:1787560427.829951:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862688128 00000100:00100000:2.0:1787560427.830015:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787560427.830024:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055148a32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+8:6476:x1874392862688128:12345-0@lo:501: 00000100:00100000:2.0:1787560427.830209:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055148a32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+9:6476:x1874392862688128:12345-0@lo:501: Request processed in 186us (5016us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560427.830217:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787560427.830534:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ea323bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6476:1874392862688128:0@lo:501: 00000100:00100000:3.0:1787560427.830578:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ea323bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6476:1874392862688256:0@lo:503: 00000100:00100000:3.0:1787560427.830627:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560427.830670:0:6476:0:(client.c:2715:ptlrpc_set_wait()) set 000000005ae9b039 going to sleep for 11 seconds 00000100:00100000:2.0:1787560427.830941:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862688256 00000100:00100000:2.0:1787560427.830947:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862688256 00000100:00100000:2.0:1787560427.830985:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787560427.830999:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000fba830c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+9:6476:x1874392862688256:12345-0@lo:503: 00000100:00100000:2.0:1787560427.831094:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000fba830c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+9:6476:x1874392862688256:12345-0@lo:503: Request processed in 97us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560427.831100:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787560427.831188:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ea323bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6476:1874392862688256:0@lo:503: 00000100:00100000:1.0:1787560427.831853:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004ba258b1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6520:1874392862688384:0@lo:502: 00000100:00100000:1.0:1787560427.831900:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560427.831969:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set 0000000066a61803 going to sleep for 11 seconds 00000100:00100000:0.0:1787560427.833268:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862688384 00000100:00100000:0.0:1787560427.833428:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862688384 00000100:00100000:0.0:1787560427.833610:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787560427.833620:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078f652cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+9:6520:x1874392862688384:12345-0@lo:502: 00000100:00100000:0.0:1787560427.834051:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078f652cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+9:6520:x1874392862688384:12345-0@lo:502: Request processed in 432us (2149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560427.834059:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787560427.834141:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004ba258b1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6520:1874392862688384:0@lo:502: 00000020:01000000:1.0:1787560427.834172:0:6520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560427.834183:0:6520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560427.834185:0:6520:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787560427.834190:0:6520:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787560427.834193:0:6520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787560427.834207:0:6520:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000001a01b036) 00000020:00000080:1.0:1787560427.834225:0:6520:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787560427.834230:0:6520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787560427.834349:0:6520:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787560427.834359:0:6520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4642c20bf2f33812 00000020:00000080:1.0:1787560427.834616:0:6520:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787560427.834621:0:6520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560427.834624:0:6520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560427.834625:0:6520:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787560427.834628:0:6520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560427.834636:0:6520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560427.834637:0:6520:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787560427.834641:0:6520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787560427.834648:0:6520:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000b2bb94be) 00000020:00000080:1.0:1787560427.834657:0:6520:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787560427.834661:0:6520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787560427.834662:0:6520:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787560427.834664:0:6520:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787560427.834670:0:6520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787560427.834724:0:6520:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009521a4a0 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787560427.834744:0:6520:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000bed062af) 00000020:00000080:1.0:1787560427.834753:0:6520:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787560427.834837:0:6520:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787560427.834843:0:6520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4642c20bf2f33827 00000020:00000080:1.0:1787560427.834935:0:6520:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787560427.834941:0:6520:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787560427.834945:0:6520:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4642c20bf2f3382e 00080000:01000000:1.0:1787560427.834949:0:6520:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787560427.834952:0:6520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4642c20bf2f33835 00080000:10000000:1.0:1787560427.835349:0:6520:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1787560427.835557:0:6520:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1787560427.854218:0:6520:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787560428.033048:0:6520:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787560428.036697:0:6520:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787560428.043567:0:6520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787560428.044156:0:6520:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787560428.051506:0:6520:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000ab76927a) 00000020:00000080:2.0:1787560428.051532:0:6520:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787560428.051628:0:6520:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787560428.051644:0:6520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4642c20bf2f33843 00000020:00000080:2.0:1787560428.061068:0:6520:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1787560428.061892:0:6520:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1787560428.066251:0:6520:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1787560428.078023:0:6520:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1787560428.084756:0:6520:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1787560428.100642:0:6520:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1787560428.106786:0:6520:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1787560428.111039:0:6520:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4642c20bf2f3384a 00000020:00000080:3.0:1787560428.112534:0:6520:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787560428.112547:0:6520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560428.112556:0:6520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560428.112568:0:6520:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787560428.112573:0:6520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560428.112576:0:6520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560428.112578:0:6520:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787560428.112581:0:6520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787560428.112582:0:6520:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787560428.112584:0:6520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560428.112599:0:6520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560428.112600:0:6520:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787560428.112602:0:6520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560428.112606:0:6520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560428.112607:0:6520:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787560428.112611:0:6520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787560428.112721:0:6520:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1787560428.112787:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000088a4cc4b pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6520:1874392862688512:0@lo:502: 00000100:00100000:3.0:1787560428.112859:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560428.112931:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c138687b going to sleep for 11 seconds 00000100:00100000:0.0:1787560428.115538:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862688512 00000100:00100000:0.0:1787560428.115554:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862688512 00000100:00100000:0.0:1787560428.115611:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787560428.115620:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000103acc56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+9:6520:x1874392862688512:12345-0@lo:502: 00000100:00100000:0.0:1787560428.115789:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000103acc56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+9:6520:x1874392862688512:12345-0@lo:502: Request processed in 170us (2930us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560428.115796:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787560428.116235:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000088a4cc4b pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6520:1874392862688512:0@lo:502: 00000020:01000000:2.0:1787560428.116338:0:6520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560428.116346:0:6520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560428.116349:0:6520:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1787560428.116353:0:6520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1787560428.116526:0:6476:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1787560428.116548:0:6476:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787560428.116559:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 00000000ab9165b8/0x4642c20bf2f337fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33804 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560428.116568:0:6476:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 00000000ab9165b8/0x4642c20bf2f337fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33804 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560428.116576:0:6476:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cb000817800 from 1 10000000:01000000:1.0:1787560428.116579:0:6476:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787560428.116631:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 00000000e17b388a/0x4642c20bf2f33851 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560428.116638:0:6476:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 00000000e17b388a/0x4642c20bf2f33851 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560428.116646:0:6476:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 00000000e17b388a/0x4642c20bf2f33851 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560428.116665:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004ba258b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6476:1874392862688640:0@lo:101: 00000100:00100000:1.0:1787560428.116708:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560428.116771:0:6476:0:(client.c:2715:ptlrpc_set_wait()) set 000000005da9a091 going to sleep for 11 seconds 00000100:00100000:2.0:1787560428.120018:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862688640 00000100:00100000:2.0:1787560428.120032:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862688640 00000100:00100000:2.0:1787560428.120097:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787560428.120105:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8a420ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+9:6476:x1874392862688640:12345-0@lo:101: 00010000:00010000:2.0:1787560428.120135:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560428.120152:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a2ae1078/0x4642c20bf2f33858 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33851 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560428.120175:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a2ae1078/0x4642c20bf2f33858 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33851 expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560428.120184:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a2ae1078/0x4642c20bf2f33858 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33851 expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560428.120192:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a2ae1078, rc 0) 00000100:00100000:2.0:1787560428.120261:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8a420ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+10:6476:x1874392862688640:12345-0@lo:101: Request processed in 157us (3554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560428.120267:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787560428.120554:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004ba258b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6476:1874392862688640:0@lo:101: 00010000:00010000:1.0:1787560428.120571:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 00000000e17b388a/0x4642c20bf2f33851 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33858 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560428.120579:0:6476:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 00000000e17b388a/0x4642c20bf2f33851 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33858 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560428.121055:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004ba258b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6476:1874392862688768:0@lo:256: 00000100:00100000:1.0:1787560428.121096:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560428.121126:0:6476:0:(client.c:2715:ptlrpc_set_wait()) set 000000005da9a091 going to sleep for 11 seconds 00000100:00100000:2.0:1787560428.122717:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862688768 00000100:00100000:2.0:1787560428.122730:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862688768 00000100:00100000:2.0:1787560428.122800:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787560428.122809:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f1714a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+10:6476:x1874392862688768:12345-0@lo:256: 20000000:01000000:2.0:1787560428.122831:0:6493:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787560428.122836:0:6493:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787560428.122946:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f1714a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+10:6476:x1874392862688768:12345-0@lo:256: Request processed in 139us (1850us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560428.122954:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787560428.127706:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004ba258b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6476:1874392862688768:0@lo:256: 10000000:01000000:1.0:1787560428.128590:0:6476:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787560428.128616:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 00000000e17b388a/0x4642c20bf2f33851 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33858 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560428.128628:0:6476:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 00000000e17b388a/0x4642c20bf2f33851 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33858 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560428.128650:0:6476:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cb000817800 from 1 10000000:01000000:1.0:1787560428.128653:0:6476:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787560428.128690:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 00000000ba72076c/0x4642c20bf2f3385f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560428.128698:0:6476:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 00000000ba72076c/0x4642c20bf2f3385f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560428.128706:0:6476:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 00000000ba72076c/0x4642c20bf2f3385f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560428.128727:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004ba258b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6476:1874392862688896:0@lo:101: 00000100:00100000:1.0:1787560428.128904:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560428.129010:0:6476:0:(client.c:2715:ptlrpc_set_wait()) set 000000005da9a091 going to sleep for 11 seconds 00000100:00100000:2.0:1787560428.130425:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862688896 00000100:00100000:2.0:1787560428.133467:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862688896 00000100:00100000:3.0:1787560428.134414:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787560428.134425:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002df1dc78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+10:6476:x1874392862688896:12345-0@lo:101: 00010000:00010000:3.0:1787560428.134473:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560428.134496:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004a445218/0x4642c20bf2f33866 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f3385f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560428.134521:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004a445218/0x4642c20bf2f33866 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f3385f expref: 11 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560428.134530:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004a445218/0x4642c20bf2f33866 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f3385f expref: 11 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560428.134556:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004a445218, rc 0) 00000100:00100000:3.0:1787560428.134648:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002df1dc78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+11:6476:x1874392862688896:12345-0@lo:101: Request processed in 225us (5743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560428.134663:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787560428.134994:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004ba258b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6476:1874392862688896:0@lo:101: 00010000:00010000:1.0:1787560428.135013:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 00000000ba72076c/0x4642c20bf2f3385f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33866 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560428.135021:0:6476:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 00000000ba72076c/0x4642c20bf2f3385f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33866 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560428.135090:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004ba258b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6476:1874392862689024:0@lo:501: 00000100:00100000:1.0:1787560428.135125:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560428.135166:0:6476:0:(client.c:2715:ptlrpc_set_wait()) set 000000005da9a091 going to sleep for 11 seconds 00000100:00100000:3.0:1787560428.135223:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862689024 00000100:00100000:3.0:1787560428.135229:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862689024 00000100:00100000:3.0:1787560428.135264:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787560428.135270:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ff9fe46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+11:6476:x1874392862689024:12345-0@lo:501: 00000100:00100000:3.0:1787560428.135456:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ff9fe46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+11:6476:x1874392862689024:12345-0@lo:501: Request processed in 186us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560428.135463:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787560428.135608:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004ba258b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6476:1874392862689024:0@lo:501: 00000100:00100000:1.0:1787560428.135634:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004ba258b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6476:1874392862689152:0@lo:503: 00000100:00100000:1.0:1787560428.135694:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560428.135719:0:6476:0:(client.c:2715:ptlrpc_set_wait()) set 000000005da9a091 going to sleep for 11 seconds 00000100:00100000:3.0:1787560428.135986:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862689152 00000100:00100000:3.0:1787560428.135992:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862689152 00000100:00100000:3.0:1787560428.136027:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787560428.136033:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0f9d011 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+11:6476:x1874392862689152:12345-0@lo:503: 00000040:00080000:3.0:1787560428.136068:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787560428.136118:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0f9d011 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+11:6476:x1874392862689152:12345-0@lo:503: Request processed in 85us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560428.136125:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787560428.138496:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004ba258b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6476:1874392862689152:0@lo:503: 00000040:00080000:1.0:1787560428.140296:0:6524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1787560428.140550:0:6476:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1787560428.140570:0:6476:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787560428.140581:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 00000000ba72076c/0x4642c20bf2f3385f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33866 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560428.140614:0:6476:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 00000000ba72076c/0x4642c20bf2f3385f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33866 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560428.140661:0:6476:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787560428.140663:0:6476:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cb000817800 10000000:01000000:2.0:1787560428.140666:0:6476:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cb000817800 10000000:01000000:2.0:1787560428.140670:0:6476:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787560428.140675:0:6476:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cb000817800 from 1 10000000:01000000:2.0:1787560428.140677:0:6476:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787560428.140706:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 0000000061dc78d9/0x4642c20bf2f3386d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560428.140713:0:6476:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 0000000061dc78d9/0x4642c20bf2f3386d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560428.140722:0:6476:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 0000000061dc78d9/0x4642c20bf2f3386d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560428.140741:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d48b2ca9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6476:1874392862689280:0@lo:101: 00000100:00100000:2.0:1787560428.140814:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560428.140851:0:6476:0:(client.c:2715:ptlrpc_set_wait()) set 000000007f3bad0d going to sleep for 11 seconds 00000100:00100000:3.0:1787560428.141355:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862689280 00000100:00100000:3.0:1787560428.141363:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862689280 00000100:00100000:3.0:1787560428.141422:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787560428.141454:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f1a5c0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+11:6476:x1874392862689280:12345-0@lo:101: 00010000:00010000:3.0:1787560428.141468:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560428.141481:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005cbf8db7/0x4642c20bf2f33874 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f3386d expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560428.141512:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005cbf8db7/0x4642c20bf2f33874 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f3386d expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560428.141520:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005cbf8db7/0x4642c20bf2f33874 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f3386d expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560428.141528:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005cbf8db7, rc 0) 00000100:00100000:3.0:1787560428.141570:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f1a5c0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+12:6476:x1874392862689280:12345-0@lo:101: Request processed in 140us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560428.141576:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787560428.142500:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d48b2ca9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6476:1874392862689280:0@lo:101: 00010000:00010000:2.0:1787560428.142516:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 0000000061dc78d9/0x4642c20bf2f3386d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33874 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560428.142526:0:6476:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 0000000061dc78d9/0x4642c20bf2f3386d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33874 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560428.142720:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d48b2ca9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6476:1874392862689408:0@lo:501: 00000100:00100000:2.0:1787560428.142970:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560428.143011:0:6476:0:(client.c:2715:ptlrpc_set_wait()) set 000000007f3bad0d going to sleep for 11 seconds 00000100:00100000:0.0:1787560428.143093:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862689408 00000100:00100000:0.0:1787560428.143100:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862689408 00000100:00100000:0.0:1787560428.143136:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787560428.143144:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015c8a2a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+12:6476:x1874392862689408:12345-0@lo:501: 00000100:00100000:0.0:1787560428.143270:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015c8a2a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+12:6476:x1874392862689408:12345-0@lo:501: Request processed in 127us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560428.143276:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787560428.143334:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d48b2ca9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6476:1874392862689408:0@lo:501: 00000100:00100000:0.0:1787560428.143380:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea405586 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6476:1874392862689536:0@lo:503: 00000100:00100000:0.0:1787560428.143458:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560428.143473:0:6476:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ef65eb71 going to sleep for 11 seconds 00000100:00100000:0.0:1787560428.143487:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862689536 00000100:00100000:0.0:1787560428.143491:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862689536 00000100:00100000:0.0:1787560428.143508:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787560428.143513:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d715ba8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+12:6476:x1874392862689536:12345-0@lo:503: 00000100:00100000:0.0:1787560428.143607:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d715ba8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+12:6476:x1874392862689536:12345-0@lo:503: Request processed in 92us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560428.143614:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787560428.143654:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea405586 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6476:1874392862689536:0@lo:503: 00000100:00100000:1.0:1787560428.152582:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004ba258b1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6525:1874392862689664:0@lo:502: 00000100:00100000:1.0:1787560428.152685:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560428.152733:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c93f220e going to sleep for 11 seconds 00000100:00100000:2.0:1787560428.153052:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862689664 00000100:00100000:2.0:1787560428.153060:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862689664 00000100:00100000:2.0:1787560428.153112:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787560428.153121:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013dfc784 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+12:6525:x1874392862689664:12345-0@lo:502: 00000100:00100000:2.0:1787560428.153250:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013dfc784 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+12:6525:x1874392862689664:12345-0@lo:502: Request processed in 130us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560428.153258:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787560428.156162:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004ba258b1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6525:1874392862689664:0@lo:502: 00000020:01000004:3.0:1787560428.156248:0:6525:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787560428.156282:0:6525:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000029c810b) 00000020:00000080:3.0:1787560428.156304:0:6525:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1787560428.156463:0:6525:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009521a4a0 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787560428.156467:0:6525:0:(tgt_mount.c:187:server_put_mount()) put mount 000000009521a4a0 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787560428.156470:0:6525:0:(obd_mount.c:710:lustre_put_lsi()) put 000000009521a4a0 4 00010000:00080000:3.0:1787560428.156505:0:6525:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006a41e16e@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.129@tcp at head 00010000:00010000:3.0:1787560428.158789:0:6525:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1787560428.158998:0:6525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787560428.159037:0:6525:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787560428.159051:0:6525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4642c20bf2f33882 00000100:00080000:3.0:1787560428.159063:0:6525:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787560428.159068:0:6525:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000006a41e16e using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787560428.159101:0:6525:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000088a4cc4b x1874392862689792/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787560428.159131:0:6525:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787560428.161174:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000088a4cc4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874392862689792:0@lo:38: 00000100:00100000:1.0:1787560428.161258:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560428.162939:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000caeafc6a pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6525:1874392862689920:0@lo:502: 00000100:00100000:3.0:1787560428.163013:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560428.163060:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set 0000000071085d17 going to sleep for 11 seconds 00000100:00100000:2.0:1787560428.163609:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862689920 00000100:00100000:2.0:1787560428.163617:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862689920 00000100:00100000:2.0:1787560428.163665:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787560428.163673:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e911497 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+12:6525:x1874392862689920:12345-0@lo:502: 00000100:00100000:2.0:1787560428.163818:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e911497 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+12:6525:x1874392862689920:12345-0@lo:502: Request processed in 145us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560428.163825:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787560428.164609:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862689792 00000100:00100000:0.0:1787560428.164619:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862689792 00000100:00100000:0.0:1787560428.164654:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787560428.164660:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003899a468 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1874392862689792:12345-0@lo:38: 00000100:00100000:0.0:1787560428.164723:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003899a468 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1874392862689792:12345-0@lo:38: Request processed in 62us (3466us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787560428.164729:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787560428.164778:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787560428.164786:0:3622:0:(import.c:65:import_set_state_nolock()) 000000006a41e16e lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787560428.164790:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787560428.164793:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000088a4cc4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874392862689792:0@lo:38: 00000100:00100000:3.0:1787560428.165140:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000caeafc6a pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6525:1874392862689920:0@lo:502: 00000040:00080000:3.0:1787560428.165174:0:6525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1787560428.165649:0:6476:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1787560428.165673:0:6476:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787560428.165691:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 0000000061dc78d9/0x4642c20bf2f3386d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33874 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560428.165701:0:6476:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 0000000061dc78d9/0x4642c20bf2f3386d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33874 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787560428.165748:0:6476:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787560428.165751:0:6476:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787560428.165752:0:6476:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787560428.165761:0:6476:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787560428.165762:0:6476:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787560428.165776:0:6476:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787560428.165777:0:6476:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787560428.165778:0:6476:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787560428.165779:0:6476:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787560428.165781:0:6476:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787560428.165782:0:6476:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787560428.165783:0:6476:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787560428.165786:0:6476:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1787560428.165788:0:6476:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787560428.165789:0:6476:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787560428.165790:0:6476:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787560428.165791:0:6476:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787560428.165792:0:6476:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787560428.165793:0:6476:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787560428.165793:0:6476:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787560428.165794:0:6476:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787560428.165795:0:6476:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787560428.165796:0:6476:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787560428.165797:0:6476:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787560428.165798:0:6476:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787560428.165816:0:6476:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787560428.165830:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea405586 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6476:1874392862690048:0@lo:253: 00000100:00100000:0.0:1787560428.165889:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560428.165918:0:6476:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ecf3b5cb going to sleep for 11 seconds 00000100:00100000:1.0:1787560428.166007:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862690048 00000100:00100000:1.0:1787560428.166014:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862690048 00000100:00100000:1.0:1787560428.166056:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787560428.166063:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059f1e19c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+12:6476:x1874392862690048:12345-0@lo:253: 20000000:01000000:1.0:1787560428.166085:0:6493:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787560428.166097:0:6493:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787560428.186189:0:6493:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787560428.186207:0:6493:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787560428.186461:0:6514:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787560428.186467:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787560428.186487:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000edec9a00/0x4642c20bf2f33889 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560428.186508:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a2ae1078/0x4642c20bf2f33858 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33851 expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560428.186515:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000edec9a00/0x4642c20bf2f33889 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560428.186553:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a2ae1078/0x4642c20bf2f33858 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f33851 expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560428.186593:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a2ae1078/0x4642c20bf2f33858 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f33851 expref: 12 pid: 6494 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560428.186607:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000023acc0dd pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6514:1874392862690176:0@lo:104: 00000100:00100000:0.0:1787560428.186687:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560428.186747:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 00000000186530dc going to sleep for 11 seconds 00000100:00100000:1.0:1787560428.186989:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059f1e19c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+12:6476:x1874392862690048:12345-0@lo:253: Request processed in 20925us (21098us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560428.187000:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787560428.187194:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862690176 00000100:00100000:3.0:1787560428.187202:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862690176 00000100:00100000:3.0:1787560428.187240:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787560428.187248:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026e01ac8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:6514:x1874392862690176:12345-0@lo:104: 00010000:00010000:3.0:1787560428.187260:0:6482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: 00000000e17b388a/0x4642c20bf2f33851 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33858 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560428.187310:0:6482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787560428.187325:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026e01ac8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:6514:x1874392862690176:12345-0@lo:104: Request processed in 79us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560428.187332:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787560428.187364:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000023acc0dd pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6514:1874392862690176:0@lo:104: 00010000:00010000:3.0:1787560428.187381:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000edec9a00/0x4642c20bf2f33889 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560428.189929:0:6487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560428.189940:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: 00000000e17b388a/0x4642c20bf2f33851 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33858 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560428.189952:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e17b388a already unused, calling callback (00000000fb88b142) 10000000:00010000:2.0:1787560428.189955:0:6487:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: 00000000e17b388a/0x4642c20bf2f33851 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33858 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560428.189964:0:6487:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: 00000000e17b388a/0x4642c20bf2f33851 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33858 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560428.189986:0:6487:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: 00000000e17b388a/0x4642c20bf2f33851 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33858 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560428.189992:0:6487:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787560428.190045:0:6487:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: 00000000e17b388a/0x4642c20bf2f33851 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33858 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560428.190052:0:6487:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787560428.190079:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: 00000000e17b388a/0x4642c20bf2f33851 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33858 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560428.190085:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: 00000000e17b388a/0x4642c20bf2f33851 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33858 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560428.190104:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560428.190105:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560428.190107:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560428.190404:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000909ed592 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862690304:0@lo:103: 00000100:00100000:3.0:1787560428.190499:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560428.192340:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862690304 00000100:00100000:2.0:1787560428.192352:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862690304 00010000:00010000:2.0:1787560428.192396:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a2ae1078/0x4642c20bf2f33858 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33851 expref: 12 pid: 6494 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560428.192459:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787560428.192469:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000caeafc6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+12:3624:x1874392862690304:12345-0@lo:103: 00010000:00010000:2.0:1787560428.192481:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560428.192486:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a2ae1078/0x4642c20bf2f33858 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33851 expref: 12 pid: 6494 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560428.192498:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a2ae1078/0x4642c20bf2f33858 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f33851 expref: 12 pid: 6494 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560428.192525:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a2ae1078/0x4642c20bf2f33858 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f33851 expref: 12 pid: 6494 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560428.192543:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000edec9a00/0x4642c20bf2f33889 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560428.192550:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000edec9a00/0x4642c20bf2f33889 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787560428.192566:0:6484:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006100602s 00010000:00010000:2.0:1787560428.192570:0:6484:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000edec9a00/0x4642c20bf2f33889 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560428.192576:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000edec9a00/0x4642c20bf2f33889 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560428.192582:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000edec9a00/0x4642c20bf2f33889 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560428.192587:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000edec9a00/0x4642c20bf2f33889 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560428.192593:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000edec9a00 already unused, calling callback (0000000018131874) 00010000:00010000:2.0:1787560428.192596:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000edec9a00/0x4642c20bf2f33889 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560428.192603:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000edec9a00/0x4642c20bf2f33889 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560428.192620:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000edec9a00/0x4642c20bf2f33889 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560428.192640:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560428.192705:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000caeafc6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+11:3624:x1874392862690304:12345-0@lo:103: Request processed in 238us (2206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560428.192712:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787560428.192767:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000909ed592 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862690304:0@lo:103: 00010000:00010000:2.0:1787560428.192792:0:6514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000edec9a00/0x4642c20bf2f33889 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560428.192799:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000edec9a00/0x4642c20bf2f33889 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560428.192805:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000edec9a00/0x4642c20bf2f33889 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560428.196684:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea405586 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6476:1874392862690048:0@lo:253: 10000000:01000000:0.0:1787560428.196704:0:6476:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787560428.196707:0:6476:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787560428.196709:0:6476:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787560428.196710:0:6476:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787560428.196711:0:6476:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787560428.196712:0:6476:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787560428.196714:0:6476:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787560428.196715:0:6476:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787560428.196716:0:6476:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787560428.196717:0:6476:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787560428.196718:0:6476:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787560428.196720:0:6476:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787560428.196721:0:6476:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787560428.196747:0:6476:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787560428.208627:0:6476:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:1.0:1787560428.208956:0:6476:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1787560428.209582:0:6476:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:1.0:1787560428.210098:0:6476:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1787560428.210343:0:6476:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1787560428.212131:0:6476:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1787560428.215068:0:6476:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1787560428.215253:0:6476:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1787560428.215489:0:6476:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1787560428.215646:0:6476:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1787560428.215838:0:6476:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1787560428.215987:0:6476:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1787560428.235135:0:6476:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1787560428.258301:0:6476:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1787560428.258686:0:6530:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1787560428.258690:0:6530:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1787560428.258888:0:6531:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787560428.265464:0:6476:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787560428.265586:0:6476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787560428.267116:0:6476:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787560428.275183:0:6476:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787560428.293568:0:6476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787560428.295159:0:6476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787560428.296293:0:6476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:00080000:2.0:1787560428.297189:0:6531:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1787560428.298061:0:6476:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1787560428.308613:0:6476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1787560428.308902:0:6476:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:1.0:1787560428.309588:0:6476:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1787560428.309744:0:6476:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1787560428.309912:0:6476:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1787560428.310051:0:6476:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1787560428.310189:0:6476:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1787560428.310316:0:6476:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1787560428.310486:0:6476:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1787560428.310636:0:6476:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1787560428.310766:0:6476:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1787560428.310906:0:6476:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1787560428.311054:0:6476:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1787560428.311202:0:6476:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1787560428.311343:0:6476:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00000040:00080000:2.0:1787560428.312252:0:6531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787560428.316160:0:6531:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787560428.316185:0:6531:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:1.0:1787560428.322872:0:6476:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1787560428.323155:0:6476:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1787560428.324015:0:6476:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1787560428.325011:0:6476:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1787560428.325199:0:6476:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1787560428.329011:0:6476:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1787560428.329215:0:6476:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1787560428.329370:0:6476:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1787560428.329583:0:6476:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1787560428.337189:0:6476:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1787560428.337346:0:6476:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1787560428.343727:0:6476:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1787560428.344184:0:6476:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1787560428.344668:0:6476:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1787560428.345011:0:6476:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1787560428.345158:0:6476:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1787560428.345304:0:6476:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1787560428.347080:0:6476:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1787560428.347209:0:6476:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1787560428.347425:0:6476:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1787560428.360067:0:6476:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787560428.360110:0:6476:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb6db41c47988 00100000:10000000:0.0:1787560428.360118:0:6476:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787560428.361106:0:6476:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787560428.361123:0:6476:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.129@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787560428.361140:0:6476:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1787560428.361158:0:6476:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1787560428.362260:0:6476:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787560428.368852:0:6476:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1787560428.536475:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560429.557623:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560430.587073:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560431.606012:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560432.627565:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787560433.203675:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787560433.203685:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787560433.203688:0:37:0:(import.c:65:import_set_state_nolock()) 000000006a41e16e lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787560433.203701:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000006a41e16e using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560433.203722:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000092bbe5f6 x1874392862690560/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787560433.203957:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000909ed592 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862690432:0@lo:400: 00000100:00100000:0.0:1787560433.204029:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560433.204124:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000092bbe5f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874392862690560:0@lo:38: 00000100:00100000:0.0:1787560433.204152:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560433.204269:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862690432 00000100:00100000:2.0:1787560433.204276:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862690432 00000100:00100000:2.0:1787560433.204327:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787560433.204336:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db387b61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+11:3625:x1874392862690432:12345-0@lo:400: 00000100:00100000:2.0:1787560433.204400:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db387b61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+11:3625:x1874392862690432:12345-0@lo:400: Request processed in 65us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560433.204407:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787560433.204511:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000909ed592 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862690432:0@lo:400: 00000100:00100000:1.0:1787560433.213502:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862690560 00000100:00100000:1.0:1787560433.213519:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862690560 00000100:00100000:1.0:1787560433.213567:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787560433.213575:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea405586 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1874392862690560:12345-0@lo:38: 00010000:00080000:1.0:1787560433.213603:0:6500:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 152 last 0 00000020:00000080:1.0:1787560433.213642:0:6500:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4642c20bf2f33890 00000004:00100000:1.0:1787560433.213708:0:6500:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787560433.213819:0:6500:0:(import.c:65:import_set_state_nolock()) 00000000a37d9a7b : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787560433.213907:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea405586 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1874392862690560:12345-0@lo:38: Request processed in 331us (9754us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560433.213915:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787560433.214361:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000092bbe5f6 x1874392862690560/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787560443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787560433.214379:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787560433.214386:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787560433.214391:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787560433.214393:0:3622:0:(import.c:65:import_set_state_nolock()) 000000006a41e16e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787560433.214399:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000092bbe5f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874392862690560:0@lo:38: 00010000:00010000:0.0:1787560433.661416:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787560434.305840:0:6776:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787560434.683527:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787560435.364777:0:6828:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787560435.364967:0:6828:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787560435.701959:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560436.723576:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787560436.787987:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787560436.787993:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cb000817800 from 3 10000000:01000000:0.0:1787560436.787998:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787560436.788044:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 00000000dac89b57/0x4642c20bf2f33897 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560436.788057:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 00000000dac89b57/0x4642c20bf2f33897 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560436.788067:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 00000000dac89b57/0x4642c20bf2f33897 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560436.788089:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b67232b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862690688:0@lo:101: 00000100:00100000:0.0:1787560436.788157:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560436.788236:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000942f96af going to sleep for 11 seconds 00000100:00100000:2.0:1787560436.788657:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862690688 00000100:00100000:2.0:1787560436.788666:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862690688 00000100:00100000:2.0:1787560436.788712:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787560436.788720:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057c72df0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+11:6497:x1874392862690688:12345-0@lo:101: 00010000:00010000:2.0:1787560436.788732:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560436.788743:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001eb81e2b/0x4642c20bf2f3389e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33897 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560436.788763:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001eb81e2b/0x4642c20bf2f3389e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33897 expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560436.788783:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001eb81e2b/0x4642c20bf2f3389e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33897 expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560436.788791:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001eb81e2b, rc 0) 00000100:00100000:2.0:1787560436.788847:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057c72df0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+12:6497:x1874392862690688:12345-0@lo:101: Request processed in 128us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560436.788853:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787560436.789645:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b67232b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862690688:0@lo:101: 00010000:00010000:1.0:1787560436.789663:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 00000000dac89b57/0x4642c20bf2f33897 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3389e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560436.789672:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 00000000dac89b57/0x4642c20bf2f33897 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f3389e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560436.789729:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000278297f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862690816:0@lo:256: 00000100:00100000:1.0:1787560436.789767:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560436.789789:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ec41e649 going to sleep for 11 seconds 00000100:00100000:0.0:1787560436.789848:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862690816 00000100:00100000:0.0:1787560436.789854:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862690816 00000100:00100000:0.0:1787560436.789892:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787560436.789899:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d241621f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+12:6497:x1874392862690816:12345-0@lo:256: 20000000:01000000:0.0:1787560436.789914:0:6492:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787560436.789929:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787560436.789932:0:6492:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787560436.790138:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d241621f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+12:6497:x1874392862690816:12345-0@lo:256: Request processed in 239us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560436.790145:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787560436.795163:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000278297f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862690816:0@lo:256: 10000000:01000000:1.0:1787560436.795232:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787560436.795249:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 00000000dac89b57/0x4642c20bf2f33897 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3389e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560436.795259:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 00000000dac89b57/0x4642c20bf2f33897 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3389e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560437.753249:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560438.326781:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000096572c4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862691072:0@lo:400: 00000100:00100000:0.0:1787560438.326856:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560438.326945:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862691072 00000100:00100000:0.0:1787560438.326954:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862691072 00000100:00100000:0.0:1787560438.326997:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787560438.327006:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2b5c70b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862691072:12345-0@lo:400: 00000100:00100000:0.0:1787560438.327056:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2b5c70b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862691072:12345-0@lo:400: Request processed in 51us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560438.327063:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787560438.327098:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000096572c4d x1874392862691072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560438.327111:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000096572c4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862691072:0@lo:400: 00000100:00100000:3.0:1787560438.327157:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787560438.327165:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a0e264d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862690944:0@lo:400: 00000100:00100000:3.0:1787560438.327202:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560438.327544:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862690944 00000100:00100000:0.0:1787560438.327549:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862690944 00000100:00100000:0.0:1787560438.327579:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787560438.327584:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd98b7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+12:3625:x1874392862690944:12345-0@lo:400: 00000100:00100000:0.0:1787560438.327627:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd98b7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+12:3625:x1874392862690944:12345-0@lo:400: Request processed in 44us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560438.327633:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787560438.327741:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a0e264d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862690944:0@lo:400: 00000020:00000004:1.0:1787560438.662525:0:6930:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787560438.662704:0:6930:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787560438.773912:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560439.797971:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560440.821406:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560441.852495:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560442.867556:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560443.445932:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004f10d71c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862691200:0@lo:400: 00000100:00100000:3.0:1787560443.446138:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560443.446218:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009588fb2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862691328:0@lo:400: 00000100:00100000:3.0:1787560443.446254:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560443.446298:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862691200 00000100:00100000:3.0:1787560443.446307:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862691200 00000100:00100000:3.0:1787560443.446348:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787560443.446358:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e229ef86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+12:3624:x1874392862691200:12345-0@lo:400: 00000100:00100000:3.0:1787560443.446405:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e229ef86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+12:3624:x1874392862691200:12345-0@lo:400: Request processed in 49us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560443.446412:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787560443.446462:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862691328 00000100:00100000:3.0:1787560443.446466:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862691328 00000100:00100000:3.0:1787560443.446492:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787560443.446499:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000640ba45c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862691328:12345-0@lo:400: 00000100:00100000:3.0:1787560443.446535:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000640ba45c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862691328:12345-0@lo:400: Request processed in 39us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560443.446541:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787560443.446570:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004f10d71c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862691200:0@lo:400: 00010000:00080000:3.0:1787560443.446596:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009588fb2c x1874392862691328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560443.446606:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009588fb2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862691328:0@lo:400: 00010000:00010000:1.0:1787560443.892624:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560444.916411:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560445.939735:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560446.965503:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560447.988589:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560448.563777:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787560448.563808:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000096572c4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862691456:0@lo:400: 00000100:00100000:2.0:1787560448.563809:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004911b1d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862691584:0@lo:400: 00000100:00100000:2.0:1787560448.563921:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560448.563987:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862691584 00000100:00100000:0.0:1787560448.563996:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862691584 00000100:00100000:0.0:1787560448.564059:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787560448.564070:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000829fdef5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862691584:12345-0@lo:400: 00000100:00100000:1.0:1787560448.565838:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560448.565939:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862691456 00000100:00100000:1.0:1787560448.565948:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862691456 00000100:00100000:1.0:1787560448.567454:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787560448.567468:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052d462c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+12:3625:x1874392862691456:12345-0@lo:400: 00000100:00100000:1.0:1787560448.567565:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052d462c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+12:3625:x1874392862691456:12345-0@lo:400: Request processed in 101us (1733us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560448.567573:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787560448.567853:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000829fdef5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862691584:12345-0@lo:400: Request processed in 3784us (3932us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560448.567864:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787560448.567912:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004911b1d0 x1874392862691584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560448.567932:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004911b1d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862691584:0@lo:400: 00000100:00100000:2.0:1787560448.574627:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000096572c4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862691456:0@lo:400: 00010000:00010000:1.0:1787560449.011770:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560450.036314:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787560450.554550:0:7428:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787560450.554556:0:7428:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787560450.554557:0:7428:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787560450.554862:0:7428:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000002788c314 00000020:01000004:2.0:1787560450.554878:0:7428:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1787560450.554899:0:7428:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787560450.554914:0:7428:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000e6274bf3) 00000020:00000080:2.0:1787560450.554930:0:7428:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787560450.703188:0:7428:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1787560450.703284:0:7428:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1787560450.764907:0:7428:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787560450.765719:0:7428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1787560450.765738:0:7428:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787560450.765751:0:7428:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4642c20bf2f338ac 00000020:01000004:2.0:1787560450.765759:0:7428:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787560450.765781:0:7428:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.129@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787560450.765784:0:7428:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787560450.765790:0:7428:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1787560450.765817:0:7428:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1787560450.765821:0:7428:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.129@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1787560450.802928:0:7428:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787560450.803042:0:7428:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.129@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1787560450.803047:0:7428:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787560450.803049:0:7428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787560450.803051:0:7428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787560450.803052:0:7428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787560450.803053:0:7428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787560450.803054:0:7428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787560450.803055:0:7428:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787560450.803057:0:7428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787560450.803058:0:7428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787560450.803060:0:7428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787560450.803061:0:7428:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787560450.803064:0:7428:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1787560450.803067:0:7428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787560450.803068:0:7428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787560450.803070:0:7428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787560450.803071:0:7428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787560450.803072:0:7428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787560450.803073:0:7428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787560450.803074:0:7428:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787560450.803075:0:7428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787560450.803076:0:7428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787560450.803077:0:7428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787560450.803078:0:7428:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787560450.803107:0:7428:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787560450.803128:0:7428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009588fb2c pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862691712:0@lo:253: 00000100:00100000:3.0:1787560450.803287:0:7428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560450.803395:0:7428:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d38d80bb going to sleep for 11 seconds 00000100:00100000:0.0:1787560450.805927:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862691712 00000100:00100000:0.0:1787560450.805945:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862691712 00000100:00100000:0.0:1787560450.806337:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787560450.806347:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef4c667f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+12:7428:x1874392862691712:12345-0@lo:253: 20000000:01000000:0.0:1787560450.806402:0:6494:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787560450.806407:0:6494:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1787560450.806411:0:6494:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1787560450.806415:0:6494:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1787560450.806712:0:6494:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1787560450.807319:0:6494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787560450.807850:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1787560450.807866:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787560450.807883:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1787560450.807898:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1787560450.807914:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1787560450.808292:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1787560450.808303:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1787560450.808318:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1787560450.808323:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1787560450.808334:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1787560450.808338:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1787560450.808350:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1787560450.808362:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1787560450.809346:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1787560450.809360:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.129@tcp (null) (null) (null) 00000040:00080000:0.0:1787560450.809688:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1787560450.809697:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787560450.809712:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1787560450.809718:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.129@tcp (null) (null) 00000040:00080000:0.0:1787560450.809731:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1787560450.809737:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787560450.809749:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1787560450.809781:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1787560450.809792:0:6494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1787560450.809894:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1787560450.809903:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1787560450.809915:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1787560450.809931:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1787560450.809946:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1787560450.809952:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1787560450.809965:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1787560450.810213:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1787560450.810221:0:6494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1787560450.810263:0:6494:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787560450.810271:0:6494:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:2.0:1787560450.825108:0:7434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1787560450.829402:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1787560450.829463:0:6494:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.129@tcp for mdt 20000000:01000000:1.0:1787560450.829466:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.129@tcp (null) (null) (null) 00000040:00080000:1.0:1787560450.829492:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1787560450.829499:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787560450.829512:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1787560450.829517:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.129@tcp (null) (null) 00000040:00080000:1.0:1787560450.829534:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1787560450.829542:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:1.0:1787560450.829555:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:1.0:1787560450.829580:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:1.0:1787560450.829636:0:6494:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:1.0:1787560450.829645:0:6494:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1787560450.830216:0:7435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1787560450.830463:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1787560450.830482:0:6494:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.129@tcp for mdt 20000000:01000000:2.0:1787560450.830484:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.129@tcp (null) (null) (null) 00000040:00080000:2.0:1787560450.830499:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1787560450.830506:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787560450.830518:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1787560450.830523:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.129@tcp (null) (null) 00000040:00080000:2.0:1787560450.830534:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1787560450.830540:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1787560450.830552:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1787560450.830566:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1787560450.830594:0:6494:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787560450.830598:0:6494:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787560450.830603:0:6494:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787560450.830661:0:6494:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1787560450.830663:0:6494:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787560450.831480:0:7436:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1787560450.831504:0:7436:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1787560450.831518:0:7436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:1.0:1787560450.831749:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1787560450.831769:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1787560450.831784:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:1.0:1787560450.831796:0:6494:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787560450.831799:0:6494:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787560450.837999:0:7437:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1787560450.838078:0:7437:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1787560450.838095:0:7437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1787560450.838386:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1787560450.838423:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1787560450.838485:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1787560450.838501:0:6494:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787560450.838503:0:6494:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787560450.839092:0:7438:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1787560450.839112:0:7438:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1787560450.839127:0:7438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1787560450.839331:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:0.0:1787560450.839353:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:0.0:1787560450.839379:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:0.0:1787560450.839395:0:6494:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787560450.839397:0:6494:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787560450.839402:0:6494:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1787560450.839409:0:6494:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1787560450.839960:0:7439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:0.0:1787560450.840112:0:6494:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787560450.862856:0:6494:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787560450.863516:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005283323a/0x4642c20bf2f338b3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560450.863539:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f39b93b9/0x4642c20bf2f337e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f337e1 expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560450.863546:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001f4dd5ed/0x4642c20bf2f33804 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f337fd expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560450.863551:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005cbf8db7/0x4642c20bf2f33874 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f3386d expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560450.863587:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005283323a/0x4642c20bf2f338b3 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560450.863632:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005cbf8db7/0x4642c20bf2f33874 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f3386d expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560450.863645:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005cbf8db7/0x4642c20bf2f33874 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f3386d expref: 12 pid: 6492 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560450.863658:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000278297f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6494:1874392862691840:0@lo:104: 00000100:00100000:1.0:1787560450.863728:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787560450.863795:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001f4dd5ed/0x4642c20bf2f33804 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f337fd expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560450.863803:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001f4dd5ed/0x4642c20bf2f33804 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f337fd expref: 12 pid: 6494 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560450.863810:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000085793113 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6494:1874392862691968:0@lo:104: 00000100:00100000:1.0:1787560450.863830:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787560450.863859:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f39b93b9/0x4642c20bf2f337e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f337e1 expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560450.863866:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f39b93b9/0x4642c20bf2f337e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f337e1 expref: 12 pid: 6493 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560450.863872:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a72a3fb pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6494:1874392862692096:0@lo:104: 00000100:00100000:1.0:1787560450.863891:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560450.863901:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 000000008d1fa846 going to sleep for 11 seconds 00000100:00100000:2.0:1787560450.864033:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862691840 00000100:00100000:2.0:1787560450.864043:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862691840 00000100:00100000:2.0:1787560450.864090:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862691968 00000100:00100000:2.0:1787560450.864093:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862691968 00000100:00100000:2.0:1787560450.864104:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862692096 00000100:00100000:2.0:1787560450.864107:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862692096 00000100:00100000:2.0:1787560450.864120:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787560450.864128:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a490d231 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+5:6494:x1874392862691840:12345-0@lo:104: 00010000:00010000:2.0:1787560450.864142:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: 0000000061dc78d9/0x4642c20bf2f3386d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33874 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.864206:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787560450.864211:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a490d231 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+5:6494:x1874392862691840:12345-0@lo:104: Request processed in 84us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560450.864217:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787560450.864245:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787560450.864250:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d2ff0da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+4:6494:x1874392862691968:12345-0@lo:104: 00010000:00010000:2.0:1787560450.864257:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: 00000000ab9165b8/0x4642c20bf2f337fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33804 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.864287:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787560450.864292:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d2ff0da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+4:6494:x1874392862691968:12345-0@lo:104: Request processed in 43us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560450.864297:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787560450.864307:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787560450.864312:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bcd8aa34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:6494:x1874392862692096:12345-0@lo:104: 00010000:00010000:2.0:1787560450.864319:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: 00000000219b95b9/0x4642c20bf2f337e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f337e8 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.864342:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787560450.864352:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bcd8aa34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:6494:x1874392862692096:12345-0@lo:104: Request processed in 40us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560450.864358:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787560450.864373:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787560450.864378:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: 0000000061dc78d9/0x4642c20bf2f3386d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33874 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.864385:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000061dc78d9 already unused, calling callback (00000000fb88b142) 10000000:00010000:2.0:1787560450.864388:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: 0000000061dc78d9/0x4642c20bf2f3386d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33874 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.864394:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: 0000000061dc78d9/0x4642c20bf2f3386d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33874 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560450.864400:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: 0000000061dc78d9/0x4642c20bf2f3386d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33874 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560450.864405:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787560450.864459:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: 0000000061dc78d9/0x4642c20bf2f3386d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33874 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.864466:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787560450.864482:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: 0000000061dc78d9/0x4642c20bf2f3386d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33874 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.864487:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: 0000000061dc78d9/0x4642c20bf2f3386d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33874 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.864501:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787560450.864503:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: 00000000ab9165b8/0x4642c20bf2f337fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33804 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.864519:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ab9165b8 already unused, calling callback (00000000fb88b142) 10000000:00010000:2.0:1787560450.864520:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: 00000000ab9165b8/0x4642c20bf2f337fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33804 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.864526:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: 00000000ab9165b8/0x4642c20bf2f337fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33804 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560450.864531:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: 00000000ab9165b8/0x4642c20bf2f337fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33804 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560450.864536:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787560450.864549:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: 00000000ab9165b8/0x4642c20bf2f337fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33804 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.864554:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787560450.864567:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: 00000000ab9165b8/0x4642c20bf2f337fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33804 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.864635:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: 00000000ab9165b8/0x4642c20bf2f337fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33804 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.864645:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560450.864647:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: 00000000219b95b9/0x4642c20bf2f337e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f337e8 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.864652:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000219b95b9 already unused, calling callback (00000000fb88b142) 10000000:00010000:2.0:1787560450.864654:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: 00000000219b95b9/0x4642c20bf2f337e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f337e8 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.864668:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: 00000000219b95b9/0x4642c20bf2f337e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f337e8 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560450.864673:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: 00000000219b95b9/0x4642c20bf2f337e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f337e8 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560450.864678:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787560450.864691:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: 00000000219b95b9/0x4642c20bf2f337e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f337e8 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.864696:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787560450.864700:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: 00000000219b95b9/0x4642c20bf2f337e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f337e8 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.864706:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: 00000000219b95b9/0x4642c20bf2f337e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f337e8 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.864719:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560450.864720:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560450.864722:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560450.864728:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560450.864746:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000057c737a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862692224:0@lo:103: 00000100:00100000:2.0:1787560450.864776:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560450.864816:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007fa5a737 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862692352:0@lo:103: 00000100:00100000:2.0:1787560450.864839:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560450.864857:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787560450.864862:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001384c1e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862692480:0@lo:103: 00000100:00100000:2.0:1787560450.864880:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560450.864914:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862692224 00000100:00100000:2.0:1787560450.864919:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862692224 00010000:00010000:2.0:1787560450.864937:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005cbf8db7/0x4642c20bf2f33874 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f3386d expref: 13 pid: 6492 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560450.864951:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862692352 00000100:00100000:2.0:1787560450.864953:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862692352 00010000:00010000:2.0:1787560450.864962:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001f4dd5ed/0x4642c20bf2f33804 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f337fd expref: 14 pid: 6494 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560450.864970:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862692480 00000100:00100000:2.0:1787560450.864973:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862692480 00010000:00010000:2.0:1787560450.864980:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f39b93b9/0x4642c20bf2f337e8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f337e1 expref: 15 pid: 6493 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560450.864991:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787560450.864996:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6c88b7e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:3624:x1874392862692224:12345-0@lo:103: 00010000:00010000:2.0:1787560450.865007:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560450.865010:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005cbf8db7/0x4642c20bf2f33874 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f3386d expref: 15 pid: 6492 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.865020:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005cbf8db7/0x4642c20bf2f33874 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f3386d expref: 15 pid: 6492 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.865035:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560450.865060:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6c88b7e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:3624:x1874392862692224:12345-0@lo:103: Request processed in 64us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560450.865067:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787560450.865078:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787560450.865083:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000346ab37e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+14:3625:x1874392862692352:12345-0@lo:103: 00010000:00010000:2.0:1787560450.865090:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560450.865099:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001f4dd5ed/0x4642c20bf2f33804 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f337fd expref: 14 pid: 6494 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.865107:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001f4dd5ed/0x4642c20bf2f33804 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f337fd expref: 14 pid: 6494 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.865117:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560450.865142:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000346ab37e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+14:3625:x1874392862692352:12345-0@lo:103: Request processed in 59us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560450.865148:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787560450.865159:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787560450.865165:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064452807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+13:3625:x1874392862692480:12345-0@lo:103: 00010000:00010000:2.0:1787560450.865172:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560450.865175:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f39b93b9/0x4642c20bf2f337e8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f337e1 expref: 13 pid: 6493 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.865183:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f39b93b9/0x4642c20bf2f337e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f337e1 expref: 13 pid: 6493 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.865194:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005283323a/0x4642c20bf2f338b3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.865200:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005283323a/0x4642c20bf2f338b3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.865211:0:6484:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005283323a/0x4642c20bf2f338b3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.865218:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005283323a/0x4642c20bf2f338b3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.865223:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005283323a/0x4642c20bf2f338b3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.865245:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005283323a/0x4642c20bf2f338b3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.865249:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005283323a already unused, calling callback (0000000018131874) 00010000:00010000:2.0:1787560450.865252:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005283323a/0x4642c20bf2f338b3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.865259:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005283323a/0x4642c20bf2f338b3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.865265:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005283323a/0x4642c20bf2f338b3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.865274:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560450.865296:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064452807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+13:3625:x1874392862692480:12345-0@lo:103: Request processed in 132us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560450.865302:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787560450.865339:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000057c737a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862692224:0@lo:103: 00000100:00100000:2.0:1787560450.865361:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001384c1e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862692480:0@lo:103: 00000100:00100000:2.0:1787560450.865368:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007fa5a737 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862692352:0@lo:103: 00010000:00010000:1.0:1787560450.866599:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005cbf8db7/0x4642c20bf2f33874 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f3386d expref: 12 pid: 6492 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560450.866629:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000278297f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6494:1874392862691840:0@lo:104: 00010000:00010000:1.0:1787560450.866644:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001f4dd5ed/0x4642c20bf2f33804 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f337fd expref: 11 pid: 6494 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560450.866651:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000085793113 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6494:1874392862691968:0@lo:104: 00010000:00010000:1.0:1787560450.866659:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f39b93b9/0x4642c20bf2f337e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f337e1 expref: 10 pid: 6493 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560450.866668:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a72a3fb pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6494:1874392862692096:0@lo:104: 00010000:00010000:1.0:1787560450.866687:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005283323a/0x4642c20bf2f338b3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560450.866696:0:6494:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005283323a/0x4642c20bf2f338b3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560450.866701:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005283323a/0x4642c20bf2f338b3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560450.866707:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005283323a/0x4642c20bf2f338b3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787560450.866723:0:6494:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1787560450.871249:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef4c667f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+9:7428:x1874392862691712:12345-0@lo:253: Request processed in 64896us (67956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560450.871265:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787560450.871712:0:7428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009588fb2c pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862691712:0@lo:253: 10000000:01000000:2.0:1787560450.871732:0:7428:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787560450.871735:0:7428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787560450.871737:0:7428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787560450.871738:0:7428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560450.871740:0:7428:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1787560450.871741:0:7428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560450.871757:0:7428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560450.871758:0:7428:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787560450.871759:0:7428:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787560450.871761:0:7428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560450.871762:0:7428:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787560450.871784:0:7428:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002788c314 from lustre-MDT0001 10000000:01000000:2.0:1787560450.871813:0:7428:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1787560450.871816:0:7428:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787560450.871823:0:7428:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9cafe06b3370 local copy 10000000:01000000:2.0:1787560450.871827:0:7428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787560450.871866:0:7428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 000000006d1480ab/0x4642c20bf2f338ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.871877:0:7428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.129@tcp lock: 000000006d1480ab/0x4642c20bf2f338ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.871886:0:7428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 000000006d1480ab/0x4642c20bf2f338ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560450.871904:0:7428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007fa5a737 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862692608:0@lo:101: 00000100:00100000:2.0:1787560450.871944:0:7428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560450.872120:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862692608 00000100:00100000:1.0:1787560450.872127:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862692608 00000100:00100000:2.0:1787560450.872175:0:7428:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f7f45566 going to sleep for 11 seconds 00000100:00100000:1.0:1787560450.877797:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787560450.877843:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ed8f8e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+9:7428:x1874392862692608:12345-0@lo:101: 00010000:00010000:1.0:1787560450.877866:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560450.877887:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000aeb3be7a/0x4642c20bf2f338c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f338ba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560450.877915:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aeb3be7a/0x4642c20bf2f338c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f338ba expref: 10 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560450.877925:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000aeb3be7a/0x4642c20bf2f338c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f338ba expref: 10 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560450.877934:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000aeb3be7a, rc 0) 00000100:00100000:1.0:1787560450.878662:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ed8f8e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+10:7428:x1874392862692608:12345-0@lo:101: Request processed in 827us (6715us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560450.878671:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787560450.878828:0:7428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007fa5a737 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862692608:0@lo:101: 00010000:00010000:2.0:1787560450.878852:0:7428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 000000006d1480ab/0x4642c20bf2f338ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x4642c20bf2f338c1 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560450.878861:0:7428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 000000006d1480ab/0x4642c20bf2f338ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4642c20bf2f338c1 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560450.878992:0:7428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007fa5a737 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862692736:0@lo:501: 00000100:00100000:2.0:1787560450.879026:0:7428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560450.879078:0:7428:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f7f45566 going to sleep for 11 seconds 00000100:00100000:1.0:1787560450.879364:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862692736 00000100:00100000:1.0:1787560450.879380:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862692736 00000100:00100000:1.0:1787560450.879416:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787560450.879424:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007baac106 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+10:7428:x1874392862692736:12345-0@lo:501: 00000100:00100000:1.0:1787560450.879530:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007baac106 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+10:7428:x1874392862692736:12345-0@lo:501: Request processed in 107us (504us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787560450.879537:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787560450.879617:0:7428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007fa5a737 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862692736:0@lo:501: 10000000:01000000:3.0:1787560450.879631:0:7428:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787560450.879658:0:7428:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787560450.879663:0:7428:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 000000006d1480ab/0x4642c20bf2f338ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4642c20bf2f338c1 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560450.879670:0:7428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 000000006d1480ab/0x4642c20bf2f338ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4642c20bf2f338c1 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560450.879676:0:7428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: 000000006d1480ab/0x4642c20bf2f338ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4642c20bf2f338c1 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560450.879701:0:7428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787560450.879724:0:7428:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9caffba72800 10000000:01000000:3.0:1787560450.879729:0:7428:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787560450.879733:0:7428:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9cafe06b3370 10000000:01000000:3.0:1787560450.879736:0:7428:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787560450.879739:0:7428:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9cafe06b3370 from 1 10000000:01000000:3.0:1787560450.879741:0:7428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787560450.879763:0:7428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 0000000025a16cb0/0x4642c20bf2f338c8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560450.879769:0:7428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 0000000025a16cb0/0x4642c20bf2f338c8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560450.879776:0:7428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 0000000025a16cb0/0x4642c20bf2f338c8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560450.879787:0:7428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004f10d71c pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862692864:0@lo:101: 00000100:00100000:3.0:1787560450.879814:0:7428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560450.879838:0:7428:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b8dcc9d1 going to sleep for 11 seconds 00000100:00100000:0.0:1787560450.879951:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862692864 00000100:00100000:0.0:1787560450.879955:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862692864 00000100:00100000:0.0:1787560450.879998:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787560450.880004:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e990469 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+10:7428:x1874392862692864:12345-0@lo:101: 00010000:00010000:0.0:1787560450.880012:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560450.880023:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006439848f/0x4642c20bf2f338cf lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f338c8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560450.880048:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006439848f/0x4642c20bf2f338cf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f338c8 expref: 11 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560450.880057:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006439848f/0x4642c20bf2f338cf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f338c8 expref: 11 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560450.880065:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006439848f, rc 0) 00000100:00100000:0.0:1787560450.880093:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e990469 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+11:7428:x1874392862692864:12345-0@lo:101: Request processed in 90us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560450.880099:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787560450.880329:0:7428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004f10d71c pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862692864:0@lo:101: 00010000:00010000:3.0:1787560450.880345:0:7428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 0000000025a16cb0/0x4642c20bf2f338c8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f338cf expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560450.880353:0:7428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 0000000025a16cb0/0x4642c20bf2f338c8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f338cf expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560450.880367:0:7428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787560450.880379:0:7428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 0000000025a16cb0/0x4642c20bf2f338c8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f338cf expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560450.880386:0:7428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 0000000025a16cb0/0x4642c20bf2f338c8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f338cf expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560450.880394:0:7428:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9caffba72800 10000000:01000000:3.0:1787560450.880397:0:7428:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787560450.880400:0:7428:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9caffba72800 from 1 10000000:01000000:3.0:1787560450.880402:0:7428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787560450.880415:0:7428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 0000000091677b5f/0x4642c20bf2f338d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560450.880420:0:7428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 0000000091677b5f/0x4642c20bf2f338d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560450.880426:0:7428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 0000000091677b5f/0x4642c20bf2f338d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560450.880460:0:7428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004f10d71c pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862692992:0@lo:101: 00000100:00100000:3.0:1787560450.880483:0:7428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560450.880500:0:7428:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b8dcc9d1 going to sleep for 11 seconds 00000100:00100000:3.0:1787560450.880513:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862692992 00000100:00100000:3.0:1787560450.880521:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862692992 00000100:00100000:3.0:1787560450.880545:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787560450.880551:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c65018ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+11:7428:x1874392862692992:12345-0@lo:101: 00010000:00010000:3.0:1787560450.880558:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560450.880565:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005b3126ea/0x4642c20bf2f338dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f338d6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560450.880588:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005b3126ea/0x4642c20bf2f338dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f338d6 expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560450.880595:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005b3126ea/0x4642c20bf2f338dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f338d6 expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560450.880601:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005b3126ea, rc 0) 00000100:00100000:3.0:1787560450.880629:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c65018ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+12:7428:x1874392862692992:12345-0@lo:101: Request processed in 78us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560450.880635:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787560450.880659:0:7428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004f10d71c pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862692992:0@lo:101: 00010000:00010000:3.0:1787560450.880667:0:7428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 0000000091677b5f/0x4642c20bf2f338d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f338dd expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560450.880675:0:7428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 0000000091677b5f/0x4642c20bf2f338d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f338dd expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560450.880684:0:7428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787560450.880686:0:7428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 0000000091677b5f/0x4642c20bf2f338d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f338dd expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560450.880693:0:7428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 0000000091677b5f/0x4642c20bf2f338d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f338dd expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560450.880705:0:7428:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1787560450.880708:0:7428:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787560450.880712:0:7428:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9caffba72800 10000000:01000000:3.0:1787560450.880714:0:7428:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787560450.880717:0:7428:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1787560450.880719:0:7428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787560450.880731:0:7428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 00000000283fb76f/0x4642c20bf2f338e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560450.880737:0:7428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 00000000283fb76f/0x4642c20bf2f338e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560450.880742:0:7428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 00000000283fb76f/0x4642c20bf2f338e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560450.880752:0:7428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004f10d71c pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862693120:0@lo:101: 00000100:00100000:3.0:1787560450.880775:0:7428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560450.880782:0:7428:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b8dcc9d1 going to sleep for 11 seconds 00000100:00100000:3.0:1787560450.880799:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862693120 00000100:00100000:3.0:1787560450.880802:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862693120 00000100:00100000:3.0:1787560450.880816:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787560450.880822:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b362647b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+12:7428:x1874392862693120:12345-0@lo:101: 00010000:00010000:3.0:1787560450.880828:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560450.880834:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004bf181f6/0x4642c20bf2f338eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f338e4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560450.880845:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004bf181f6/0x4642c20bf2f338eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f338e4 expref: 13 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560450.880863:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004bf181f6/0x4642c20bf2f338eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f338e4 expref: 13 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560450.880869:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004bf181f6, rc 0) 00000100:00100000:3.0:1787560450.880898:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b362647b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+13:7428:x1874392862693120:12345-0@lo:101: Request processed in 76us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560450.880903:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787560450.880926:0:7428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004f10d71c pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862693120:0@lo:101: 00010000:00010000:3.0:1787560450.880935:0:7428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 00000000283fb76f/0x4642c20bf2f338e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f338eb expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560450.880942:0:7428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 00000000283fb76f/0x4642c20bf2f338e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f338eb expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560450.881027:0:7428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004f10d71c pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862693248:0@lo:501: 00000100:00100000:3.0:1787560450.881050:0:7428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560450.881058:0:7428:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b8dcc9d1 going to sleep for 11 seconds 00000100:00100000:3.0:1787560450.881075:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862693248 00000100:00100000:3.0:1787560450.881078:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862693248 00000100:00100000:3.0:1787560450.881093:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787560450.881098:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004fbb8117 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+13:7428:x1874392862693248:12345-0@lo:501: 00000100:00100000:3.0:1787560450.881204:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004fbb8117 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+13:7428:x1874392862693248:12345-0@lo:501: Request processed in 105us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560450.881210:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787560450.881246:0:7428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004f10d71c pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862693248:0@lo:501: 00000100:00100000:3.0:1787560450.881269:0:7428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004f10d71c pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862693376:0@lo:503: 00000100:00100000:3.0:1787560450.881310:0:7428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560450.881317:0:7428:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b8dcc9d1 going to sleep for 11 seconds 00000100:00100000:3.0:1787560450.881333:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862693376 00000100:00100000:3.0:1787560450.881339:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862693376 00000100:00100000:3.0:1787560450.881354:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787560450.881358:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7caeb86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+13:7428:x1874392862693376:12345-0@lo:503: 00000100:00100000:3.0:1787560450.881463:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7caeb86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+13:7428:x1874392862693376:12345-0@lo:503: Request processed in 104us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560450.881469:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787560450.881507:0:7428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004f10d71c pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862693376:0@lo:503: 00000040:00080000:3.0:1787560450.881770:0:7428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787560450.881841:0:7428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004f10d71c pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862693504:0@lo:502: 00000100:00100000:3.0:1787560450.881873:0:7428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560450.881882:0:7428:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b8dcc9d1 going to sleep for 11 seconds 00000100:00100000:3.0:1787560450.881904:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862693504 00000100:00100000:3.0:1787560450.881908:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862693504 00000100:00100000:3.0:1787560450.881926:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787560450.881931:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a748446e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+13:7428:x1874392862693504:12345-0@lo:502: 00000100:00100000:3.0:1787560450.882008:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a748446e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+13:7428:x1874392862693504:12345-0@lo:502: Request processed in 77us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560450.882014:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787560450.882047:0:7428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004f10d71c pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862693504:0@lo:502: 00000040:00080000:3.0:1787560450.882250:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787560450.882276:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:3.0:1787560450.882290:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:3.0:1787560450.882302:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:3.0:1787560450.882314:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:3.0:1787560450.882339:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:3.0:1787560450.882354:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:3.0:1787560450.882365:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:3.0:1787560450.882376:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:3.0:1787560450.882386:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:3.0:1787560450.882398:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1787560450.882410:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1787560450.882423:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1787560450.882474:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1787560450.882491:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1787560450.882503:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1787560450.882516:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:3.0:1787560450.882529:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:3.0:1787560450.882542:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:3.0:1787560450.882554:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:3.0:1787560450.882565:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1787560450.882579:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1787560450.882593:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1787560450.882612:0:7428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004f10d71c pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862693632:0@lo:502: 00000100:00100000:3.0:1787560450.882645:0:7428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560450.882655:0:7428:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c43b8188 going to sleep for 11 seconds 00000100:00100000:3.0:1787560450.882673:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862693632 00000100:00100000:3.0:1787560450.882677:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862693632 00000100:00100000:3.0:1787560450.882694:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787560450.882699:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002795a23d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+13:7428:x1874392862693632:12345-0@lo:502: 00000100:00100000:3.0:1787560450.882762:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002795a23d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+13:7428:x1874392862693632:12345-0@lo:502: Request processed in 63us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560450.882768:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787560450.882800:0:7428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004f10d71c pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862693632:0@lo:502: 00000040:00080000:3.0:1787560450.882833:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1787560450.882846:0:7428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00010000:00010000:1.0:1787560450.883418:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560450.883425:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: 000000006d1480ab/0x4642c20bf2f338ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4642c20bf2f338c1 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560450.883460:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006d1480ab already unused, calling callback (00000000fb88b142) 10000000:00010000:1.0:1787560450.883464:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: 000000006d1480ab/0x4642c20bf2f338ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4642c20bf2f338c1 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560450.883488:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: 000000006d1480ab/0x4642c20bf2f338ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x4642c20bf2f338c1 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560450.883494:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: 000000006d1480ab/0x4642c20bf2f338ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x4642c20bf2f338c1 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560450.883499:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787560450.883524:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: 000000006d1480ab/0x4642c20bf2f338ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4642c20bf2f338c1 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560450.883530:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560450.883553:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: 000000006d1480ab/0x4642c20bf2f338ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4642c20bf2f338c1 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560450.883560:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: 000000006d1480ab/0x4642c20bf2f338ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4642c20bf2f338c1 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560450.883582:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560450.883584:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560450.883585:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560450.883813:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a72a3fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862693760:0@lo:103: 00000100:00100000:2.0:1787560450.883850:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560450.883929:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862693760 00000100:00100000:0.0:1787560450.883935:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862693760 00000100:00100000:0.0:1787560450.883986:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787560450.883994:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001384c1e3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+13:3623:x1874392862693760:12345-0@lo:103: 00010000:00010000:0.0:1787560450.884004:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560450.884019:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000aeb3be7a/0x4642c20bf2f338c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4642c20bf2f338ba expref: 13 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560450.884031:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560450.884059:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001384c1e3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+12:3623:x1874392862693760:12345-0@lo:103: Request processed in 67us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560450.884065:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787560450.884192:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a72a3fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862693760:0@lo:103: 00000020:01000000:0.0:1787560450.884390:0:7440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560450.884401:0:7440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560450.884404:0:7440:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1787560450.884409:0:7440:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1787560450.884412:0:7440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787560450.884426:0:7440:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000007352134e) 00000020:00000080:0.0:1787560450.884485:0:7440:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:0.0:1787560450.884494:0:7440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787560450.884586:0:7440:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787560450.884594:0:7440:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4642c20bf2f338f9 00000020:00000080:0.0:1787560450.884815:0:7440:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1787560450.884820:0:7440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560450.884824:0:7440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560450.884825:0:7440:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1787560450.884827:0:7440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560450.884831:0:7440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560450.884832:0:7440:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1787560450.884834:0:7440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787560450.884841:0:7440:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000009ab831dd) 00000020:00000080:0.0:1787560450.884851:0:7440:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:0.0:1787560450.884854:0:7440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787560450.884856:0:7440:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1787560450.884858:0:7440:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1787560450.884864:0:7440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787560450.884903:0:7440:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002788c314 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1787560450.884915:0:7440:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000009620bb18) 00000020:00000080:0.0:1787560450.884923:0:7440:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:0.0:1787560450.885014:0:7440:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787560450.885020:0:7440:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4642c20bf2f3390e 00000020:00000080:0.0:1787560450.885109:0:7440:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1787560450.885114:0:7440:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787560450.885118:0:7440:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x4642c20bf2f33915 00080000:01000000:0.0:1787560450.885124:0:7440:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787560450.885126:0:7440:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4642c20bf2f3391c 00080000:10000000:0.0:1787560450.885755:0:7440:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1787560450.885879:0:7440:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:1.0:1787560451.047306:0:7440:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:1.0:1787560451.047631:0:7440:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:1.0:1787560451.057792:0:7440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1787560451.058160:0:7440:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00010000:3.0:1787560451.074306:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787560451.105143:0:7440:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1787560451.105157:0:7440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560451.105163:0:7440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560451.105170:0:7440:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1787560451.105174:0:7440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560451.105180:0:7440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560451.105181:0:7440:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1787560451.105184:0:7440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787560451.105188:0:7440:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:00000080:0.0:1787560451.105216:0:7440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787560451.105251:0:7440:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000003758c98a) 00000020:00000080:0.0:1787560451.105277:0:7440:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1787560451.105283:0:7440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787560451.105353:0:7440:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1787560451.105360:0:7440:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787560451.105368:0:7440:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4642c20bf2f3392a 00010000:00080000:0.0:1787560451.105402:0:7440:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e5327c08@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.129@tcp at head 00010000:00010000:3.0:1787560451.114471:0:7440:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:2.0:1787560451.116819:0:7440:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787560451.116835:0:7440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787560451.116873:0:7440:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787560451.116894:0:7440:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4642c20bf2f33931 00000100:00080000:2.0:1787560451.116905:0:7440:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787560451.116910:0:7440:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000e5327c08 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560451.116943:0:7440:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000057c737a5 x1874392862693888/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787560451.116960:0:7440:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787560451.117043:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000057c737a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862693888:0@lo:38: 00000100:00100000:0.0:1787560451.117127:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560451.117426:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862693888 00000100:00100000:2.0:1787560451.117462:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862693888 00000100:00100000:2.0:1787560451.117497:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787560451.117504:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017157d7d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1874392862693888:12345-0@lo:38: 00010000:00080000:2.0:1787560451.117524:0:6503:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:2.0:1787560451.117558:0:6503:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4642c20bf2f33938 00000004:00100000:2.0:1787560451.117572:0:6503:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787560451.117577:0:6503:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:2.0:1787560451.117676:0:7440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560451.117853:0:7440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560451.117856:0:7440:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1787560451.117861:0:7440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787560451.117863:0:7440:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787560451.117865:0:7440:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787560451.117866:0:7440:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787560451.117874:0:7440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787560451.117876:0:7440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560451.117878:0:7440:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787560451.117880:0:7440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787560451.117884:0:7440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560451.117886:0:7440:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1787560451.117889:0:7440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787560451.117923:0:7440:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787560451.117938:0:7440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560451.117941:0:7440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560451.117943:0:7440:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1787560451.117945:0:7440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787560451.117947:0:7440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560451.117948:0:7440:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787560451.117951:0:7440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787560451.117953:0:7440:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787560451.117975:0:7440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560451.117978:0:7440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560451.117979:0:7440:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787560451.117982:0:7440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:1.0:1787560451.118554:0:7428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:1.0:1787560451.118586:0:7428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787560451.118608:0:7428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 00000000283fb76f/0x4642c20bf2f338e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f338eb expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560451.118635:0:7428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 00000000283fb76f/0x4642c20bf2f338e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f338eb expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560451.118643:0:7428:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9caffba72800 from 1 10000000:01000000:1.0:1787560451.118878:0:7428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787560451.118907:0:7428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 000000005283323a/0x4642c20bf2f3393f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560451.118914:0:7428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 000000005283323a/0x4642c20bf2f3393f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560451.118923:0:7428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 000000005283323a/0x4642c20bf2f3393f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560451.118940:0:7428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000085793113 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862694016:0@lo:101: 00000100:00100000:1.0:1787560451.118990:0:7428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560451.119054:0:7428:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eb9a1a61 going to sleep for 11 seconds 00000100:00100000:2.0:1787560451.119826:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004f10d71c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862694144:0@lo:400: 00000100:00100000:2.0:1787560451.119861:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560451.121032:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862694144 00000100:00100000:3.0:1787560451.121043:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862694144 00000100:00100000:3.0:1787560451.121102:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787560451.121111:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005708ceb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862694144:12345-0@lo:400: 00010000:00080000:1.0:1787560451.121324:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000004f10d71c x1874392862694144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560451.121338:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004f10d71c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862694144:0@lo:400: 00000100:00100000:3.0:1787560451.121382:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005708ceb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862694144:12345-0@lo:400: Request processed in 272us (1520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560451.121389:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787560451.121532:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862694016 00000100:00100000:0.0:1787560451.121537:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862694016 00000100:00100000:0.0:1787560451.121600:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787560451.121607:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a76f72b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+12:7428:x1874392862694016:12345-0@lo:101: 00010000:00010000:0.0:1787560451.121618:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560451.121632:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008941718a/0x4642c20bf2f33946 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f3393f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560451.121666:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008941718a/0x4642c20bf2f33946 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f3393f expref: 13 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560451.121676:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008941718a/0x4642c20bf2f33946 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f3393f expref: 13 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560451.121684:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008941718a, rc 0) 00000100:00100000:0.0:1787560451.121763:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a76f72b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+13:7428:x1874392862694016:12345-0@lo:101: Request processed in 156us (2773us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560451.121769:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787560451.123021:0:7428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000085793113 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862694016:0@lo:101: 00010000:00010000:1.0:1787560451.123043:0:7428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 000000005283323a/0x4642c20bf2f3393f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33946 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560451.123053:0:7428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 000000005283323a/0x4642c20bf2f3393f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33946 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560451.123894:0:7428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000085793113 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862694272:0@lo:256: 00000100:00100000:1.0:1787560451.124013:0:7428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560451.124094:0:7428:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eb9a1a61 going to sleep for 11 seconds 00000100:00100000:0.0:1787560451.124213:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862694272 00000100:00100000:0.0:1787560451.124219:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862694272 00000100:00100000:0.0:1787560451.124273:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787560451.124281:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2bdbe8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+13:7428:x1874392862694272:12345-0@lo:256: 20000000:01000000:0.0:1787560451.124299:0:6494:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787560451.124313:0:6494:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787560451.124316:0:6494:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787560451.124396:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2bdbe8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+13:7428:x1874392862694272:12345-0@lo:256: Request processed in 115us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560451.124403:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787560451.124468:0:7428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000085793113 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862694272:0@lo:256: 10000000:01000000:0.0:1787560451.127164:0:7428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787560451.127504:0:7428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 000000005283323a/0x4642c20bf2f3393f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33946 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560451.127516:0:7428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 000000005283323a/0x4642c20bf2f3393f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33946 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560451.127524:0:7428:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9caffba72800 from 1 10000000:01000000:0.0:1787560451.127527:0:7428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787560451.127563:0:7428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 00000000f39b93b9/0x4642c20bf2f3394d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560451.127570:0:7428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 00000000f39b93b9/0x4642c20bf2f3394d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560451.127594:0:7428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 00000000f39b93b9/0x4642c20bf2f3394d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560451.127614:0:7428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000508e05eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862694400:0@lo:101: 00000100:00100000:0.0:1787560451.127871:0:7428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560451.128094:0:7428:0:(client.c:2715:ptlrpc_set_wait()) set 0000000083f92c10 going to sleep for 11 seconds 00000100:00100000:1.0:1787560451.128498:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862694400 00000100:00100000:1.0:1787560451.128506:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862694400 00000100:00100000:1.0:1787560451.128554:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787560451.128563:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002245d5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+13:7428:x1874392862694400:12345-0@lo:101: 00010000:00010000:1.0:1787560451.128576:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560451.128588:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001f4dd5ed/0x4642c20bf2f33954 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f3394d expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560451.128610:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001f4dd5ed/0x4642c20bf2f33954 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f3394d expref: 14 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560451.128619:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001f4dd5ed/0x4642c20bf2f33954 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f3394d expref: 14 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560451.128628:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001f4dd5ed, rc 0) 00000100:00100000:1.0:1787560451.128677:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002245d5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+14:7428:x1874392862694400:12345-0@lo:101: Request processed in 116us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560451.128684:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787560451.128948:0:7428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000508e05eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862694400:0@lo:101: 00010000:00010000:0.0:1787560451.128964:0:7428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 00000000f39b93b9/0x4642c20bf2f3394d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33954 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560451.128972:0:7428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 00000000f39b93b9/0x4642c20bf2f3394d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33954 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560451.129072:0:7428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000508e05eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862694528:0@lo:501: 00000100:00100000:0.0:1787560451.129100:0:7428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560451.129129:0:7428:0:(client.c:2715:ptlrpc_set_wait()) set 0000000083f92c10 going to sleep for 11 seconds 00000100:00100000:1.0:1787560451.129328:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862694528 00000100:00100000:1.0:1787560451.129333:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862694528 00000100:00100000:1.0:1787560451.129363:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787560451.129368:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000687ee634 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+14:7428:x1874392862694528:12345-0@lo:501: 00000100:00100000:1.0:1787560451.129489:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000687ee634 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+14:7428:x1874392862694528:12345-0@lo:501: Request processed in 120us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560451.129513:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787560451.129635:0:7428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000508e05eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862694528:0@lo:501: 00000100:00100000:0.0:1787560451.129801:0:7428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000508e05eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862694656:0@lo:503: 00000100:00100000:0.0:1787560451.129839:0:7428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560451.129865:0:7428:0:(client.c:2715:ptlrpc_set_wait()) set 0000000083f92c10 going to sleep for 11 seconds 00000100:00100000:1.0:1787560451.129925:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862694656 00000100:00100000:1.0:1787560451.129930:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862694656 00000100:00100000:1.0:1787560451.130057:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787560451.130074:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000008a783d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+14:7428:x1874392862694656:12345-0@lo:503: 00000040:00080000:1.0:1787560451.130109:0:6494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787560451.130154:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000008a783d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+14:7428:x1874392862694656:12345-0@lo:503: Request processed in 90us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560451.130161:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787560451.130372:0:7428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000508e05eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862694656:0@lo:503: 00000040:00080000:0.0:1787560451.131011:0:7428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787560451.131125:0:7428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1787560451.131292:0:7428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1787560451.136580:0:6503:0:(import.c:65:import_set_state_nolock()) 00000000bcdfa4d0 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787560451.136769:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017157d7d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3622:x1874392862693888:12345-0@lo:38: Request processed in 19262us (19643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560451.136781:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787560451.136839:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787560451.136856:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1787560451.136864:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787560451.136869:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787560451.136871:0:3622:0:(import.c:65:import_set_state_nolock()) 00000000e5327c08 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787560451.136886:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000057c737a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862693888:0@lo:38: 00000100:00100000:2.0:1787560451.137142:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003766fee4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862694784:0@lo:41: 00000100:00100000:2.0:1787560451.137186:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560451.137282:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862694784 00000100:00100000:3.0:1787560451.137289:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862694784 00000100:00100000:3.0:1787560451.137331:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787560451.137338:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6fe1f4f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3625:x1874392862694784:12345-0@lo:41: 00000004:00000024:3.0:1787560451.137362:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1787560451.137399:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6fe1f4f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3625:x1874392862694784:12345-0@lo:41: Request processed in 62us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560451.137405:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787560451.137500:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003766fee4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862694784:0@lo:41: 00000040:00080000:1.0:1787560451.138689:0:7446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1787560451.138885:0:7428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787560451.138918:0:7428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787560451.139150:0:7428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 00000000f39b93b9/0x4642c20bf2f3394d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33954 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560451.139171:0:7428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 00000000f39b93b9/0x4642c20bf2f3394d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33954 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560451.139414:0:7428:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787560451.139417:0:7428:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9caffba72800 10000000:01000000:0.0:1787560451.139463:0:7428:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9caffba72800 10000000:01000000:0.0:1787560451.139468:0:7428:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787560451.139475:0:7428:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9caffba72800 from 1 10000000:01000000:0.0:1787560451.139478:0:7428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787560451.139515:0:7428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 00000000d551c91d/0x4642c20bf2f3395b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560451.139524:0:7428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 00000000d551c91d/0x4642c20bf2f3395b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560451.139533:0:7428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 00000000d551c91d/0x4642c20bf2f3395b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560451.139553:0:7428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000508e05eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862694912:0@lo:101: 00000100:00100000:0.0:1787560451.139630:0:7428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560451.139679:0:7428:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ff83f3d8 going to sleep for 11 seconds 00000100:00100000:1.0:1787560451.139896:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862694912 00000100:00100000:1.0:1787560451.139904:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862694912 00000100:00100000:1.0:1787560451.139958:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787560451.139966:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002757ceff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+14:7428:x1874392862694912:12345-0@lo:101: 00010000:00010000:1.0:1787560451.139979:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560451.139990:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000016c3ba0b/0x4642c20bf2f33962 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f3395b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560451.140011:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000016c3ba0b/0x4642c20bf2f33962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f3395b expref: 15 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560451.140020:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000016c3ba0b/0x4642c20bf2f33962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f3395b expref: 15 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560451.140027:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000016c3ba0b, rc 0) 00000100:00100000:1.0:1787560451.140079:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002757ceff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:7428:x1874392862694912:12345-0@lo:101: Request processed in 114us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560451.140086:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787560451.140360:0:7428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000508e05eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862694912:0@lo:101: 00010000:00010000:3.0:1787560451.140375:0:7428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 00000000d551c91d/0x4642c20bf2f3395b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33962 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560451.140382:0:7428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 00000000d551c91d/0x4642c20bf2f3395b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33962 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560451.140524:0:7428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d296b536 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862695040:0@lo:501: 00000100:00100000:3.0:1787560451.140551:0:7428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560451.140581:0:7428:0:(client.c:2715:ptlrpc_set_wait()) set 0000000015400844 going to sleep for 11 seconds 00000100:00100000:2.0:1787560451.140739:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862695040 00000100:00100000:2.0:1787560451.140745:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862695040 00000100:00100000:2.0:1787560451.140787:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787560451.140793:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d4099d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:7428:x1874392862695040:12345-0@lo:501: 00000100:00100000:2.0:1787560451.141070:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d4099d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:7428:x1874392862695040:12345-0@lo:501: Request processed in 268us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560451.141078:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787560451.142261:0:7428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d296b536 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862695040:0@lo:501: 00000100:00100000:3.0:1787560451.142306:0:7428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d296b536 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862695168:0@lo:503: 00000100:00100000:3.0:1787560451.142362:0:7428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560451.142398:0:7428:0:(client.c:2715:ptlrpc_set_wait()) set 0000000015400844 going to sleep for 11 seconds 00000100:00100000:0.0:1787560451.142571:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862695168 00000100:00100000:0.0:1787560451.142578:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862695168 00000100:00100000:0.0:1787560451.142625:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787560451.142633:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca37b6eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:7428:x1874392862695168:12345-0@lo:503: 00000100:00100000:0.0:1787560451.142753:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca37b6eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:7428:x1874392862695168:12345-0@lo:503: Request processed in 120us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560451.142760:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787560451.143322:0:7428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d296b536 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862695168:0@lo:503: 00000040:00080000:3.0:1787560451.143848:0:7428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787560451.143924:0:7428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d296b536 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862695296:0@lo:502: 00000100:00100000:3.0:1787560451.144971:0:7428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560451.145018:0:7428:0:(client.c:2715:ptlrpc_set_wait()) set 000000001bea6d99 going to sleep for 11 seconds 00000100:00100000:2.0:1787560451.145040:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862695296 00000100:00100000:2.0:1787560451.145048:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862695296 00000100:00100000:2.0:1787560451.145325:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787560451.145334:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b53be594 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:7428:x1874392862695296:12345-0@lo:502: 00000100:00100000:2.0:1787560451.145503:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b53be594 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:7428:x1874392862695296:12345-0@lo:502: Request processed in 171us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560451.145511:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787560451.145791:0:7428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d296b536 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862695296:0@lo:502: 00000040:00080000:3.0:1787560451.146386:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787560451.146459:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787560451.146481:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787560451.146499:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787560451.146515:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787560451.146529:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787560451.146546:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787560451.147146:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787560451.147177:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787560451.147192:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787560451.147206:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787560451.147219:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787560451.147244:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787560451.147259:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787560451.147274:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787560451.147288:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787560451.147324:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787560451.147340:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787560451.147352:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787560451.147377:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787560451.147389:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787560451.147401:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787560451.147412:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787560451.147423:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787560451.147638:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1787560451.147723:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1787560451.147740:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1787560451.147753:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1787560451.147855:0:7428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d296b536 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862695424:0@lo:502: 00000100:00100000:3.0:1787560451.147922:0:7428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560451.147970:0:7428:0:(client.c:2715:ptlrpc_set_wait()) set 000000001bea6d99 going to sleep for 11 seconds 00000100:00100000:2.0:1787560451.149112:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862695424 00000100:00100000:2.0:1787560451.149122:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862695424 00000100:00100000:2.0:1787560451.149178:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787560451.149187:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000556838c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:7428:x1874392862695424:12345-0@lo:502: 00000100:00100000:2.0:1787560451.149651:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000556838c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:7428:x1874392862695424:12345-0@lo:502: Request processed in 460us (1723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560451.149660:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787560451.149766:0:7428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d296b536 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862695424:0@lo:502: 00000040:00080000:3.0:1787560451.150140:0:7428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1787560451.150245:0:7428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1787560451.150953:0:7447:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1787560451.150968:0:7447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (0000000067441a49) 00000020:00000080:0.0:1787560451.150990:0:7447:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1787560451.151262:0:7447:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002788c314 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1787560451.151266:0:7447:0:(tgt_mount.c:187:server_put_mount()) put mount 000000002788c314 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1787560451.151268:0:7447:0:(obd_mount.c:710:lustre_put_lsi()) put 000000002788c314 3 00010000:00080000:0.0:1787560451.151294:0:7447:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ae01d0d6@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.129@tcp at head 00010000:00010000:0.0:1787560451.153375:0:7447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:0.0:1787560451.153867:0:7447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1787560451.153911:0:7447:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787560451.153925:0:7447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x4642c20bf2f33970 00000100:00080000:0.0:1787560451.153937:0:7447:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787560451.153943:0:7447:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000ae01d0d6 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:0.0:1787560451.153982:0:7447:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008d317930 x1874392862695552/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787560451.154060:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d317930 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874392862695552:0@lo:38: 00000100:00100000:1.0:1787560451.154140:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787560451.154212:0:7447:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787560451.154410:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862695552 00000100:00100000:2.0:1787560451.154426:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862695552 00000100:00100000:2.0:1787560451.154487:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787560451.154494:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000278297f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1874392862695552:12345-0@lo:38: 00010000:00080000:2.0:1787560451.154515:0:6500:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:2.0:1787560451.154546:0:6500:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x4642c20bf2f33977 00000004:00100000:2.0:1787560451.154559:0:6500:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787560451.154585:0:6500:0:(import.c:65:import_set_state_nolock()) 0000000094d0a99b : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787560451.154659:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000278297f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874392862695552:12345-0@lo:38: Request processed in 164us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560451.154666:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:1.0:1787560451.154703:0:7447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00010000:00080000:0.0:1787560451.154790:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000008d317930 x1874392862695552/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787560461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560451.154801:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787560451.154813:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1787560451.154819:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787560451.154823:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787560451.154825:0:3622:0:(import.c:65:import_set_state_nolock()) 00000000ae01d0d6 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787560451.154830:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d317930 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874392862695552:0@lo:38: 40000000:00080000:0.0:1787560451.154918:0:7448:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:2.0:1787560451.155904:0:7428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1787560451.155950:0:7428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787560451.155969:0:7428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 00000000d551c91d/0x4642c20bf2f3395b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33962 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560451.155980:0:7428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 00000000d551c91d/0x4642c20bf2f3395b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33962 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787560451.156030:0:7428:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787560451.156032:0:7428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787560451.156034:0:7428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560451.156035:0:7428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560451.156036:0:7428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560451.156037:0:7428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560451.156039:0:7428:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787560451.156041:0:7428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787560451.156042:0:7428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787560451.156044:0:7428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560451.156045:0:7428:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787560451.156048:0:7428:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:2.0:1787560451.156051:0:7428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787560451.156052:0:7428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787560451.156053:0:7428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560451.156054:0:7428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560451.156055:0:7428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560451.156057:0:7428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560451.156057:0:7428:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787560451.156058:0:7428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787560451.156059:0:7428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787560451.156060:0:7428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560451.156061:0:7428:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787560451.156950:0:7428:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787560451.156968:0:7428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000364180d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862695680:0@lo:253: 00000100:00100000:2.0:1787560451.157039:0:7428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560451.157360:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862695680 00000100:00100000:2.0:1787560451.157368:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862695680 00000100:00100000:2.0:1787560451.157409:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787560451.157417:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062ec6bd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:7428:x1874392862695680:12345-0@lo:253: 20000000:01000000:2.0:1787560451.157455:0:6492:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787560451.157469:0:6492:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787560451.157830:0:7428:0:(client.c:2715:ptlrpc_set_wait()) set 00000000391ede47 going to sleep for 11 seconds 00000001:00100000:2.0:1787560451.160287:0:6478:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1787560451.160564:0:6492:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787560451.160604:0:6492:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1787560451.161007:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062ec6bd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:7428:x1874392862695680:12345-0@lo:253: Request processed in 3588us (3965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560451.161021:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 20000000:01000000:2.0:1787560451.161322:0:6514:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787560451.161326:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787560451.161345:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000219b95b9/0x4642c20bf2f3397e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560451.161359:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001eb81e2b/0x4642c20bf2f3389e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33897 expref: 14 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560451.161366:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008941718a/0x4642c20bf2f33946 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f3393f expref: 14 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560451.161371:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000219b95b9/0x4642c20bf2f3397e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560451.161404:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008941718a/0x4642c20bf2f33946 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f3393f expref: 14 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560451.161416:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008941718a/0x4642c20bf2f33946 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f3393f expref: 14 pid: 6494 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560451.161427:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000057b530f0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6514:1874392862695808:0@lo:104: 00000100:00100000:2.0:1787560451.161498:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787560451.161540:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001eb81e2b/0x4642c20bf2f3389e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f33897 expref: 14 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560451.161548:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001eb81e2b/0x4642c20bf2f3389e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f33897 expref: 14 pid: 6493 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560451.161555:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000256135c9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6514:1874392862695936:0@lo:104: 00000100:00100000:2.0:1787560451.161575:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560451.161591:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fbd325cf going to sleep for 11 seconds 00000100:00100000:2.0:1787560451.161608:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862695808 00000100:00100000:2.0:1787560451.161614:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862695808 00000100:00100000:2.0:1787560451.161641:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862695936 00000100:00100000:2.0:1787560451.161644:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862695936 00000100:00100000:2.0:1787560451.161656:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787560451.161663:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1ff16ee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+4:6514:x1874392862695808:12345-0@lo:104: 00010000:00010000:2.0:1787560451.161675:0:6482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: 000000005283323a/0x4642c20bf2f3393f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33946 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560451.161871:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000057b530f0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6514:1874392862695808:0@lo:104: 00010000:00010000:2.0:1787560451.161890:0:6482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787560451.161896:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1ff16ee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+4:6514:x1874392862695808:12345-0@lo:104: Request processed in 234us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560451.161902:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787560451.161917:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787560451.161922:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ee811b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:6514:x1874392862695936:12345-0@lo:104: 00010000:00010000:2.0:1787560451.161930:0:6482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: 00000000dac89b57/0x4642c20bf2f33897 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f3389e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560451.162003:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000256135c9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6514:1874392862695936:0@lo:104: 00010000:00010000:0.0:1787560451.162022:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000219b95b9/0x4642c20bf2f3397e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560451.162057:0:7428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000364180d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7428:1874392862695680:0@lo:253: 10000000:01000000:1.0:1787560451.162067:0:7428:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787560451.162070:0:7428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787560451.162072:0:7428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787560451.162074:0:7428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787560451.162075:0:7428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787560451.162076:0:7428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787560451.162077:0:7428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787560451.162079:0:7428:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787560451.162080:0:7428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787560451.162082:0:7428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787560451.162083:0:7428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787560451.162084:0:7428:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787560451.162097:0:7428:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1787560451.162699:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787560451.162705:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: 000000005283323a/0x4642c20bf2f3393f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33946 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560451.162713:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005283323a already unused, calling callback (00000000fb88b142) 10000000:00010000:3.0:1787560451.162716:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: 000000005283323a/0x4642c20bf2f3393f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33946 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560451.162724:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: 000000005283323a/0x4642c20bf2f3393f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33946 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560451.162739:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: 000000005283323a/0x4642c20bf2f3393f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33946 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560451.162745:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787560451.162791:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: 000000005283323a/0x4642c20bf2f3393f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33946 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560451.162798:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560451.162815:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: 000000005283323a/0x4642c20bf2f3393f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33946 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560451.162822:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: 000000005283323a/0x4642c20bf2f3393f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33946 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560451.162833:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560451.162835:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: 00000000dac89b57/0x4642c20bf2f33897 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f3389e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560451.162841:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dac89b57 already unused, calling callback (00000000fb88b142) 10000000:00010000:3.0:1787560451.162843:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: 00000000dac89b57/0x4642c20bf2f33897 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f3389e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560451.162849:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: 00000000dac89b57/0x4642c20bf2f33897 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f3389e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560451.162854:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: 00000000dac89b57/0x4642c20bf2f33897 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f3389e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560451.162859:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787560451.162870:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: 00000000dac89b57/0x4642c20bf2f33897 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f3389e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560451.162876:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560451.162890:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: 00000000dac89b57/0x4642c20bf2f33897 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f3389e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560451.162906:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: 00000000dac89b57/0x4642c20bf2f33897 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f3389e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560451.162918:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560451.162920:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560451.162921:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560451.162944:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d2632694 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862696192:0@lo:103: 00000100:00100000:3.0:1787560451.162981:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787560451.163222:0:6482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1787560451.163242:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ee811b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:6514:x1874392862695936:12345-0@lo:104: Request processed in 1320us (1667us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560451.163250:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787560451.163276:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862696192 00000100:00100000:2.0:1787560451.163282:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862696192 00010000:00010000:2.0:1787560451.163298:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001eb81e2b/0x4642c20bf2f3389e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33897 expref: 15 pid: 6493 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560451.163322:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787560451.163328:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f971b4b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:3623:x1874392862696192:12345-0@lo:103: 00010000:00010000:2.0:1787560451.163339:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560451.163343:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001eb81e2b/0x4642c20bf2f3389e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33897 expref: 15 pid: 6493 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560451.163352:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001eb81e2b/0x4642c20bf2f3389e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f33897 expref: 15 pid: 6493 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560451.163364:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001eb81e2b/0x4642c20bf2f3389e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f33897 expref: 15 pid: 6493 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560451.163376:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560451.163407:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f971b4b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+14:3623:x1874392862696192:12345-0@lo:103: Request processed in 80us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560451.163413:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787560451.163454:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d2632694 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862696192:0@lo:103: 00000100:00100000:2.0:1787560451.163469:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787560451.163477:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d296b536 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862696064:0@lo:103: 00000100:00100000:2.0:1787560451.163502:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560451.163527:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862696064 00000100:00100000:2.0:1787560451.163537:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862696064 00010000:00010000:2.0:1787560451.163550:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008941718a/0x4642c20bf2f33946 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f3393f expref: 14 pid: 6494 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560451.163569:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787560451.163575:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024adeedf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+14:3625:x1874392862696064:12345-0@lo:103: 00010000:00010000:2.0:1787560451.163582:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560451.163585:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008941718a/0x4642c20bf2f33946 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f3393f expref: 14 pid: 6494 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560451.163593:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008941718a/0x4642c20bf2f33946 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f3393f expref: 14 pid: 6494 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560451.163602:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008941718a/0x4642c20bf2f33946 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f3393f expref: 14 pid: 6494 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560451.163713:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000219b95b9/0x4642c20bf2f3397e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560451.163721:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000219b95b9/0x4642c20bf2f3397e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787560451.163791:0:6485:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006100602s 00010000:00010000:2.0:1787560451.163795:0:6485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000219b95b9/0x4642c20bf2f3397e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560451.163802:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000219b95b9/0x4642c20bf2f3397e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560451.163808:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000219b95b9/0x4642c20bf2f3397e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560451.163823:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000219b95b9/0x4642c20bf2f3397e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560451.163833:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000219b95b9 already unused, calling callback (0000000018131874) 00010000:00010000:2.0:1787560451.163836:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000219b95b9/0x4642c20bf2f3397e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560451.163843:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000219b95b9/0x4642c20bf2f3397e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560451.163857:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000219b95b9/0x4642c20bf2f3397e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560451.163866:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560451.163893:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024adeedf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+13:3625:x1874392862696064:12345-0@lo:103: Request processed in 319us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560451.163900:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787560451.164009:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d296b536 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862696064:0@lo:103: 00010000:00010000:2.0:1787560451.164028:0:6514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000219b95b9/0x4642c20bf2f3397e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560451.164035:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000219b95b9/0x4642c20bf2f3397e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560451.164040:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000219b95b9/0x4642c20bf2f3397e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560451.164095:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1787560451.167547:0:7428:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:0.0:1787560451.167728:0:7428:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1787560451.167918:0:7428:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1787560451.168096:0:7428:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1787560451.168502:0:7428:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1787560451.168668:0:7428:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1787560451.171051:0:7428:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1787560451.171602:0:7428:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1787560451.171787:0:7428:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1787560451.171964:0:7428:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1787560451.172495:0:7428:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:0.0:1787560451.172699:0:7428:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1787560451.174794:0:7428:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1787560451.175011:0:7453:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1787560451.175058:0:7453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000638d07e2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7453:1874392862696320:0@lo:700: 00000040:01000000:0.0:1787560451.175331:0:7428:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1787560451.175401:0:7453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560451.175454:0:7453:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d2b31dd1 going to sleep for 11 seconds 00000100:00100000:0.0:1787560451.175521:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862696320 00000100:00100000:0.0:1787560451.175528:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862696320 00000100:00100000:0.0:1787560451.175564:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787560451.175571:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b41ee560 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7453:x1874392862696320:12345-0@lo:700: 00000100:00100000:0.0:1787560451.175993:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d317930 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7454:1874392862696448:0@lo:1000: 00000100:00100000:0.0:1787560451.176032:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560451.176144:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862696448 00000100:00100000:3.0:1787560451.176149:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862696448 00000100:00100000:3.0:1787560451.176290:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787560451.176297:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003309e39e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7454:x1874392862696448:12345-0@lo:1000: 00000100:00100000:3.0:1787560451.176351:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003309e39e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7454:x1874392862696448:12345-0@lo:1000: Request processed in 55us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560451.176357:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787560451.176397:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 000000000927f92e going to sleep for 11 seconds 00000100:00100000:0.0:1787560451.176418:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d317930 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7454:1874392862696448:0@lo:1000: 00000040:01000000:0.0:1787560451.176471:0:7454:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1787560451.176500:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d317930 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7454:1874392862696576:0@lo:700: 00000100:00100000:0.0:1787560451.176521:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560451.176544:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862696576 00000100:00100000:0.0:1787560451.176547:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862696576 00000100:00100000:0.0:1787560451.176567:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787560451.176571:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e6c1ae0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7454:x1874392862696576:12345-0@lo:700: 00000100:00100000:0.0:1787560451.176607:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e6c1ae0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7454:x1874392862696576:12345-0@lo:700: Request processed in 36us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560451.176613:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787560451.176631:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 0000000080727a99 going to sleep for 11 seconds 00000100:00100000:0.0:1787560451.176643:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d317930 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7454:1874392862696576:0@lo:700: 00000100:00100000:0.0:1787560451.176674:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d317930 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7454:1874392862696704:0@lo:900: 00000100:00100000:0.0:1787560451.176698:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560451.176723:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862696704 00000100:00100000:0.0:1787560451.176726:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862696704 00000100:00100000:0.0:1787560451.176761:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787560451.176767:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b5f0c95 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7454:x1874392862696704:12345-0@lo:900: 00000100:00100000:0.0:1787560451.176797:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b5f0c95 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7454:x1874392862696704:12345-0@lo:900: Request processed in 31us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560451.176802:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787560451.176816:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 0000000080727a99 going to sleep for 11 seconds 00010000:00080000:0.0:1787560451.176828:0:7454:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000008d317930 x1874392862696704/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787560467 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560451.176838:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d317930 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7454:1874392862696704:0@lo:900: 00000100:00100000:0.0:1787560451.176882:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d317930 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7454:1874392862696832:0@lo:1000: 00000100:00100000:0.0:1787560451.176917:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560451.176939:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862696832 00000100:00100000:0.0:1787560451.176942:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862696832 00000100:00100000:0.0:1787560451.176957:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787560451.176961:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f859b38e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7454:x1874392862696832:12345-0@lo:1000: 00000100:00100000:0.0:1787560451.177012:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f859b38e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7454:x1874392862696832:12345-0@lo:1000: Request processed in 50us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560451.177018:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787560451.177030:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d6a0d425 going to sleep for 11 seconds 00000100:00100000:0.0:1787560451.177040:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d317930 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7454:1874392862696832:0@lo:1000: 00000040:01000000:2.0:1787560451.177633:0:7428:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1787560451.177754:0:7428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1787560451.178591:0:7454:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000080727a99 with version 0 00000020:00100000:0.0:1787560451.178620:0:7454:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787560451.178629:0:7454:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000008d317930 x1874392862697088/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787560451.178648:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d317930 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7454:1874392862697088:0@lo:1000: 00000100:00100000:0.0:1787560451.180370:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560451.180456:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862697088 00000100:00100000:0.0:1787560451.180467:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862697088 00000100:00100000:0.0:1787560451.180520:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787560451.180527:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9ee7fec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7454:x1874392862697088:12345-0@lo:1000: 00000100:00100000:0.0:1787560451.180869:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aa4d7ab1 going to sleep for 11 seconds 00000004:00000080:2.0:1787560451.181054:0:7428:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787560451.181268:0:7428:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1787560451.181466:0:7428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1787560451.182026:0:7452:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1787560451.182031:0:7452:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:2.0:1787560451.183160:0:7428:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787560451.184073:0:7428:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787560451.184111:0:7428:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1787560451.184340:0:7428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787560451.184589:0:7428:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1787560451.185852:0:7428:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1787560451.186120:0:7428:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1787560451.186268:0:7428:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1787560451.186401:0:7428:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1787560451.188102:0:7428:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1787560451.188340:0:7428:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1787560451.188532:0:7428:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1787560451.188676:0:7428:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00000001:00080000:3.0:1787560451.189774:0:6478:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00100000:10000000:2.0:1787560451.191903:0:7428:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1787560451.192170:0:7428:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1787560451.192367:0:7428:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1787560451.192520:0:7428:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1787560451.194562:0:7428:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1787560451.196152:0:7428:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1787560451.196319:0:7428:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1787560451.196575:0:7428:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00000100:00100000:0.0:1787560451.196951:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9ee7fec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7454:x1874392862697088:12345-0@lo:1000: Request processed in 16420us (16581us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787560451.196964:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:0.0:1787560451.197020:0:7454:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1787560451.197024:0:7454:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787560451.197040:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d317930 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7454:1874392862697088:0@lo:1000: 00000100:00100000:0.0:1787560451.197120:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d317930 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7454:1874392862697216:0@lo:1000: 00000100:00100000:0.0:1787560451.197154:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560451.197557:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 00000000636f4d2b going to sleep for 11 seconds 00000100:00100000:3.0:1787560451.198795:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862697216 00000100:00100000:3.0:1787560451.198808:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862697216 00000100:00100000:3.0:1787560451.198867:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787560451.198877:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9d7758b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7454:x1874392862697216:12345-0@lo:1000: 00100000:10000000:2.0:1787560451.198937:0:7428:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00000100:00100000:3.0:1787560451.198984:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9d7758b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7454:x1874392862697216:12345-0@lo:1000: Request processed in 108us (1829us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560451.198998:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00100000:10000000:2.0:1787560451.199076:0:7428:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00000100:00100000:0.0:1787560451.199080:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d317930 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7454:1874392862697216:0@lo:1000: 00000040:00080000:0.0:1787560451.199107:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1787560451.199142:0:7454:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000aa4d7ab1 with version 1 00100000:10000000:2.0:1787560451.199245:0:7428:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00000004:00080000:3.0:1787560451.199292:0:7443:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000001b29501b version 1 rpc_version 1 00000020:00100000:3.0:1787560451.199320:0:7443:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787560451.199328:0:7443:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000b70ddebc x1874392862697472/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787560451.199408:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b70ddebc pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7443:1874392862697472:0@lo:1000: 00100000:10000000:2.0:1787560451.199478:0:7428:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00000100:00100000:3.0:1787560451.199484:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560451.199505:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 0000000098398710 going to sleep for 11 seconds 00000100:00100000:3.0:1787560451.199521:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862697472 00000100:00100000:3.0:1787560451.199525:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862697472 00000100:00100000:3.0:1787560451.199562:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787560451.199569:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f2cc3c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7443:x1874392862697472:12345-0@lo:1000: 00100000:10000000:2.0:1787560451.199657:0:7428:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1787560451.202207:0:7428:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1787560451.202396:0:7428:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1787560451.203078:0:7428:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1787560451.203221:0:7428:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1787560451.203369:0:7428:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00000040:00080000:0.0:1787560451.203471:0:7454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787560451.203547:0:7454:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:2.0:1787560451.203567:0:7428:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1787560451.204840:0:7428:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 40000000:02000000:0.0:1787560451.205111:0:6505:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:2.0:1787560451.205147:0:7428:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1787560451.205343:0:7428:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1787560451.205505:0:7428:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1787560451.205910:0:7428:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1787560451.206220:0:7428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1787560451.219798:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b41ee560 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7453:x1874392862696320:12345-0@lo:700: Request processed in 44220us (44391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560451.219814:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787560451.220528:0:7453:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000638d07e2 x1874392862696320/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787560467 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560451.220544:0:7453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000638d07e2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7453:1874392862696320:0@lo:700: 40000000:02000000:3.0:1787560451.220557:0:7453:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:2.0:1787560451.229487:0:7428:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787560451.229525:0:7428:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb6db41c37988 00100000:10000000:2.0:1787560451.229533:0:7428:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000001:00080000:0.0:1787560451.231633:0:6478:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:3.0:1787560451.231806:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f2cc3c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7443:x1874392862697472:12345-0@lo:1000: Request processed in 32234us (32321us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787560451.231820:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1787560451.231925:0:7443:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1787560451.231930:0:7443:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787560451.231947:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b70ddebc pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7443:1874392862697472:0@lo:1000: 00000020:01000004:3.0:1787560451.232908:0:7428:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787560451.232939:0:7428:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.129@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787560451.232958:0:7428:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787560451.232984:0:7428:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1787560451.233962:0:7428:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787560451.234499:0:7428:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:1.0:1787560451.272832:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787560451.282550:0:7453:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787560451.282637:0:7453:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787560451.282642:0:7453:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:2.0:1787560452.087316:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560453.108966:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560454.136888:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560455.155674:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560456.180174:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560456.247357:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d317930 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862697600:0@lo:41: 00000100:00100000:0.0:1787560456.247459:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560456.248536:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862697600 00000100:00100000:3.0:1787560456.248546:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862697600 00000100:00100000:3.0:1787560456.248603:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787560456.248612:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c926e5c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862697600:12345-0@lo:41: 00000004:00000024:3.0:1787560456.248649:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1787560456.248712:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c926e5c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862697600:12345-0@lo:41: Request processed in 102us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560456.248719:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787560456.248764:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d317930 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862697600:0@lo:41: 00000100:00100000:1.0:1787560456.249206:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000002b3732e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862697856:0@lo:400: 00000100:00100000:1.0:1787560456.249252:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560456.249277:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787560456.249282:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ccfbb667 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862697728:0@lo:400: 00000100:00100000:1.0:1787560456.249305:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560456.249336:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862697856 00000100:00100000:1.0:1787560456.249340:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862697856 00000100:00100000:1.0:1787560456.249370:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787560456.249384:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1d7422b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862697856:12345-0@lo:400: 00000100:00100000:1.0:1787560456.249424:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1d7422b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862697856:12345-0@lo:400: Request processed in 41us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560456.249456:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787560456.249483:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008cba98df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862697984:0@lo:400: 00000100:00100000:1.0:1787560456.249508:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560456.249535:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862697984 00000100:00100000:1.0:1787560456.249539:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862697984 00000100:00100000:1.0:1787560456.249560:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787560456.249566:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000969dda42 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862697984:12345-0@lo:400: 00000100:00100000:1.0:1787560456.249597:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000969dda42 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862697984:12345-0@lo:400: Request processed in 31us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560456.249603:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787560456.249629:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000008cba98df x1874392862697984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560456.249640:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008cba98df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862697984:0@lo:400: 00010000:00080000:1.0:1787560456.249664:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000002b3732e x1874392862697856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560456.249672:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000002b3732e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862697856:0@lo:400: 00000100:00100000:2.0:1787560456.252664:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862697728 00000100:00100000:2.0:1787560456.252680:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862697728 00000100:00100000:2.0:1787560456.252739:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787560456.252748:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004036719f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+13:3626:x1874392862697728:12345-0@lo:400: 00000100:00100000:2.0:1787560456.252851:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004036719f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+13:3626:x1874392862697728:12345-0@lo:400: Request processed in 105us (3545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560456.252859:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787560456.252915:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ccfbb667 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862697728:0@lo:400: 00000001:02000400:2.0:1787560456.456361:0:7698:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787560457.205714:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787560457.268410:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787560457.268418:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9caffba72800 from 4 10000000:01000000:0.0:1787560457.268423:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787560457.268513:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 000000007b0254cb/0x4642c20bf2f33985 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560457.268525:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 000000007b0254cb/0x4642c20bf2f33985 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560457.268536:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 000000007b0254cb/0x4642c20bf2f33985 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560457.268558:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d317930 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862698112:0@lo:101: 00000100:00100000:0.0:1787560457.268624:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560457.268666:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 000000008535fcce going to sleep for 11 seconds 00000100:00100000:0.0:1787560457.268695:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862698112 00000100:00100000:0.0:1787560457.268702:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862698112 00000100:00100000:0.0:1787560457.268757:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787560457.268765:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a16c114 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+13:6497:x1874392862698112:12345-0@lo:101: 00010000:00010000:0.0:1787560457.268777:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560457.268790:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008cc58e1a/0x4642c20bf2f3398c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33985 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560457.268809:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008cc58e1a/0x4642c20bf2f3398c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33985 expref: 14 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560457.268836:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008cc58e1a/0x4642c20bf2f3398c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33985 expref: 14 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560457.268845:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008cc58e1a, rc 0) 00000100:00100000:0.0:1787560457.268882:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a16c114 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+14:6497:x1874392862698112:12345-0@lo:101: Request processed in 118us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560457.268889:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787560457.268944:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d317930 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862698112:0@lo:101: 00010000:00010000:0.0:1787560457.268958:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 000000007b0254cb/0x4642c20bf2f33985 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3398c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560457.268965:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 000000007b0254cb/0x4642c20bf2f33985 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f3398c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560457.269007:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d317930 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862698240:0@lo:256: 00000100:00100000:0.0:1787560457.269035:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560457.269047:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 000000008535fcce going to sleep for 11 seconds 00000100:00100000:1.0:1787560457.274409:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862698240 00000100:00100000:1.0:1787560457.274424:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862698240 00000100:00100000:1.0:1787560457.274949:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787560457.274959:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000571fd30b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+14:6497:x1874392862698240:12345-0@lo:256: 20000000:01000000:1.0:1787560457.274983:0:6494:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787560457.275005:0:6494:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787560457.275012:0:6494:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1787560457.275416:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000571fd30b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+14:6497:x1874392862698240:12345-0@lo:256: Request processed in 458us (6378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560457.275424:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787560457.281369:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d317930 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862698240:0@lo:256: 10000000:01000000:2.0:1787560457.281465:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787560457.281475:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 000000007b0254cb/0x4642c20bf2f33985 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3398c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560457.281485:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 000000007b0254cb/0x4642c20bf2f33985 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3398c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560457.281497:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787560457.281499:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cb000817800 from 21 10000000:01000000:2.0:1787560457.281501:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787560457.281534:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 0000000061dc78d9/0x4642c20bf2f33993 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560457.281541:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 0000000061dc78d9/0x4642c20bf2f33993 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560457.281549:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 0000000061dc78d9/0x4642c20bf2f33993 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560457.281566:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d6c88b7e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862698368:0@lo:101: 00000100:00100000:2.0:1787560457.281622:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560457.281658:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 0000000001c379a9 going to sleep for 11 seconds 00000100:00100000:0.0:1787560457.287866:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862698368 00000100:00100000:0.0:1787560457.287880:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862698368 00000100:00100000:0.0:1787560457.287947:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787560457.287957:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007eef3cea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+14:6497:x1874392862698368:12345-0@lo:101: 00010000:00010000:0.0:1787560457.287974:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560457.287992:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e416e3ff/0x4642c20bf2f3399a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33993 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560457.288019:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e416e3ff/0x4642c20bf2f3399a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33993 expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560457.288041:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e416e3ff/0x4642c20bf2f3399a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33993 expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560457.288049:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e416e3ff, rc 0) 00000100:00100000:0.0:1787560457.288311:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007eef3cea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:6497:x1874392862698368:12345-0@lo:101: Request processed in 354us (6687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560457.288319:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787560457.288373:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d6c88b7e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862698368:0@lo:101: 00010000:00010000:0.0:1787560457.288391:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 0000000061dc78d9/0x4642c20bf2f33993 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3399a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560457.288400:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 0000000061dc78d9/0x4642c20bf2f33993 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f3399a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560457.288996:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000508e05eb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862698496:0@lo:501: 00000100:00100000:0.0:1787560457.289037:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560457.289079:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c38f2010 going to sleep for 11 seconds 00000100:00100000:0.0:1787560457.289095:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862698496 00000100:00100000:0.0:1787560457.289100:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862698496 00000100:00100000:0.0:1787560457.289837:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787560457.289847:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033b49214 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:6497:x1874392862698496:12345-0@lo:501: 00000100:00100000:0.0:1787560457.289988:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033b49214 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:6497:x1874392862698496:12345-0@lo:501: Request processed in 143us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560457.289996:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787560457.290215:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000508e05eb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862698496:0@lo:501: 00000100:00100000:2.0:1787560457.290252:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000346ab37e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862698624:0@lo:503: 00000100:00100000:2.0:1787560457.290308:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560457.290340:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 0000000053385f98 going to sleep for 11 seconds 00000100:00100000:0.0:1787560457.291262:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862698624 00000100:00100000:0.0:1787560457.291271:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862698624 00000100:00100000:0.0:1787560457.291326:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787560457.291334:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ada9b3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:6497:x1874392862698624:12345-0@lo:503: 00000100:00100000:0.0:1787560457.292206:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ada9b3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:6497:x1874392862698624:12345-0@lo:503: Request processed in 869us (1894us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560457.292215:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787560457.299086:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000346ab37e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862698624:0@lo:503: 00000100:00100000:0.0:1787560457.302409:0:7726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000096572c4d pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7726:1874392862698752:0@lo:502: 00000100:00100000:0.0:1787560457.302583:0:7726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560457.302628:0:7726:0:(client.c:2715:ptlrpc_set_wait()) set 0000000019140038 going to sleep for 11 seconds 00000100:00100000:2.0:1787560457.302744:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862698752 00000100:00100000:2.0:1787560457.302752:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862698752 00000100:00100000:2.0:1787560457.302800:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787560457.302809:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b4442761 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:7726:x1874392862698752:12345-0@lo:502: 00000100:00100000:2.0:1787560457.304233:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b4442761 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:7726:x1874392862698752:12345-0@lo:502: Request processed in 1419us (1643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560457.304246:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787560457.304592:0:7726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000096572c4d pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7726:1874392862698752:0@lo:502: 00000100:00100000:1.0:1787560457.304656:0:7726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000002b3732e pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7726:1874392862698880:0@lo:502: 00000100:00100000:1.0:1787560457.304704:0:7726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560457.304729:0:7726:0:(client.c:2715:ptlrpc_set_wait()) set 0000000023fb95ec going to sleep for 11 seconds 00000100:00100000:0.0:1787560457.304866:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862698880 00000100:00100000:0.0:1787560457.304872:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862698880 00000100:00100000:0.0:1787560457.304917:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787560457.304925:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ee315ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:7726:x1874392862698880:12345-0@lo:502: 00000100:00100000:0.0:1787560457.305085:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ee315ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:7726:x1874392862698880:12345-0@lo:502: Request processed in 161us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560457.305091:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787560457.307366:0:7726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000002b3732e pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7726:1874392862698880:0@lo:502: 00000040:00080000:1.0:1787560457.307411:0:7726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1787560457.308124:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1787560457.308146:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787560457.308157:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 0000000061dc78d9/0x4642c20bf2f33993 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3399a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560457.308168:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 0000000061dc78d9/0x4642c20bf2f33993 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3399a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560457.308178:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787560457.308192:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cb000817800 from 4 10000000:01000000:2.0:1787560457.308195:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787560457.308232:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 000000001eb81e2b/0x4642c20bf2f339a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560457.308238:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 000000001eb81e2b/0x4642c20bf2f339a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560457.308246:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 000000001eb81e2b/0x4642c20bf2f339a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560457.308264:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000064452807 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862699008:0@lo:101: 00000100:00100000:2.0:1787560457.308327:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560457.308366:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 0000000053385f98 going to sleep for 11 seconds 00000100:00100000:2.0:1787560457.308385:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862699008 00000100:00100000:2.0:1787560457.308391:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862699008 00000100:00100000:2.0:1787560457.308465:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787560457.308474:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000339f4557 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:6497:x1874392862699008:12345-0@lo:101: 00010000:00010000:2.0:1787560457.308487:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560457.308497:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000219b95b9/0x4642c20bf2f339a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f339a1 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560457.308516:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000219b95b9/0x4642c20bf2f339a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f339a1 expref: 16 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560457.308525:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000219b95b9/0x4642c20bf2f339a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f339a1 expref: 16 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560457.308532:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000219b95b9, rc 0) 00000100:00100000:2.0:1787560457.308569:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000339f4557 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:6497:x1874392862699008:12345-0@lo:101: Request processed in 96us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560457.308575:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787560457.308613:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000064452807 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862699008:0@lo:101: 00010000:00010000:2.0:1787560457.308624:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 000000001eb81e2b/0x4642c20bf2f339a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f339a8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560457.308631:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 000000001eb81e2b/0x4642c20bf2f339a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f339a8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560457.308674:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000064452807 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862699136:0@lo:256: 00000100:00100000:2.0:1787560457.308710:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560457.308722:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 0000000053385f98 going to sleep for 11 seconds 00000100:00100000:2.0:1787560457.308732:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862699136 00000100:00100000:2.0:1787560457.308735:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862699136 00000100:00100000:2.0:1787560457.308755:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787560457.308759:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004fda0da9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:6497:x1874392862699136:12345-0@lo:256: 20000000:01000000:2.0:1787560457.308771:0:6494:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787560457.308786:0:6494:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787560457.308789:0:6494:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1787560457.308860:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004fda0da9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:6497:x1874392862699136:12345-0@lo:256: Request processed in 100us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560457.308867:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787560457.308892:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000064452807 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862699136:0@lo:256: 10000000:01000000:2.0:1787560457.308928:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787560457.308932:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 000000001eb81e2b/0x4642c20bf2f339a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f339a8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560457.308938:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 000000001eb81e2b/0x4642c20bf2f339a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f339a8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560457.308944:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787560457.308946:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1787560457.308948:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787560457.308961:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 000000006d1480ab/0x4642c20bf2f339af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560457.308967:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 000000006d1480ab/0x4642c20bf2f339af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560457.308981:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 000000006d1480ab/0x4642c20bf2f339af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560457.308990:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000064452807 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862699264:0@lo:101: 00000100:00100000:2.0:1787560457.309013:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560457.309027:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 0000000053385f98 going to sleep for 11 seconds 00000100:00100000:2.0:1787560457.309039:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862699264 00000100:00100000:2.0:1787560457.309042:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862699264 00000100:00100000:2.0:1787560457.309058:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787560457.309063:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c03f7ebe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:6497:x1874392862699264:12345-0@lo:101: 00010000:00010000:2.0:1787560457.309069:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560457.309076:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000057ff37d3/0x4642c20bf2f339b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f339af expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560457.309088:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000057ff37d3/0x4642c20bf2f339b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f339af expref: 17 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560457.309093:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000057ff37d3/0x4642c20bf2f339b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f339af expref: 17 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560457.309100:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000057ff37d3, rc 0) 00000100:00100000:2.0:1787560457.309123:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c03f7ebe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:6497:x1874392862699264:12345-0@lo:101: Request processed in 60us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560457.309129:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787560457.309154:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000064452807 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862699264:0@lo:101: 00010000:00010000:2.0:1787560457.309162:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 000000006d1480ab/0x4642c20bf2f339af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f339b6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560457.309178:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 000000006d1480ab/0x4642c20bf2f339af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f339b6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560457.309239:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000064452807 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862699392:0@lo:501: 00000100:00100000:2.0:1787560457.309262:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560457.309275:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 0000000053385f98 going to sleep for 11 seconds 00000100:00100000:2.0:1787560457.309286:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862699392 00000100:00100000:2.0:1787560457.309289:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862699392 00000100:00100000:2.0:1787560457.309304:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787560457.309309:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048b97c5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:6497:x1874392862699392:12345-0@lo:501: 00000100:00100000:2.0:1787560457.309406:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048b97c5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:6497:x1874392862699392:12345-0@lo:501: Request processed in 97us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560457.309413:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787560457.309457:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000064452807 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862699392:0@lo:501: 00000100:00100000:2.0:1787560457.309479:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000064452807 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862699520:0@lo:503: 00000100:00100000:2.0:1787560457.309510:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560457.309522:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 0000000053385f98 going to sleep for 11 seconds 00000100:00100000:2.0:1787560457.309532:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862699520 00000100:00100000:2.0:1787560457.309535:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862699520 00000100:00100000:2.0:1787560457.309550:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787560457.309555:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f2e344a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:6497:x1874392862699520:12345-0@lo:503: 00000100:00100000:2.0:1787560457.309623:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f2e344a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:6497:x1874392862699520:12345-0@lo:503: Request processed in 68us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560457.309628:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787560457.309662:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000064452807 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862699520:0@lo:503: 00000100:00100000:0.0:1787560457.317513:0:7727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004911b1d0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7727:1874392862699648:0@lo:502: 00000100:00100000:0.0:1787560457.317602:0:7727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560457.317730:0:7727:0:(client.c:2715:ptlrpc_set_wait()) set 00000000db88eb93 going to sleep for 11 seconds 00000100:00100000:3.0:1787560457.319378:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862699648 00000100:00100000:3.0:1787560457.319394:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862699648 00000100:00100000:3.0:1787560457.319476:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787560457.319486:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c53fda9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:7727:x1874392862699648:12345-0@lo:502: 00000100:00100000:3.0:1787560457.319653:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c53fda9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:7727:x1874392862699648:12345-0@lo:502: Request processed in 169us (2051us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560457.319661:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787560457.319945:0:7727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004911b1d0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7727:1874392862699648:0@lo:502: 00000020:01000000:1.0:1787560457.319980:0:7727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560457.319990:0:7727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560457.320140:0:7727:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1787560457.320149:0:7727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787560457.320152:0:7727:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:00000080:1.0:1787560457.320176:0:7727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787560457.320203:0:7727:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000001b8cabc3) 00000020:00000080:1.0:1787560457.320225:0:7727:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1787560457.320232:0:7727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787560457.320315:0:7727:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1787560457.320320:0:7727:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787560457.320327:0:7727:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4642c20bf2f339c4 00010000:00080000:1.0:1787560457.320367:0:7727:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003b093bc8@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.129@tcp at head 00010000:00010000:0.0:1787560457.325692:0:7727:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:3.0:1787560457.328344:0:7727:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787560457.328362:0:7727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787560457.328402:0:7727:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787560457.329646:0:7727:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4642c20bf2f339cb 00000100:00080000:3.0:1787560457.329664:0:7727:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787560457.329670:0:7727:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000003b093bc8 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787560457.329757:0:7727:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000638d07e2 x1874392862699776/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787560457.329776:0:7727:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:3.0:1787560457.329821:0:7727:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1787560457.330022:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000638d07e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862699776:0@lo:38: 00000100:00100000:0.0:1787560457.330097:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560457.330168:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000002b3732e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862699904:0@lo:400: 00000100:00100000:1.0:1787560457.330210:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560457.330249:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862699904 00000100:00100000:1.0:1787560457.330255:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862699904 00000100:00100000:1.0:1787560457.330305:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787560457.330313:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085a5285b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862699904:12345-0@lo:400: 00000100:00100000:1.0:1787560457.330370:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085a5285b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862699904:12345-0@lo:400: Request processed in 58us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560457.330377:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787560457.330599:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000002b3732e x1874392862699904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560473 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560457.330612:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000002b3732e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862699904:0@lo:400: 00000100:00100000:2.0:1787560457.331033:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000af72b0cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874392862700160:0@lo:400: 00000100:00100000:2.0:1787560457.331072:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560457.331096:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787560457.331102:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008cba98df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862700032:0@lo:400: 00000100:00100000:3.0:1787560457.331223:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862699776 00000100:00100000:3.0:1787560457.331228:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862699776 00000100:00100000:3.0:1787560457.331262:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787560457.331267:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0e264d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1874392862699776:12345-0@lo:38: 00010000:00080000:3.0:1787560457.331292:0:6504:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 176 last 0 00000100:00100000:1.0:1787560457.331301:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862700160 00000100:00100000:1.0:1787560457.331304:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862700160 00000020:00000080:3.0:1787560457.331329:0:6504:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4642c20bf2f339d2 00000100:00100000:1.0:1787560457.331329:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787560457.331335:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064452807 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874392862700160:12345-0@lo:400: 00000004:00100000:3.0:1787560457.331343:0:6504:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1787560457.331348:0:6504:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1787560457.331382:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064452807 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874392862700160:12345-0@lo:400: Request processed in 47us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560457.331387:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787560457.331553:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787560457.331575:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000af72b0cc x1874392862700160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560473 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560457.331586:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000af72b0cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874392862700160:0@lo:400: 00000100:00100000:0.0:1787560457.335899:0:6503:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1787560457.335922:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1787560457.339877:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862700032 00000100:00100000:3.0:1787560457.339892:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862700032 00000100:00100000:2.0:1787560457.340328:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787560457.340338:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001384c1e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862700032:12345-0@lo:400: 00000100:00100000:3.0:1787560457.340578:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008cba98df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862700032:0@lo:400: 00000100:00100000:2.0:1787560457.340693:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001384c1e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862700032:12345-0@lo:400: Request processed in 357us (9140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560457.340702:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1787560457.340887:0:7732:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@0000000069fb9719 x1874392862700288/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560457.340898:0:7732:0:(client.c:2715:ptlrpc_set_wait()) set 000000004cb457d1 going to sleep for 0 seconds 00000020:01000000:3.0:1787560457.341003:0:7727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560457.341010:0:7727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560457.341012:0:7727:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1787560457.341015:0:7727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560457.341019:0:7727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560457.341020:0:7727:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787560457.341023:0:7727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787560457.341024:0:7727:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787560457.341047:0:7727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006fc02682 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7727:1874392862700416:0@lo:502: 00000100:00100000:3.0:1787560457.341098:0:7727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560457.341319:0:7727:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f3551e2d going to sleep for 11 seconds 00000100:00100000:2.0:1787560457.346066:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862700416 00000100:00100000:2.0:1787560457.346079:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862700416 00000100:00100000:2.0:1787560457.346672:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787560457.346683:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000061e8a5ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:7727:x1874392862700416:12345-0@lo:502: 00000100:00100000:2.0:1787560457.347243:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000061e8a5ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:7727:x1874392862700416:12345-0@lo:502: Request processed in 561us (6144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560457.347252:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1787560457.347684:0:6504:0:(import.c:65:import_set_state_nolock()) 000000004291ec8b : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787560457.347746:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0e264d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3622:x1874392862699776:12345-0@lo:38: Request processed in 16477us (17648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560457.347754:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787560457.350059:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787560457.350075:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787560457.350083:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787560457.350089:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787560457.350092:0:3622:0:(import.c:65:import_set_state_nolock()) 000000003b093bc8 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1787560457.350133:0:3622:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000004cb457d1): req@0000000069fb9719 x1874392862700288/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560457.350154:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000638d07e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862699776:0@lo:38: 00000100:00100000:3.0:1787560457.350599:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001b295c28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862700544:0@lo:41: 00000100:00100000:3.0:1787560457.350660:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560457.350765:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862700544 00000100:00100000:2.0:1787560457.350772:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862700544 00000100:00100000:2.0:1787560457.350816:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787560457.350825:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eca4cb8c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3623:x1874392862700544:12345-0@lo:41: 00000004:00000024:2.0:1787560457.350855:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1787560457.350911:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eca4cb8c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3623:x1874392862700544:12345-0@lo:41: Request processed in 87us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560457.350918:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787560457.351041:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001b295c28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862700544:0@lo:41: 00000100:00100000:1.0:1787560457.351845:0:7727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006fc02682 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:7727:1874392862700416:0@lo:502: 00000100:00100000:1.0:1787560457.351944:0:7732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560457.351975:0:7732:0:(client.c:2715:ptlrpc_set_wait()) set 000000004cb457d1 going to sleep for 11 seconds 00000020:01000000:1.0:1787560457.351994:0:7727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560457.352001:0:7727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560457.352003:0:7727:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787560457.352007:0:7727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1787560457.352068:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1787560457.352087:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787560457.352097:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 000000006d1480ab/0x4642c20bf2f339af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f339b6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560457.352132:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 000000006d1480ab/0x4642c20bf2f339af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f339b6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560457.352142:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787560457.352144:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9cafe06b3370 from 1 10000000:01000000:1.0:1787560457.352146:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787560457.352170:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 000000005283323a/0x4642c20bf2f339d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560457.352177:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 000000005283323a/0x4642c20bf2f339d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560457.352195:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 000000005283323a/0x4642c20bf2f339d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560457.352210:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000af72b0cc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862700672:0@lo:101: 00000100:00100000:1.0:1787560457.352240:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560457.352271:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 000000006ff5a19a going to sleep for 11 seconds 00000100:00100000:0.0:1787560457.352396:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862700672 00000100:00100000:0.0:1787560457.352403:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862700672 00000100:00100000:0.0:1787560457.352467:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787560457.352476:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2e7d05f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:6497:x1874392862700672:12345-0@lo:101: 00010000:00010000:0.0:1787560457.352487:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560457.352498:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000780e030b/0x4642c20bf2f339e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f339d9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560457.352517:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000780e030b/0x4642c20bf2f339e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f339d9 expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560457.352526:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000780e030b/0x4642c20bf2f339e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f339d9 expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560457.352533:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000780e030b, rc 0) 00000100:00100000:0.0:1787560457.352570:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2e7d05f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:6497:x1874392862700672:12345-0@lo:101: Request processed in 95us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560457.352576:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787560457.354254:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000af72b0cc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862700672:0@lo:101: 00010000:00010000:1.0:1787560457.354278:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 000000005283323a/0x4642c20bf2f339d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f339e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560457.354289:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 000000005283323a/0x4642c20bf2f339d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f339e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560457.354358:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000af72b0cc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862700800:0@lo:501: 00000100:00100000:1.0:1787560457.354406:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560457.354487:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 000000006ff5a19a going to sleep for 11 seconds 00000100:00100000:1.0:1787560457.354504:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862700800 00000100:00100000:1.0:1787560457.354509:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862700800 00000100:00100000:1.0:1787560457.354543:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787560457.354551:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa9f6620 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:6497:x1874392862700800:12345-0@lo:501: 00000100:00100000:1.0:1787560457.354643:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa9f6620 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:6497:x1874392862700800:12345-0@lo:501: Request processed in 93us (237us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787560457.354650:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787560457.354759:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000af72b0cc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862700800:0@lo:501: 10000000:01000000:1.0:1787560457.354782:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787560457.354788:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 000000005283323a/0x4642c20bf2f339d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f339e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560457.354795:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 000000005283323a/0x4642c20bf2f339d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f339e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560457.354935:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862700288 00000100:00100000:2.0:1787560457.354940:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862700288 00000100:00100000:2.0:1787560457.354970:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787560457.354976:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008cba98df pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7732:x1874392862700288:12345-0@lo:1000: 00000100:00100000:2.0:1787560457.355052:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008cba98df pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7732:x1874392862700288:12345-0@lo:1000: Request processed in 77us (3123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560457.355058:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787560457.355203:0:7732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000069fb9719 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7732:1874392862700288:0@lo:1000: 00000040:01000000:1.0:1787560457.355229:0:7732:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787560457.355254:0:7732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000069fb9719 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7732:1874392862700928:0@lo:1000: 00000100:00100000:1.0:1787560457.355282:0:7732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560457.355307:0:7732:0:(client.c:2715:ptlrpc_set_wait()) set 000000004cb457d1 going to sleep for 11 seconds 00000100:00100000:2.0:1787560457.355699:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862700928 00000100:00100000:2.0:1787560457.355704:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862700928 00000100:00100000:2.0:1787560457.355732:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787560457.355738:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af72b0cc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7732:x1874392862700928:12345-0@lo:1000: 00000100:00100000:2.0:1787560457.355841:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af72b0cc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7732:x1874392862700928:12345-0@lo:1000: Request processed in 103us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560457.355847:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787560457.357161:0:7732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000069fb9719 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7732:1874392862700928:0@lo:1000: 00000100:00100000:1.0:1787560457.357226:0:7732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000069fb9719 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7732:1874392862701056:0@lo:700: 00000100:00100000:1.0:1787560457.357264:0:7732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560457.357299:0:7732:0:(client.c:2715:ptlrpc_set_wait()) set 00000000da611d33 going to sleep for 11 seconds 00000100:00100000:2.0:1787560457.357406:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862701056 00000100:00100000:2.0:1787560457.357413:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862701056 00000100:00100000:2.0:1787560457.357492:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787560457.357498:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002b3732e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7732:x1874392862701056:12345-0@lo:700: 00000100:00100000:2.0:1787560457.357548:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002b3732e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7732:x1874392862701056:12345-0@lo:700: Request processed in 50us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560457.357554:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787560457.358231:0:7732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000069fb9719 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7732:1874392862701056:0@lo:700: 00000100:00100000:1.0:1787560457.358388:0:7732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000069fb9719 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7732:1874392862701184:0@lo:1000: 00000100:00100000:1.0:1787560457.358422:0:7732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560457.358548:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862701184 00000100:00100000:2.0:1787560457.358554:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862701184 00000100:00100000:2.0:1787560457.358584:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787560457.358590:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ccfbb667 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7732:x1874392862701184:12345-0@lo:1000: 00000100:00100000:2.0:1787560457.359262:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ccfbb667 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7732:x1874392862701184:12345-0@lo:1000: Request processed in 671us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560457.359269:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787560457.360202:0:7732:0:(client.c:2715:ptlrpc_set_wait()) set 000000006ff5a19a going to sleep for 11 seconds 00000100:00100000:1.0:1787560457.360226:0:7732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000069fb9719 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7732:1874392862701184:0@lo:1000: 00000004:00080000:1.0:1787560457.360280:0:7732:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000da611d33 with version 0 00000020:00100000:1.0:1787560457.360300:0:7732:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787560457.360306:0:7732:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000069fb9719 x1874392862701440/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787560457.360323:0:7732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000069fb9719 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7732:1874392862701440:0@lo:1000: 00000100:00100000:1.0:1787560457.360357:0:7732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560457.360464:0:7732:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d50174fe going to sleep for 11 seconds 00000100:00100000:3.0:1787560457.364020:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862701440 00000100:00100000:3.0:1787560457.369491:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862701440 00000100:00100000:2.0:1787560457.369728:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787560457.369737:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085793113 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7732:x1874392862701440:12345-0@lo:1000: 00000001:00080000:1.0:1787560457.383192:0:7430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:1.0:1787560457.383206:0:7430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787560457.383667:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085793113 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7732:x1874392862701440:12345-0@lo:1000: Request processed in 13927us (23305us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787560457.383682:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1787560457.388095:0:7732:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1787560457.388105:0:7732:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787560457.388122:0:7732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000069fb9719 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7732:1874392862701440:0@lo:1000: 00000100:00100000:1.0:1787560457.388231:0:7732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000069fb9719 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7732:1874392862701568:0@lo:1000: 00000100:00100000:1.0:1787560457.388287:0:7732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560457.393254:0:7732:0:(client.c:2715:ptlrpc_set_wait()) set 000000004cb457d1 going to sleep for 11 seconds 00000100:00100000:2.0:1787560457.393383:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862701568 00000100:00100000:2.0:1787560457.393393:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862701568 00000100:00100000:3.0:1787560457.393983:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787560457.393994:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a72a3fb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7732:x1874392862701568:12345-0@lo:1000: 00000100:00100000:3.0:1787560457.394121:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a72a3fb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7732:x1874392862701568:12345-0@lo:1000: Request processed in 129us (5834us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560457.394140:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787560457.394242:0:7732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000069fb9719 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7732:1874392862701568:0@lo:1000: 00000040:00080000:1.0:1787560457.394269:0:7732:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1787560457.394309:0:7732:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000da611d33 with version 1 00000004:00080000:0.0:1787560457.396080:0:7730:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000ed05be36 version 1 rpc_version 1 00000020:00100000:0.0:1787560457.396127:0:7730:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787560457.396137:0:7730:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000b67232b0 x1874392862701824/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787560457.396161:0:7730:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b67232b0 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7730:1874392862701824:0@lo:1000: 00000100:00100000:0.0:1787560457.396233:0:7730:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560457.396276:0:7730:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d2b31dd1 going to sleep for 11 seconds 00000100:00100000:2.0:1787560457.396766:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862701824 00000100:00100000:2.0:1787560457.396773:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862701824 00000100:00100000:2.0:1787560457.396836:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787560457.396845:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023acc0dd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7730:x1874392862701824:12345-0@lo:1000: 00000040:00080000:1.0:1787560457.397729:0:7732:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787560457.397793:0:7732:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787560457.397797:0:7732:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:1.0:1787560457.410388:0:7430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:2.0:1787560457.410586:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023acc0dd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7730:x1874392862701824:12345-0@lo:1000: Request processed in 13738us (14349us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787560457.410599:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:0.0:1787560457.410707:0:7730:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1787560457.410712:0:7730:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787560457.410727:0:7730:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b67232b0 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7730:1874392862701824:0@lo:1000: 00000020:00000004:3.0:1787560457.610953:0:7756:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787560457.611249:0:7756:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787560458.227633:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560459.251926:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560460.275730:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787560460.287228:0:7858:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787560460.287426:0:7858:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787560461.299642:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560461.364755:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560461.364780:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b67232b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862701952:0@lo:41: 00000100:00100000:0.0:1787560461.364854:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560461.365168:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862701952 00000100:00100000:2.0:1787560461.365177:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862701952 00000100:00100000:2.0:1787560461.365226:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787560461.365235:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004911b1d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862701952:12345-0@lo:41: 00000004:00000024:2.0:1787560461.365265:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1787560461.365332:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004911b1d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862701952:12345-0@lo:41: Request processed in 99us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560461.365339:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787560461.366288:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b67232b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862701952:0@lo:41: 00000020:00000080:2.0:1787560461.406695:0:7906:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa2861b00 20000000:00000080:2.0:1787560461.406717:0:7906:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9caffcacd800 uarg=0000000000000000 20000000:01000000:2.0:1787560461.406759:0:7906:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787560461.406765:0:7906:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787560461.406769:0:7906:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787560461.406839:0:7906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1787560461.406849:0:7906:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1787560461.419929:0:7906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787560461.420465:0:7906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787560461.420503:0:7906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1787560461.420532:0:7906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1787560461.420550:0:7906:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787560461.420565:0:7906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ab9165b8/0x4642c20bf2f339e7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560461.420582:0:7906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004a445218/0x4642c20bf2f33866 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f3385f expref: 17 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560461.420589:0:7906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001f4dd5ed/0x4642c20bf2f33954 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f3394d expref: 17 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560461.420595:0:7906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ab9165b8/0x4642c20bf2f339e7 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560461.420631:0:7906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001f4dd5ed/0x4642c20bf2f33954 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f3394d expref: 17 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560461.420644:0:7906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001f4dd5ed/0x4642c20bf2f33954 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f3394d expref: 17 pid: 6494 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560461.420657:0:7906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001b295c28 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7906:1874392862702080:0@lo:104: 00000100:00100000:3.0:1787560461.420725:0:7906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787560461.420776:0:7906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004a445218/0x4642c20bf2f33866 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f3385f expref: 17 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560461.420795:0:7906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004a445218/0x4642c20bf2f33866 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f3385f expref: 17 pid: 6493 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560461.420803:0:7906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003c2e54fc pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7906:1874392862702208:0@lo:104: 00000100:00100000:3.0:1787560461.420824:0:7906:0:(client.c:2715:ptlrpc_set_wait()) set 0000000078acefa8 going to sleep for 11 seconds 00000100:00100000:2.0:1787560461.424350:0:6482:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787560461.424404:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560461.424464:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862702080 00000100:00100000:2.0:1787560461.424473:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862702080 00000100:00100000:2.0:1787560461.424512:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862702208 00000100:00100000:2.0:1787560461.424515:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862702208 00000100:00100000:2.0:1787560461.424530:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787560461.424538:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e27814f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+4:7906:x1874392862702080:12345-0@lo:104: 00010000:00010000:2.0:1787560461.424555:0:6482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: 00000000f39b93b9/0x4642c20bf2f3394d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33954 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560461.424618:0:6482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787560461.424634:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e27814f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+4:7906:x1874392862702080:12345-0@lo:104: Request processed in 97us (3910us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560461.424641:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787560461.424674:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787560461.424680:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000346ab37e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:7906:x1874392862702208:12345-0@lo:104: 00010000:00010000:2.0:1787560461.424687:0:6482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: 00000000ba72076c/0x4642c20bf2f3385f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33866 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560461.424721:0:6482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787560461.424725:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000346ab37e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:7906:x1874392862702208:12345-0@lo:104: Request processed in 47us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560461.424731:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1787560461.424748:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787560461.424753:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: 00000000f39b93b9/0x4642c20bf2f3394d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33954 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560461.424760:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f39b93b9 already unused, calling callback (00000000fb88b142) 10000000:00010000:2.0:1787560461.424764:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: 00000000f39b93b9/0x4642c20bf2f3394d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33954 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560461.424771:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: 00000000f39b93b9/0x4642c20bf2f3394d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33954 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560461.424777:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: 00000000f39b93b9/0x4642c20bf2f3394d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33954 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560461.424782:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787560461.424812:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: 00000000f39b93b9/0x4642c20bf2f3394d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33954 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560461.424829:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787560461.424846:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: 00000000f39b93b9/0x4642c20bf2f3394d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33954 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560461.424853:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: 00000000f39b93b9/0x4642c20bf2f3394d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33954 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560461.424867:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560461.424869:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: 00000000ba72076c/0x4642c20bf2f3385f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33866 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560461.424875:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ba72076c already unused, calling callback (00000000fb88b142) 10000000:00010000:2.0:1787560461.424876:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: 00000000ba72076c/0x4642c20bf2f3385f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33866 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560461.424882:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: 00000000ba72076c/0x4642c20bf2f3385f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33866 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560461.424888:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: 00000000ba72076c/0x4642c20bf2f3385f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33866 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560461.424892:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787560461.424904:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: 00000000ba72076c/0x4642c20bf2f3385f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33866 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560461.424910:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787560461.424914:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: 00000000ba72076c/0x4642c20bf2f3385f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33866 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560461.424920:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: 00000000ba72076c/0x4642c20bf2f3385f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33866 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560461.424940:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560461.424942:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560461.424944:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560461.424950:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560461.424970:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1ff16ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862702336:0@lo:103: 00000100:00100000:2.0:1787560461.425003:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560461.425034:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787560461.425039:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a6ee811b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862702464:0@lo:103: 00000100:00100000:2.0:1787560461.425058:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560461.425098:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862702336 00000100:00100000:2.0:1787560461.425102:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862702336 00000100:00100000:3.0:1787560461.425624:0:7906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001b295c28 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7906:1874392862702080:0@lo:104: 00000100:00100000:3.0:1787560461.425635:0:7906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003c2e54fc pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7906:1874392862702208:0@lo:104: 00010000:00010000:3.0:1787560461.425655:0:7906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ab9165b8/0x4642c20bf2f339e7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560461.426334:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862702464 00000100:00100000:3.0:1787560461.426343:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862702464 00010000:00010000:3.0:1787560461.426375:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004a445218/0x4642c20bf2f33866 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f3385f expref: 19 pid: 6493 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560461.426412:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787560461.426420:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000364180d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+19:3625:x1874392862702464:12345-0@lo:103: 00010000:00010000:3.0:1787560461.426452:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560461.426457:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004a445218/0x4642c20bf2f33866 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f3385f expref: 19 pid: 6493 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560461.426466:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004a445218/0x4642c20bf2f33866 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f3385f expref: 19 pid: 6493 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560461.426480:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004a445218/0x4642c20bf2f33866 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f3385f expref: 19 pid: 6493 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560461.426493:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560461.426569:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000364180d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:3625:x1874392862702464:12345-0@lo:103: Request processed in 147us (1507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560461.426577:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787560461.426693:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a6ee811b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862702464:0@lo:103: 00010000:00010000:2.0:1787560461.426786:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001f4dd5ed/0x4642c20bf2f33954 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f3394d expref: 17 pid: 6494 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560461.426816:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787560461.426824:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6c88b7e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:3625:x1874392862702336:12345-0@lo:103: 00010000:00010000:2.0:1787560461.426832:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560461.426836:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001f4dd5ed/0x4642c20bf2f33954 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f3394d expref: 17 pid: 6494 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560461.426844:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001f4dd5ed/0x4642c20bf2f33954 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f3394d expref: 17 pid: 6494 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560461.426853:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001f4dd5ed/0x4642c20bf2f33954 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f3394d expref: 17 pid: 6494 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560461.426862:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ab9165b8/0x4642c20bf2f339e7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560461.426880:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ab9165b8/0x4642c20bf2f339e7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560461.426893:0:6485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ab9165b8/0x4642c20bf2f339e7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560461.426899:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ab9165b8/0x4642c20bf2f339e7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560461.426904:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ab9165b8/0x4642c20bf2f339e7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560461.426909:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ab9165b8/0x4642c20bf2f339e7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560461.426915:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ab9165b8 already unused, calling callback (0000000018131874) 00010000:00010000:2.0:1787560461.426918:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ab9165b8/0x4642c20bf2f339e7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560461.426923:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ab9165b8/0x4642c20bf2f339e7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560461.431261:0:7906:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ab9165b8/0x4642c20bf2f339e7 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560461.431281:0:7906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ab9165b8/0x4642c20bf2f339e7 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560461.432324:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ab9165b8/0x4642c20bf2f339e7 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560461.432339:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ab9165b8/0x4642c20bf2f339e7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560461.432362:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560461.432618:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6c88b7e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:3625:x1874392862702336:12345-0@lo:103: Request processed in 5792us (7610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560461.432640:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787560461.432754:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1ff16ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862702336:0@lo:103: 00010000:00010000:2.0:1787560462.324632:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560462.387719:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003c2e54fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862702592:0@lo:41: 00000100:00100000:1.0:1787560462.387786:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560462.387966:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862702592 00000100:00100000:3.0:1787560462.387975:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862702592 00000100:00100000:3.0:1787560462.388033:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787560462.388042:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069fb9719 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862702592:12345-0@lo:41: 00000004:00000024:3.0:1787560462.388082:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1787560462.388133:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069fb9719 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862702592:12345-0@lo:41: Request processed in 92us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560462.388140:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787560462.388267:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003c2e54fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862702592:0@lo:41: 00000100:00100000:1.0:1787560462.388624:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009268eb90 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862702848:0@lo:400: 00000100:00100000:1.0:1787560462.388656:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560462.388678:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787560462.388685:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ed267aee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862702976:0@lo:400: 00000100:00100000:1.0:1787560462.388706:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560462.388732:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862702848 00000100:00100000:1.0:1787560462.388736:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862702848 00000100:00100000:1.0:1787560462.388764:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787560462.388770:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d2ff0da pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862702848:12345-0@lo:400: 00000100:00100000:1.0:1787560462.388803:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d2ff0da pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862702848:12345-0@lo:400: Request processed in 34us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560462.388809:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1787560462.388839:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000009268eb90 x1874392862702848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560462.388850:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009268eb90 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862702848:0@lo:400: 00000100:00100000:1.0:1787560462.388864:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a490d231 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862703104:0@lo:400: 00000100:00100000:1.0:1787560462.388884:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560462.388910:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787560462.388915:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004ba258b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862702720:0@lo:400: 00000100:00100000:1.0:1787560462.388938:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560462.388964:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862703104 00000100:00100000:1.0:1787560462.388967:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862703104 00000100:00100000:1.0:1787560462.388989:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787560462.388994:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009268eb90 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862703104:12345-0@lo:400: 00000100:00100000:1.0:1787560462.389039:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009268eb90 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862703104:12345-0@lo:400: Request processed in 45us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560462.389044:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787560462.389061:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862702720 00000100:00100000:1.0:1787560462.389064:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862702720 00000100:00100000:1.0:1787560462.389099:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787560462.389106:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd7c658f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:3623:x1874392862702720:12345-0@lo:400: 00000100:00100000:1.0:1787560462.389132:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd7c658f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:3623:x1874392862702720:12345-0@lo:400: Request processed in 28us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560462.389138:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787560462.389181:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004ba258b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862702720:0@lo:400: 00010000:00080000:1.0:1787560462.389190:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a490d231 x1874392862703104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560462.389198:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a490d231 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862703104:0@lo:400: 00000100:00100000:0.0:1787560462.389446:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862702976 00000100:00100000:0.0:1787560462.389450:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862702976 00000100:00100000:0.0:1787560462.389487:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787560462.389493:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bcd8aa34 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862702976:12345-0@lo:400: 00000100:00100000:0.0:1787560462.389530:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bcd8aa34 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862702976:12345-0@lo:400: Request processed in 38us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560462.389537:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787560462.389559:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ed267aee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862702976:0@lo:400: 00010000:00010000:2.0:1787560463.347577:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787560464.243605:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787560464.243790:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9caffba72800 from 1 10000000:01000000:2.0:1787560464.243794:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787560464.243836:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 00000000d4e51baa/0x4642c20bf2f339ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560464.243847:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 00000000d4e51baa/0x4642c20bf2f339ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560464.243856:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 00000000d4e51baa/0x4642c20bf2f339ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560464.243878:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000256135c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862703232:0@lo:101: 00000100:00100000:2.0:1787560464.243947:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560464.244003:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 000000000f9f84e2 going to sleep for 11 seconds 00000100:00100000:3.0:1787560464.244079:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862703232 00000100:00100000:3.0:1787560464.244087:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862703232 00000100:00100000:3.0:1787560464.244156:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787560464.244164:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000bb0bba5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:6497:x1874392862703232:12345-0@lo:101: 00010000:00010000:3.0:1787560464.244176:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560464.244189:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004a445218/0x4642c20bf2f339f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f339ee expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560464.244210:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004a445218/0x4642c20bf2f339f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f339ee expref: 17 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560464.244219:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004a445218/0x4642c20bf2f339f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f339ee expref: 17 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560464.244226:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004a445218, rc 0) 00000100:00100000:3.0:1787560464.244271:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000bb0bba5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:6497:x1874392862703232:12345-0@lo:101: Request processed in 108us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560464.244277:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787560464.246202:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000256135c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862703232:0@lo:101: 00010000:00010000:2.0:1787560464.246228:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 00000000d4e51baa/0x4642c20bf2f339ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f339f5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560464.246239:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 00000000d4e51baa/0x4642c20bf2f339ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f339f5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560464.246317:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000256135c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862703360:0@lo:501: 00000100:00100000:2.0:1787560464.246370:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560464.246422:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 000000000f9f84e2 going to sleep for 11 seconds 00000100:00100000:3.0:1787560464.246924:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862703360 00000100:00100000:3.0:1787560464.246931:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862703360 00000100:00100000:3.0:1787560464.246978:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787560464.246987:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5a19947 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:6497:x1874392862703360:12345-0@lo:501: 00000100:00100000:3.0:1787560464.247118:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5a19947 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:6497:x1874392862703360:12345-0@lo:501: Request processed in 132us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560464.247125:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787560464.247173:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000256135c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862703360:0@lo:501: 00000100:00100000:1.0:1787560464.247204:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a490d231 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862703488:0@lo:503: 00000100:00100000:1.0:1787560464.247243:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560464.247278:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fb8d0e07 going to sleep for 11 seconds 00000100:00100000:2.0:1787560464.247501:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862703488 00000100:00100000:2.0:1787560464.247511:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862703488 00000100:00100000:2.0:1787560464.247538:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787560464.247543:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f157d9e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:6497:x1874392862703488:12345-0@lo:503: 00000100:00100000:2.0:1787560464.247617:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f157d9e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:6497:x1874392862703488:12345-0@lo:503: Request processed in 73us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560464.247623:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787560464.247732:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a490d231 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862703488:0@lo:503: 00000100:00100000:1.0:1787560464.250614:0:8040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a490d231 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8040:1874392862703616:0@lo:502: 00000100:00100000:1.0:1787560464.250686:0:8040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560464.250730:0:8040:0:(client.c:2715:ptlrpc_set_wait()) set 000000006662bd6d going to sleep for 11 seconds 00000100:00100000:2.0:1787560464.250788:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862703616 00000100:00100000:2.0:1787560464.250796:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862703616 00000100:00100000:2.0:1787560464.250840:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787560464.250847:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096e8c42e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:8040:x1874392862703616:12345-0@lo:502: 00000100:00100000:2.0:1787560464.250962:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096e8c42e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:8040:x1874392862703616:12345-0@lo:502: Request processed in 115us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560464.250969:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787560464.251176:0:8040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a490d231 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8040:1874392862703616:0@lo:502: 00000020:01000000:3.0:1787560464.251203:0:8040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560464.251212:0:8040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560464.251214:0:8040:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787560464.251221:0:8040:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9caffba72800 00000020:00000080:3.0:1787560464.251224:0:8040:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787560464.251261:0:8040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeaba9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8040:1874392862703744:0@lo:502: 00000100:00100000:3.0:1787560464.251294:0:8040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560464.251320:0:8040:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc5955e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787560464.251364:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862703744 00000100:00100000:1.0:1787560464.251368:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862703744 00000100:00100000:1.0:1787560464.251398:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787560464.251405:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5803850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:8040:x1874392862703744:12345-0@lo:502: 00000100:00100000:1.0:1787560464.251535:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5803850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:8040:x1874392862703744:12345-0@lo:502: Request processed in 129us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560464.251542:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787560464.251642:0:8040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeaba9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8040:1874392862703744:0@lo:502: 00000020:01000000:3.0:1787560464.251660:0:8040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560464.251665:0:8040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560464.251666:0:8040:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787560464.251669:0:8040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1787560464.251808:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787560464.251829:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787560464.251838:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49600/0x4642c20bf2f339ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f339f5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560464.251848:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffca49600/0x4642c20bf2f339ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f339f5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560464.251858:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787560464.251860:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cb000817800 from 1 10000000:01000000:1.0:1787560464.251863:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787560464.251886:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff800/0x4642c20bf2f339fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560464.251894:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff800/0x4642c20bf2f339fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560464.251903:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff800/0x4642c20bf2f339fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560464.251926:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc87ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862703872:0@lo:101: 00000100:00100000:1.0:1787560464.251953:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560464.251980:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafeec68540 going to sleep for 11 seconds 00000100:00100000:3.0:1787560464.252021:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862703872 00000100:00100000:3.0:1787560464.252025:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862703872 00000100:00100000:3.0:1787560464.252053:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787560464.252061:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5800450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:6497:x1874392862703872:12345-0@lo:101: 00010000:00010000:3.0:1787560464.252069:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560464.252080:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f33a03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f339fc expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560464.252112:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f33a03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f339fc expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560464.252122:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f33a03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f339fc expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560464.252131:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f6800, rc 0) 00000100:00100000:3.0:1787560464.252181:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5800450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:6497:x1874392862703872:12345-0@lo:101: Request processed in 121us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560464.252187:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787560464.252246:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc87ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862703872:0@lo:101: 00010000:00010000:1.0:1787560464.252257:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff800/0x4642c20bf2f339fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33a03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560464.252265:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff800/0x4642c20bf2f339fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33a03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560464.252306:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc87ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862704000:0@lo:501: 00000100:00100000:1.0:1787560464.252330:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560464.252353:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafeec68540 going to sleep for 11 seconds 00000100:00100000:2.0:1787560464.252535:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862704000 00000100:00100000:2.0:1787560464.252540:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862704000 00000100:00100000:2.0:1787560464.252572:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787560464.252579:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5800050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:6497:x1874392862704000:12345-0@lo:501: 00000100:00100000:2.0:1787560464.252676:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5800050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:6497:x1874392862704000:12345-0@lo:501: Request processed in 96us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560464.252682:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787560464.253056:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc87ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862704000:0@lo:501: 00000100:00100000:1.0:1787560464.253085:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc87ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862704128:0@lo:503: 00000100:00100000:1.0:1787560464.253121:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560464.253159:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafeec68540 going to sleep for 11 seconds 00000100:00100000:3.0:1787560464.253512:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862704128 00000100:00100000:3.0:1787560464.253518:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862704128 00000100:00100000:3.0:1787560464.253550:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787560464.253558:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5802c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:6497:x1874392862704128:12345-0@lo:503: 00000100:00100000:3.0:1787560464.253644:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5802c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:6497:x1874392862704128:12345-0@lo:503: Request processed in 86us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560464.253651:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787560464.253718:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc87ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862704128:0@lo:503: 00000100:00100000:3.0:1787560464.254758:0:8042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeaba9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8042:1874392862704256:0@lo:502: 00000100:00100000:3.0:1787560464.254805:0:8042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560464.254878:0:8042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc59553c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560464.262518:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862704256 00000100:00100000:2.0:1787560464.262530:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862704256 00000100:00100000:2.0:1787560464.262585:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787560464.262595:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:8042:x1874392862704256:12345-0@lo:502: 00000100:00100000:2.0:1787560464.262758:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:8042:x1874392862704256:12345-0@lo:502: Request processed in 164us (7952us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560464.262765:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787560464.262836:0:8042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeaba9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8042:1874392862704256:0@lo:502: 00000020:01000000:2.0:1787560464.262869:0:8042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787560464.262877:0:8042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560464.262880:0:8042:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787560464.262887:0:8042:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cb000817800 00000020:00000080:2.0:1787560464.262889:0:8042:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787560464.262923:0:8042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8042:1874392862704384:0@lo:502: 00000100:00100000:2.0:1787560464.262965:0:8042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560464.262991:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862704384 00000100:00100000:2.0:1787560464.262995:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862704384 00000100:00100000:2.0:1787560464.263019:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787560464.263025:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:8042:x1874392862704384:12345-0@lo:502: 00000100:00100000:2.0:1787560464.263082:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:8042:x1874392862704384:12345-0@lo:502: Request processed in 56us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560464.263089:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787560464.263127:0:8042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc890180 going to sleep for 11 seconds 00000100:00100000:2.0:1787560464.263150:0:8042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8042:1874392862704384:0@lo:502: 00000020:01000000:2.0:1787560464.263168:0:8042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560464.263175:0:8042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560464.263176:0:8042:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787560464.263179:0:8042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1787560464.266420:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787560464.266620:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787560464.266632:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff800/0x4642c20bf2f339fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33a03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560464.266644:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff800/0x4642c20bf2f339fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33a03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560464.376463:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560465.402220:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560466.420040:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560466.483782:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffb885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862704512:0@lo:41: 00000100:00100000:3.0:1787560466.483863:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560466.483956:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862704512 00000100:00100000:1.0:1787560466.483964:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862704512 00000100:00100000:1.0:1787560466.484012:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787560466.484021:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862704512:12345-0@lo:41: 00000004:00000024:1.0:1787560466.484052:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1787560466.486601:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862704512:12345-0@lo:41: Request processed in 2570us (2728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560466.486615:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787560466.486733:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffb885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862704512:0@lo:41: 00010000:00010000:1.0:1787560467.450416:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560467.511894:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787560467.511940:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeabab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862704640:0@lo:400: 00000100:00100000:3.0:1787560467.512013:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560467.512089:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeababb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862704768:0@lo:400: 00000100:00100000:3.0:1787560467.512128:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560467.512162:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862704768 00000100:00100000:3.0:1787560467.512170:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862704768 00000100:00100000:3.0:1787560467.512216:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787560467.512224:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeabaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862704768:12345-0@lo:400: 00000100:00100000:3.0:1787560467.512278:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeabaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862704768:12345-0@lo:400: Request processed in 54us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560467.512284:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1787560467.512322:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cafeababb80 x1874392862704768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560467.512336:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeababb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862704768:0@lo:400: 00000100:00100000:3.0:1787560467.512371:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787560467.512379:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeababb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862704896:0@lo:400: 00000100:00100000:3.0:1787560467.512406:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560467.512457:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862704896 00000100:00100000:3.0:1787560467.512461:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862704896 00000100:00100000:3.0:1787560467.512493:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787560467.512500:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeabab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862704896:12345-0@lo:400: 00000100:00100000:3.0:1787560467.512537:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeabab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862704896:12345-0@lo:400: Request processed in 37us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560467.512544:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787560467.512583:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeababb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862704896:0@lo:400: 00000100:00100000:3.0:1787560467.512612:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeababb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862705024:0@lo:400: 00000100:00100000:3.0:1787560467.512646:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560467.512674:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862705024 00000100:00100000:3.0:1787560467.512678:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862705024 00000100:00100000:3.0:1787560467.512698:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787560467.512704:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862705024:12345-0@lo:400: 00000100:00100000:3.0:1787560467.512738:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862705024:12345-0@lo:400: Request processed in 34us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560467.512743:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1787560467.512767:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cafeababb80 x1874392862705024/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560467.512776:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeababb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862705024:0@lo:400: 00000100:00100000:3.0:1787560467.512801:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787560467.512808:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeababb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862705152:0@lo:400: 00000100:00100000:3.0:1787560467.512830:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560467.512854:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862705152 00000100:00100000:3.0:1787560467.512858:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862705152 00000100:00100000:3.0:1787560467.512879:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787560467.512885:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862705152:12345-0@lo:400: 00000100:00100000:3.0:1787560467.512918:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862705152:12345-0@lo:400: Request processed in 33us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560467.512924:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787560467.512947:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeababb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862705152:0@lo:400: 00000100:00100000:2.0:1787560467.513192:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862704640 00000100:00100000:2.0:1787560467.513197:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862704640 00000100:00100000:2.0:1787560467.513227:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787560467.513234:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:3626:x1874392862704640:12345-0@lo:400: 00000100:00100000:2.0:1787560467.513270:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:3626:x1874392862704640:12345-0@lo:400: Request processed in 37us (1257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560467.513275:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787560467.513354:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787560467.513366:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862705280:0@lo:41: 00000100:00100000:1.0:1787560467.513394:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560467.513480:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862705280 00000100:00100000:2.0:1787560467.513484:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862705280 00000100:00100000:2.0:1787560467.513516:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787560467.513522:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc87ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862705280:12345-0@lo:41: 00000004:00000024:2.0:1787560467.513553:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1787560467.513590:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc87ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862705280:12345-0@lo:41: Request processed in 68us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560467.513596:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787560467.513627:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862705280:0@lo:41: 00000100:00100000:3.0:1787560467.513779:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeabab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862704640:0@lo:400: 00010000:00010000:3.0:1787560468.469955:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560469.494105:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560470.515633:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787560470.564749:0:8406:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787560470.564760:0:8406:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787560470.564761:0:8406:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787560470.564884:0:8406:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9cafeab05000 00000020:01000004:3.0:1787560470.564898:0:8406:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787560470.564911:0:8406:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787560470.564924:0:8406:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9caffb993370) 00000020:00000080:3.0:1787560470.564942:0:8406:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787560470.611064:0:8406:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1787560470.611128:0:8406:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:1.0:1787560470.632737:0:8406:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787560470.632941:0:8406:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1787560470.632953:0:8406:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787560470.632966:0:8406:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4642c20bf2f33a11 00000020:01000004:1.0:1787560470.632973:0:8406:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787560470.632993:0:8406:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.129@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787560470.632997:0:8406:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787560470.633003:0:8406:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1787560470.633008:0:8406:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1787560470.634097:0:8406:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9cafeabd4d28) 00000020:00000080:0.0:1787560470.636371:0:8406:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:0.0:1787560470.638157:0:8406:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787560470.638328:0:8406:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787560470.638334:0:8406:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787560470.670915:0:8406:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787560470.670930:0:8406:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787560470.673291:0:8406:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787560470.673304:0:8406:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787560470.676904:0:8406:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787560470.677190:0:8406:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787560470.677196:0:8406:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787560470.678312:0:8406:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787560470.678322:0:8406:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787560470.708541:0:8406:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787560470.708787:0:8406:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787560470.708799:0:8406:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787560470.710938:0:8406:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787560470.710952:0:8406:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787560470.712624:0:8406:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787560470.712637:0:8406:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787560470.723748:0:8406:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787560470.723920:0:8406:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787560470.723925:0:8406:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787560470.729317:0:8406:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787560470.729340:0:8406:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1787560470.814082:0:8406:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787560470.814282:0:8406:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1787560470.814289:0:8406:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787560470.818243:0:8406:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787560470.818257:0:8406:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787560470.818672:0:8406:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787560470.818709:0:8406:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1787560470.818715:0:8406:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.129@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787560470.842960:0:8406:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787560470.842999:0:8406:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.129@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1787560470.843003:0:8406:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787560470.843005:0:8406:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787560470.843007:0:8406:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787560470.843008:0:8406:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787560470.843010:0:8406:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787560470.843011:0:8406:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787560470.843013:0:8406:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787560470.843098:0:8406:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787560470.843100:0:8406:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787560470.843102:0:8406:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787560470.843103:0:8406:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787560470.843106:0:8406:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1787560470.843109:0:8406:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787560470.843110:0:8406:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787560470.843111:0:8406:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787560470.843112:0:8406:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787560470.843113:0:8406:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787560470.843115:0:8406:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787560470.843116:0:8406:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787560470.843117:0:8406:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787560470.843118:0:8406:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787560470.843119:0:8406:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787560470.843120:0:8406:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787560470.843154:0:8406:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787560470.843172:0:8406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeabab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862705408:0@lo:253: 00000100:00100000:3.0:1787560470.843245:0:8406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560470.843359:0:8406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd86bccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560470.843528:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862705408 00000100:00100000:2.0:1787560470.843537:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862705408 00000100:00100000:2.0:1787560470.843596:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787560470.843606:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:8406:x1874392862705408:12345-0@lo:253: 20000000:01000000:2.0:1787560470.843644:0:6493:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787560470.843649:0:6493:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1787560470.843654:0:6493:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1787560470.843657:0:6493:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1787560470.843871:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787560470.844011:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1787560470.844038:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1787560470.844056:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1787560470.844063:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1787560470.844076:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1787560470.844106:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1787560470.844187:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1787560470.844201:0:6493:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.129@tcp 20000000:01000000:2.0:1787560470.844213:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.129@tcp (null) (null) (null) 00000040:00080000:2.0:1787560470.844230:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1787560470.844237:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787560470.844252:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1787560470.844258:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.129@tcp (null) (null) 00000040:00080000:2.0:1787560470.844270:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1787560470.844275:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787560470.844285:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1787560470.844299:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1787560470.844366:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:2.0:1787560470.844376:0:6493:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.129@tcp 20000000:01000000:2.0:1787560470.844377:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.129@tcp (null) (null) (null) 00000040:00080000:2.0:1787560470.844392:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:2.0:1787560470.844398:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787560470.844411:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:2.0:1787560470.844417:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.129@tcp (null) (null) 00000040:00080000:2.0:1787560470.844469:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:2.0:1787560470.844477:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787560470.844492:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:2.0:1787560470.844508:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:2.0:1787560470.844884:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:2.0:1787560470.844896:0:6493:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.129@tcp 20000000:01000000:2.0:1787560470.844897:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.129@tcp (null) (null) (null) 00000040:00080000:2.0:1787560470.844911:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:2.0:1787560470.844917:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787560470.844928:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:2.0:1787560470.844932:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.129@tcp (null) (null) 00000040:00080000:2.0:1787560470.844945:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:2.0:1787560470.844950:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787560470.844963:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:2.0:1787560470.844987:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:2.0:1787560470.845000:0:6493:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787560470.845002:0:6493:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787560470.845006:0:6493:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787560470.845046:0:6493:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1787560470.845049:0:6493:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787560470.847217:0:8425:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:2.0:1787560470.847269:0:8425:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:2.0:1787560470.847288:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:3.0:1787560470.847544:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:3.0:1787560470.847599:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:3.0:1787560470.847618:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:3.0:1787560470.847645:0:6493:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787560470.847648:0:6493:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787560470.853727:0:8426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1787560470.854221:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1787560470.854249:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1787560470.854262:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1787560470.854275:0:6493:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787560470.854277:0:6493:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787560470.855467:0:8427:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1787560470.855512:0:8427:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1787560470.855528:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1787560470.855719:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1787560470.855738:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1787560470.855750:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1787560470.855759:0:6493:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787560470.855761:0:6493:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787560470.856615:0:8428:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:1.0:1787560470.856653:0:8428:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:1.0:1787560470.856667:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1787560470.856982:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1787560470.857029:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1787560470.857046:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 10000000:01000000:2.0:1787560470.857061:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787560470.857079:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33a1f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560470.857106:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cafda2f6600/0x4642c20bf2f338eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f338e4 expref: 18 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560470.857114:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cb0021fe600/0x4642c20bf2f33962 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f3395b expref: 18 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560470.857120:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cafc0030400/0x4642c20bf2f3399a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33993 expref: 18 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560470.857133:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cb002176600/0x4642c20bf2f339b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f339af expref: 18 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560470.857140:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cafc0030800/0x4642c20bf2f339e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f339d9 expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560470.857148:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33a1f lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560470.857184:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cafc0030800/0x4642c20bf2f339e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f339d9 expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560470.857199:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cafc0030800/0x4642c20bf2f339e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f339d9 expref: 18 pid: 6492 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560470.857213:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1874392862705536:0@lo:104: 00000100:00100000:2.0:1787560470.857277:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787560470.857326:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cb002176600/0x4642c20bf2f339b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f339af expref: 18 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560470.857334:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cb002176600/0x4642c20bf2f339b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f339af expref: 18 pid: 6494 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560470.857342:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab12a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1874392862705664:0@lo:104: 00000100:00100000:2.0:1787560470.857361:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787560470.857391:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cafc0030400/0x4642c20bf2f3399a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f33993 expref: 18 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560470.857400:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cafc0030400/0x4642c20bf2f3399a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f33993 expref: 18 pid: 6493 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560470.857415:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab11f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1874392862705792:0@lo:104: 00000100:00100000:2.0:1787560470.857466:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787560470.857483:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cb0021fe600/0x4642c20bf2f33962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f3395b expref: 18 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560470.857491:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cb0021fe600/0x4642c20bf2f33962 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f3395b expref: 18 pid: 6494 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560470.857500:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab11880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1874392862705920:0@lo:104: 00000100:00100000:2.0:1787560470.857519:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787560470.857535:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cafda2f6600/0x4642c20bf2f338eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f338e4 expref: 18 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560470.857542:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cafda2f6600/0x4642c20bf2f338eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f338e4 expref: 18 pid: 6494 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560470.857550:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1874392862706048:0@lo:104: 00000100:00100000:2.0:1787560470.857567:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560470.857576:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcac7900 going to sleep for 11 seconds 00000100:00100000:0.0:1787560470.857766:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862705536 00000100:00100000:0.0:1787560470.857773:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862705536 00000100:00100000:0.0:1787560470.857814:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862705664 00000100:00100000:0.0:1787560470.857818:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862705664 00000100:00100000:0.0:1787560470.857827:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862705792 00000100:00100000:0.0:1787560470.857829:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862705792 00000100:00100000:0.0:1787560470.857836:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862705920 00000100:00100000:0.0:1787560470.857838:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862705920 00000100:00100000:0.0:1787560470.857845:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862706048 00000100:00100000:0.0:1787560470.857852:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862706048 00000100:00100000:0.0:1787560470.857863:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787560470.857871:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+7:6493:x1874392862705536:12345-0@lo:104: 00010000:00010000:0.0:1787560470.857882:0:6482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f339d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f339e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.857951:0:6482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787560470.857958:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+7:6493:x1874392862705536:12345-0@lo:104: Request processed in 88us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560470.857965:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787560470.857984:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787560470.857990:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+6:6493:x1874392862705664:12345-0@lo:104: 00010000:00010000:0.0:1787560470.857997:0:6482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cb002176200/0x4642c20bf2f339af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f339b6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.858043:0:6482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787560470.858048:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+6:6493:x1874392862705664:12345-0@lo:104: Request processed in 60us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560470.858064:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787560470.858077:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787560470.858083:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+5:6493:x1874392862705792:12345-0@lo:104: 00010000:00010000:0.0:1787560470.858104:0:6482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cb002177a00/0x4642c20bf2f33993 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f3399a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.858135:0:6482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787560470.858140:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+5:6493:x1874392862705792:12345-0@lo:104: Request processed in 58us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560470.858145:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787560470.858156:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787560470.858161:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+4:6493:x1874392862705920:12345-0@lo:104: 00010000:00010000:0.0:1787560470.858168:0:6482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cafc0030200/0x4642c20bf2f3395b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33962 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.858192:0:6482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787560470.858196:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+4:6493:x1874392862705920:12345-0@lo:104: Request processed in 36us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560470.858201:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787560470.858213:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787560470.858218:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:6493:x1874392862706048:12345-0@lo:104: 00010000:00010000:0.0:1787560470.858224:0:6482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7000/0x4642c20bf2f338e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f338eb expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.858247:0:6482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1787560470.858251:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:6493:x1874392862706048:12345-0@lo:104: Request processed in 34us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560470.858261:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1787560470.858278:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787560470.858298:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f339d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f339e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.858306:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021fe000 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:0.0:1787560470.858310:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f339d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f339e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.858318:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f339d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f339e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787560470.858325:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f339d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f339e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560470.858331:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787560470.858358:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f339d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f339e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.858365:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787560470.858383:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f339d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f339e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.858389:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f339d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f339e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.858402:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787560470.858405:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cb002176200/0x4642c20bf2f339af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f339b6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.858421:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb002176200 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:0.0:1787560470.858424:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cb002176200/0x4642c20bf2f339af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f339b6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.858458:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cb002176200/0x4642c20bf2f339af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f339b6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787560470.858465:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cb002176200/0x4642c20bf2f339af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f339b6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560470.858470:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787560470.858483:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cb002176200/0x4642c20bf2f339af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f339b6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.858489:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787560470.858494:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cb002176200/0x4642c20bf2f339af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f339b6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.858500:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cb002176200/0x4642c20bf2f339af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f339b6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.858511:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787560470.858514:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cb002177a00/0x4642c20bf2f33993 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f3399a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.858520:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb002177a00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:0.0:1787560470.858523:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cb002177a00/0x4642c20bf2f33993 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f3399a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.858538:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cb002177a00/0x4642c20bf2f33993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f3399a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787560470.858545:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cb002177a00/0x4642c20bf2f33993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f3399a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560470.858549:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787560470.858561:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cb002177a00/0x4642c20bf2f33993 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f3399a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.858567:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787560470.858580:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cb002177a00/0x4642c20bf2f33993 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f3399a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.858587:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cb002177a00/0x4642c20bf2f33993 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f3399a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.858597:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787560470.858600:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cafc0030200/0x4642c20bf2f3395b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33962 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.858606:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafc0030200 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:0.0:1787560470.858608:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cafc0030200/0x4642c20bf2f3395b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33962 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.858615:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cafc0030200/0x4642c20bf2f3395b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33962 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787560470.858621:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cafc0030200/0x4642c20bf2f3395b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33962 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560470.858643:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787560470.858656:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cafc0030200/0x4642c20bf2f3395b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33962 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.858662:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787560470.858667:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cafc0030200/0x4642c20bf2f3395b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33962 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.858673:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cafc0030200/0x4642c20bf2f3395b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33962 expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.858681:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560470.858684:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7000/0x4642c20bf2f338e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f338eb expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.858690:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7000 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:0.0:1787560470.858693:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7000/0x4642c20bf2f338e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f338eb expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.858699:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7000/0x4642c20bf2f338e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f338eb expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787560470.858704:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7000/0x4642c20bf2f338e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f338eb expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560470.858709:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787560470.858717:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7000/0x4642c20bf2f338e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f338eb expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.858723:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787560470.858731:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7000/0x4642c20bf2f338e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f338eb expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.858738:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7000/0x4642c20bf2f338e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f338eb expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.858750:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560470.858752:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560470.858754:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560470.858768:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffb884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862706176:0@lo:103: 00000100:00100000:0.0:1787560470.859412:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560470.859496:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffb885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862706688:0@lo:103: 00000100:00100000:0.0:1787560470.859525:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560470.859545:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560470.859551:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffb884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862706304:0@lo:103: 00000100:00100000:0.0:1787560470.859567:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560470.859594:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffb885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862706432:0@lo:103: 00000100:00100000:0.0:1787560470.859613:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560470.859623:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787560470.859628:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffb887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862706560:0@lo:103: 00000100:00100000:0.0:1787560470.859648:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560470.859672:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862706176 00000100:00100000:0.0:1787560470.859678:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862706176 00010000:00010000:0.0:1787560470.859705:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cafc0030800/0x4642c20bf2f339e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f339d9 expref: 19 pid: 6492 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560470.859723:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862706688 00000100:00100000:0.0:1787560470.859725:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862706688 00010000:00010000:0.0:1787560470.859734:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cafda2f6600/0x4642c20bf2f338eb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f338e4 expref: 20 pid: 6494 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560470.859751:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862706304 00000100:00100000:0.0:1787560470.859754:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862706304 00010000:00010000:0.0:1787560470.859765:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cb002176600/0x4642c20bf2f339b6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f339af expref: 21 pid: 6494 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560470.859774:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862706432 00000100:00100000:0.0:1787560470.859776:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862706432 00010000:00010000:0.0:1787560470.859785:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cafc0030400/0x4642c20bf2f3399a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33993 expref: 22 pid: 6493 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560470.859793:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862706560 00000100:00100000:0.0:1787560470.859795:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862706560 00010000:00010000:0.0:1787560470.859813:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cb0021fe600/0x4642c20bf2f33962 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f3395b expref: 23 pid: 6494 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560470.859828:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787560470.859835:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:3623:x1874392862706176:12345-0@lo:103: 00010000:00010000:0.0:1787560470.859853:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560470.859858:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cafc0030800/0x4642c20bf2f339e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f339d9 expref: 23 pid: 6492 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.859869:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cafc0030800/0x4642c20bf2f339e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f339d9 expref: 23 pid: 6492 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.859884:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560470.859915:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:3623:x1874392862706176:12345-0@lo:103: Request processed in 80us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560470.859921:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787560470.859938:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787560470.859950:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:3623:x1874392862706688:12345-0@lo:103: 00010000:00010000:0.0:1787560470.859957:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560470.859961:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cafda2f6600/0x4642c20bf2f338eb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f338e4 expref: 22 pid: 6494 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.859969:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cafda2f6600/0x4642c20bf2f338eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f338e4 expref: 22 pid: 6494 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.859978:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560470.859997:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:3623:x1874392862706688:12345-0@lo:103: Request processed in 49us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560470.860002:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787560470.860013:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787560470.860018:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:3623:x1874392862706304:12345-0@lo:103: 00010000:00010000:0.0:1787560470.860042:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560470.860047:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cb002176600/0x4642c20bf2f339b6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f339af expref: 21 pid: 6494 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.860055:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cb002176600/0x4642c20bf2f339b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f339af expref: 21 pid: 6494 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.860064:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560470.860081:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:3623:x1874392862706304:12345-0@lo:103: Request processed in 63us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560470.860099:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787560470.860111:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787560470.860117:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:3625:x1874392862706432:12345-0@lo:103: 00010000:00010000:0.0:1787560470.860123:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560470.860133:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cafc0030400/0x4642c20bf2f3399a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33993 expref: 20 pid: 6493 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.860141:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cafc0030400/0x4642c20bf2f3399a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f33993 expref: 20 pid: 6493 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.860150:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560470.860175:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:3625:x1874392862706432:12345-0@lo:103: Request processed in 59us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560470.860182:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787560470.860192:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787560470.860197:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd7cb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+19:3625:x1874392862706560:12345-0@lo:103: 00010000:00010000:0.0:1787560470.860204:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560470.860208:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cb0021fe600/0x4642c20bf2f33962 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f3395b expref: 19 pid: 6494 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.860217:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cb0021fe600/0x4642c20bf2f33962 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f3395b expref: 19 pid: 6494 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.860228:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33a1f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.860236:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33a1f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.860249:0:6486:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33a1f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.860256:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33a1f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.860262:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33a1f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.860274:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33a1f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.860280:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca48400 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560470.860284:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33a1f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.860292:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33a1f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.860300:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33a1f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.860310:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560470.860331:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd7cb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+19:3625:x1874392862706560:12345-0@lo:103: Request processed in 133us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560470.860337:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787560470.860410:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffb887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862706560:0@lo:103: 00000100:00100000:0.0:1787560470.860420:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffb885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862706432:0@lo:103: 00000100:00100000:0.0:1787560470.860465:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffb884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862706304:0@lo:103: 00000100:00100000:0.0:1787560470.860472:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffb884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862706176:0@lo:103: 00000100:00100000:0.0:1787560470.860478:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffb885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862706688:0@lo:103: 00010000:00010000:2.0:1787560470.861162:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafc0030800/0x4642c20bf2f339e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f339d9 expref: 18 pid: 6492 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560470.861174:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1874392862705536:0@lo:104: 00010000:00010000:2.0:1787560470.861183:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cb002176600/0x4642c20bf2f339b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f339af expref: 17 pid: 6494 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560470.861193:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab12a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1874392862705664:0@lo:104: 00010000:00010000:2.0:1787560470.861202:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafc0030400/0x4642c20bf2f3399a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f33993 expref: 16 pid: 6493 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560470.861221:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab11f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1874392862705792:0@lo:104: 00010000:00010000:2.0:1787560470.861233:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cb0021fe600/0x4642c20bf2f33962 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f3395b expref: 15 pid: 6494 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560470.861241:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab11880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1874392862705920:0@lo:104: 00010000:00010000:2.0:1787560470.861250:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafda2f6600/0x4642c20bf2f338eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f338e4 expref: 14 pid: 6494 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560470.861257:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1874392862706048:0@lo:104: 00010000:00010000:2.0:1787560470.861275:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33a1f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560470.861284:0:6493:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33a1f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560470.861290:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33a1f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560470.861297:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33a1f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787560470.861310:0:6493:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:1.0:1787560470.861610:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560470.865169:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+13:8406:x1874392862705408:12345-0@lo:253: Request processed in 21557us (21916us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560470.865184:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787560470.865263:0:8406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeabab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862705408:0@lo:253: 10000000:01000000:3.0:1787560470.865276:0:8406:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787560470.865280:0:8406:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787560470.865281:0:8406:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787560470.865283:0:8406:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787560470.865284:0:8406:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1787560470.865285:0:8406:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787560470.865286:0:8406:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787560470.865288:0:8406:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787560470.865290:0:8406:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787560470.865291:0:8406:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787560470.865292:0:8406:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787560470.865312:0:8406:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cafeab05000 from lustre-OST0000 10000000:01000000:3.0:1787560470.865340:0:8406:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787560470.865343:0:8406:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787560470.865352:0:8406:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9cafe06b3370 local copy 10000000:01000000:3.0:1787560470.865356:0:8406:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787560470.865392:0:8406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7c00/0x4642c20bf2f33a26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560470.865403:0:8406:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7c00/0x4642c20bf2f33a26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560470.865412:0:8406:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7c00/0x4642c20bf2f33a26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560470.865773:0:8406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeabab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862706816:0@lo:101: 00000100:00100000:3.0:1787560470.865885:0:8406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560470.865964:0:8406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd86bc600 going to sleep for 11 seconds 00000100:00100000:2.0:1787560470.866002:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862706816 00000100:00100000:2.0:1787560470.866009:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862706816 00000100:00100000:2.0:1787560470.866412:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787560470.866462:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+13:8406:x1874392862706816:12345-0@lo:101: 00010000:00010000:2.0:1787560470.866476:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560470.866490:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca48a00/0x4642c20bf2f33a2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33a26 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560470.866514:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca48a00/0x4642c20bf2f33a2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33a26 expref: 14 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560470.866524:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca48a00/0x4642c20bf2f33a2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33a26 expref: 14 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560470.866534:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca48a00, rc 0) 00000100:00100000:2.0:1787560470.866574:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+14:8406:x1874392862706816:12345-0@lo:101: Request processed in 147us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560470.866580:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787560470.866671:0:8406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeabab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862706816:0@lo:101: 00010000:00010000:3.0:1787560470.866695:0:8406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7c00/0x4642c20bf2f33a26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x4642c20bf2f33a2d expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560470.866705:0:8406:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7c00/0x4642c20bf2f33a26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4642c20bf2f33a2d expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560470.866810:0:8406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeabab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862706944:0@lo:501: 00000100:00100000:3.0:1787560470.866838:0:8406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560470.867307:0:8406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd86bc600 going to sleep for 11 seconds 00000100:00100000:0.0:1787560470.867360:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862706944 00000100:00100000:0.0:1787560470.867366:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862706944 00000100:00100000:0.0:1787560470.867396:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787560470.867404:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+14:8406:x1874392862706944:12345-0@lo:501: 00000100:00100000:0.0:1787560470.867830:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+14:8406:x1874392862706944:12345-0@lo:501: Request processed in 424us (989us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787560470.867837:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787560470.867981:0:8406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeabab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862706944:0@lo:501: 10000000:01000000:3.0:1787560470.867996:0:8406:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787560470.868082:0:8406:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787560470.868098:0:8406:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7c00/0x4642c20bf2f33a26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4642c20bf2f33a2d expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560470.868107:0:8406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7c00/0x4642c20bf2f33a26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4642c20bf2f33a2d expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560470.868114:0:8406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7c00/0x4642c20bf2f33a26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4642c20bf2f33a2d expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560470.868169:0:8406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787560470.868197:0:8406:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cafeab05000 10000000:01000000:3.0:1787560470.868202:0:8406:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787560470.868207:0:8406:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787560470.868210:0:8406:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787560470.868214:0:8406:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787560470.868224:0:8406:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787560470.868244:0:8406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33a34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560470.868250:0:8406:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33a34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560470.868258:0:8406:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33a34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560470.868271:0:8406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeabab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862707072:0@lo:101: 00000100:00100000:3.0:1787560470.868301:0:8406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560470.868330:0:8406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd86bc000 going to sleep for 11 seconds 00000100:00100000:2.0:1787560470.868378:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862707072 00000100:00100000:2.0:1787560470.868383:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862707072 00000100:00100000:2.0:1787560470.868421:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787560470.868456:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+14:8406:x1874392862707072:12345-0@lo:101: 00010000:00010000:2.0:1787560470.868466:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560470.868477:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33a3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33a34 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560470.868493:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33a3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33a34 expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560470.868502:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33a3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33a34 expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560470.868510:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca48400, rc 0) 00000100:00100000:2.0:1787560470.868548:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:8406:x1874392862707072:12345-0@lo:101: Request processed in 120us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560470.868554:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787560470.868642:0:8406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeabab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862707072:0@lo:101: 00010000:00010000:3.0:1787560470.868652:0:8406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33a34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33a3b expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560470.868660:0:8406:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33a34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33a3b expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560470.868906:0:8406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeabab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862707200:0@lo:501: 00000100:00100000:3.0:1787560470.868932:0:8406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560470.868960:0:8406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd86bc000 going to sleep for 11 seconds 00000100:00100000:2.0:1787560470.869000:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862707200 00000100:00100000:2.0:1787560470.869005:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862707200 00000100:00100000:2.0:1787560470.869039:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787560470.869046:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:8406:x1874392862707200:12345-0@lo:501: 00000100:00100000:2.0:1787560470.869140:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:8406:x1874392862707200:12345-0@lo:501: Request processed in 93us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560470.869146:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787560470.869175:0:8406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeabab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862707200:0@lo:501: 00000100:00100000:2.0:1787560470.869199:0:8406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862707328:0@lo:503: 00000100:00100000:2.0:1787560470.869236:0:8406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560470.869249:0:8406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcac73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560470.869261:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862707328 00000100:00100000:2.0:1787560470.869265:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862707328 00000100:00100000:2.0:1787560470.869281:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787560470.869286:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:8406:x1874392862707328:12345-0@lo:503: 00000100:00100000:2.0:1787560470.869352:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:8406:x1874392862707328:12345-0@lo:503: Request processed in 65us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560470.869359:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787560470.869396:0:8406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862707328:0@lo:503: 00000040:00080000:2.0:1787560470.869656:0:8406:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787560470.870025:0:8406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862707456:0@lo:502: 00000100:00100000:2.0:1787560470.870066:0:8406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560470.870172:0:8406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcac73c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787560470.870289:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560470.870297:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7c00/0x4642c20bf2f33a26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4642c20bf2f33a2d expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.870305:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7c00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:0.0:1787560470.870309:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7c00/0x4642c20bf2f33a26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4642c20bf2f33a2d expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.870318:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7c00/0x4642c20bf2f33a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x4642c20bf2f33a2d expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787560470.870325:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7c00/0x4642c20bf2f33a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x4642c20bf2f33a2d expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560470.870331:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787560470.870352:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7c00/0x4642c20bf2f33a26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4642c20bf2f33a2d expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.870359:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787560470.870374:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7c00/0x4642c20bf2f33a26 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4642c20bf2f33a2d expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.870382:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7c00/0x4642c20bf2f33a26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4642c20bf2f33a2d expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.870394:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560470.870396:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560470.870403:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560470.870414:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1c2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862707584:0@lo:103: 00000100:00100000:0.0:1787560470.870464:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560470.870495:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862707584 00000100:00100000:0.0:1787560470.870500:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862707584 00000100:00100000:0.0:1787560470.870536:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787560470.870543:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:3624:x1874392862707584:12345-0@lo:103: 00010000:00010000:0.0:1787560470.870555:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560470.870569:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca48a00/0x4642c20bf2f33a2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4642c20bf2f33a26 expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.870580:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560470.870607:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+14:3624:x1874392862707584:12345-0@lo:103: Request processed in 65us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560470.870613:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787560470.870655:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1c2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862707584:0@lo:103: 00000100:00100000:3.0:1787560470.870947:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862707456 00000100:00100000:3.0:1787560470.870952:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862707456 00000100:00100000:3.0:1787560470.871023:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787560470.871031:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+14:8406:x1874392862707456:12345-0@lo:502: 00000100:00100000:3.0:1787560470.871145:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+14:8406:x1874392862707456:12345-0@lo:502: Request processed in 115us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560470.871160:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787560470.871299:0:8406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862707456:0@lo:502: 00000040:00080000:0.0:1787560470.871555:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787560470.871585:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787560470.871598:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787560470.871609:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787560470.871620:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787560470.871648:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787560470.871671:0:8406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1c2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862707712:0@lo:502: 00000100:00100000:0.0:1787560470.871721:0:8406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560470.871746:0:8406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec17c9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787560470.871981:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862707712 00000100:00100000:1.0:1787560470.871987:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862707712 00000100:00100000:1.0:1787560470.872022:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787560470.872032:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+14:8406:x1874392862707712:12345-0@lo:502: 00000100:00100000:1.0:1787560470.872128:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+14:8406:x1874392862707712:12345-0@lo:502: Request processed in 98us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560470.872135:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787560470.872258:0:8406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1c2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862707712:0@lo:502: 00000040:00080000:0.0:1787560470.872306:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787560470.872314:0:8406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1787560470.872954:0:8429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787560470.872961:0:8429:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1787560470.872967:0:8429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560470.872969:0:8429:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787560470.872975:0:8429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787560470.872989:0:8429:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9cafef9f99b8) 00000020:00000080:0.0:1787560470.873009:0:8429:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787560470.873082:0:8429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787560470.873169:0:8429:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cafeab05000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787560470.873177:0:8429:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787560470.873183:0:8429:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4642c20bf2f33a49 00010000:00010000:0.0:1787560470.880898:0:8429:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:0.0:1787560470.881299:0:8429:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1787560470.884985:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787560470.885340:0:8429:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1787560470.893219:0:8429:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1787560470.893403:0:8429:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1787560470.911836:0:8429:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1787560470.915286:0:8429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787560470.915298:0:8429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560470.915304:0:8429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560470.915307:0:8429:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787560470.915310:0:8429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560470.915313:0:8429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560470.915315:0:8429:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787560470.915317:0:8429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787560470.915319:0:8429:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787560470.915345:0:8429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560470.915358:0:8429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560470.915360:0:8429:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787560470.915369:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787560470.915630:0:8406:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1787560470.915658:0:8406:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787560470.915691:0:8406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33a34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33a3b expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560470.915714:0:8406:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33a34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33a3b expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560470.915722:0:8406:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cafeab05000 from 1 10000000:01000000:1.0:1787560470.915725:0:8406:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787560470.915758:0:8406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021fec00/0x4642c20bf2f33a50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560470.915765:0:8406:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cb0021fec00/0x4642c20bf2f33a50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560470.915776:0:8406:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cb0021fec00/0x4642c20bf2f33a50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560470.915808:0:8406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc87ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862707840:0@lo:101: 00000100:00100000:1.0:1787560470.915879:0:8406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560470.915932:0:8406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc4cc4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787560470.916216:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862707840 00000100:00100000:0.0:1787560470.916224:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862707840 00000100:00100000:0.0:1787560470.916271:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787560470.916280:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+14:8406:x1874392862707840:12345-0@lo:101: 00010000:00010000:0.0:1787560470.916291:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560470.916302:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafc0030200/0x4642c20bf2f33a57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33a50 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.916333:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafc0030200/0x4642c20bf2f33a57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33a50 expref: 15 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.916343:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafc0030200/0x4642c20bf2f33a57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33a50 expref: 15 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.916357:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafc0030200, rc 0) 00000100:00100000:0.0:1787560470.916400:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:8406:x1874392862707840:12345-0@lo:101: Request processed in 121us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560470.916406:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787560470.918953:0:8406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc87ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862707840:0@lo:101: 00010000:00010000:1.0:1787560470.918977:0:8406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cb0021fec00/0x4642c20bf2f33a50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33a57 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560470.918989:0:8406:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cb0021fec00/0x4642c20bf2f33a50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33a57 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560470.919102:0:8406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc87ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862707968:0@lo:501: 00000100:00100000:1.0:1787560470.919153:0:8406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560470.919190:0:8406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc4cc4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787560470.921110:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862707968 00000100:00100000:3.0:1787560470.921122:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862707968 00000100:00100000:3.0:1787560470.921173:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787560470.921182:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:8406:x1874392862707968:12345-0@lo:501: 00000100:00100000:3.0:1787560470.921336:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:8406:x1874392862707968:12345-0@lo:501: Request processed in 154us (2181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560470.921343:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787560470.921529:0:8406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc87ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862707968:0@lo:501: 00000100:00100000:1.0:1787560470.921571:0:8406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc87ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862708096:0@lo:503: 00000100:00100000:1.0:1787560470.921635:0:8406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560470.921666:0:8406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc4cc4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787560470.921682:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862708096 00000100:00100000:1.0:1787560470.921695:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862708096 00000100:00100000:1.0:1787560470.921722:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787560470.921729:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:8406:x1874392862708096:12345-0@lo:503: 00000100:00100000:1.0:1787560470.922021:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:8406:x1874392862708096:12345-0@lo:503: Request processed in 291us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560470.922028:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787560470.922117:0:8406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc87ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862708096:0@lo:503: 00000040:00080000:0.0:1787560470.922340:0:8406:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787560470.922418:0:8406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1c2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862708224:0@lo:502: 00000100:00100000:0.0:1787560470.922512:0:8406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560470.922532:0:8406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec17c93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560470.922986:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862708224 00000100:00100000:3.0:1787560470.922992:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862708224 00000100:00100000:3.0:1787560470.923025:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787560470.923032:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:8406:x1874392862708224:12345-0@lo:502: 00000100:00100000:3.0:1787560470.923132:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:8406:x1874392862708224:12345-0@lo:502: Request processed in 99us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560470.923138:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787560470.923854:0:8406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1c2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862708224:0@lo:502: 00000040:00080000:0.0:1787560470.924061:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787560470.924100:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787560470.924128:0:8406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1c2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862708352:0@lo:502: 00000100:00100000:0.0:1787560470.924180:0:8406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560470.924213:0:8406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec17c93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560470.924408:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862708352 00000100:00100000:3.0:1787560470.924414:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862708352 00000100:00100000:3.0:1787560470.924512:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787560470.924521:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:8406:x1874392862708352:12345-0@lo:502: 00000100:00100000:3.0:1787560470.924605:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:8406:x1874392862708352:12345-0@lo:502: Request processed in 85us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560470.924611:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787560470.924702:0:8406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1c2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862708352:0@lo:502: 00000040:00080000:0.0:1787560470.924739:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787560470.924747:0:8406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787560470.931310:0:8433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560470.931323:0:8433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560470.931326:0:8433:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787560470.931333:0:8433:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cafeab05000 00000020:00000080:0.0:1787560470.931336:0:8433:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787560470.931358:0:8433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560470.931363:0:8433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560470.931364:0:8433:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787560470.931367:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787560470.932100:0:8406:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787560470.932131:0:8406:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787560470.932158:0:8406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021fec00/0x4642c20bf2f33a50 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33a57 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560470.932172:0:8406:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cb0021fec00/0x4642c20bf2f33a50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33a57 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560470.932224:0:8406:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787560470.932227:0:8406:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cafeab05000 10000000:01000000:2.0:1787560470.932230:0:8406:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cafeab05000 10000000:01000000:2.0:1787560470.932234:0:8406:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787560470.932240:0:8406:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cafeab05000 from 1 10000000:01000000:2.0:1787560470.932243:0:8406:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787560470.932278:0:8406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49200/0x4642c20bf2f33a5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560470.932286:0:8406:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffca49200/0x4642c20bf2f33a5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560470.932297:0:8406:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffca49200/0x4642c20bf2f33a5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560470.932321:0:8406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab11880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862708480:0@lo:101: 00000100:00100000:2.0:1787560470.932396:0:8406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560470.933235:0:8406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcac7480 going to sleep for 11 seconds 00000100:00100000:1.0:1787560470.933311:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862708480 00000100:00100000:1.0:1787560470.933322:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862708480 00000100:00100000:1.0:1787560470.933374:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787560470.933385:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd8e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:8406:x1874392862708480:12345-0@lo:101: 00010000:00010000:1.0:1787560470.933399:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560470.933412:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cb0021fee00/0x4642c20bf2f33a65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33a5e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560470.933462:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cb0021fee00/0x4642c20bf2f33a65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33a5e expref: 16 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560470.933471:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cb0021fee00/0x4642c20bf2f33a65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33a5e expref: 16 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560470.933479:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb0021fee00, rc 0) 00000100:00100000:1.0:1787560470.933531:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd8e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:8406:x1874392862708480:12345-0@lo:101: Request processed in 148us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560470.933554:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787560470.933820:0:8406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab11880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862708480:0@lo:101: 00010000:00010000:2.0:1787560470.933835:0:8406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffca49200/0x4642c20bf2f33a5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33a65 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560470.933855:0:8406:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffca49200/0x4642c20bf2f33a5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33a65 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560470.933962:0:8406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab11880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862708608:0@lo:501: 00000100:00100000:2.0:1787560470.933994:0:8406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560470.934007:0:8406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcac7480 going to sleep for 11 seconds 00000100:00100000:1.0:1787560470.934198:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862708608 00000100:00100000:1.0:1787560470.934203:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862708608 00000100:00100000:1.0:1787560470.934225:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787560470.934232:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd86eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:8406:x1874392862708608:12345-0@lo:501: 00000100:00100000:1.0:1787560470.934491:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd86eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:8406:x1874392862708608:12345-0@lo:501: Request processed in 258us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560470.934498:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787560470.934875:0:8406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab11880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862708608:0@lo:501: 00000100:00100000:2.0:1787560470.934905:0:8406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab11880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862708736:0@lo:503: 00000100:00100000:2.0:1787560470.934946:0:8406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560470.935007:0:8406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcac7480 going to sleep for 11 seconds 00000100:00100000:2.0:1787560470.935022:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862708736 00000100:00100000:2.0:1787560470.935026:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862708736 00000100:00100000:0.0:1787560470.935068:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787560470.935079:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd86e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:8406:x1874392862708736:12345-0@lo:503: 00000100:00100000:0.0:1787560470.935185:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd86e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:8406:x1874392862708736:12345-0@lo:503: Request processed in 108us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560470.935191:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787560470.935254:0:8406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab11880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862708736:0@lo:503: 00000040:00080000:3.0:1787560470.935509:0:8406:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787560470.935566:0:8406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeababb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862708864:0@lo:502: 00000100:00100000:3.0:1787560470.935598:0:8406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560470.935979:0:8406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd86bc180 going to sleep for 11 seconds 00000100:00100000:1.0:1787560470.936014:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862708864 00000100:00100000:1.0:1787560470.936020:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862708864 00000100:00100000:1.0:1787560470.936044:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787560470.936050:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd86e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:8406:x1874392862708864:12345-0@lo:502: 00000100:00100000:1.0:1787560470.936149:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd86e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:8406:x1874392862708864:12345-0@lo:502: Request processed in 98us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560470.936156:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787560470.936236:0:8406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeababb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862708864:0@lo:502: 00000040:00080000:3.0:1787560470.936465:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787560470.936495:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787560470.936508:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787560470.936522:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787560470.936535:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787560470.936562:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787560470.936576:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787560470.936588:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787560470.936599:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787560470.936612:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787560470.936636:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787560470.936651:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787560470.936663:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787560470.936676:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787560470.936698:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787560470.936714:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787560470.936726:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787560470.936739:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787560470.936751:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787560470.936763:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787560470.936775:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787560470.936809:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787560470.936827:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787560470.936841:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787560470.936853:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1787560470.936864:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1787560470.936876:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1787560470.936888:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1787560470.936901:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1787560470.936913:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1787560470.936944:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1787560470.936958:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1787560470.936970:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1787560470.936982:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1787560470.936995:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1787560470.937007:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1787560470.937020:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:3.0:1787560470.937054:0:8406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeababb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862708992:0@lo:502: 00000100:00100000:3.0:1787560470.937109:0:8406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560470.937125:0:8406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd86bc180 going to sleep for 11 seconds 00000100:00100000:1.0:1787560470.937586:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862708992 00000100:00100000:1.0:1787560470.937592:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862708992 00000100:00100000:1.0:1787560470.937633:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787560470.937642:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:8406:x1874392862708992:12345-0@lo:502: 00000100:00100000:1.0:1787560470.937750:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:8406:x1874392862708992:12345-0@lo:502: Request processed in 108us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560470.937756:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787560470.937995:0:8406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeababb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862708992:0@lo:502: 00000040:00080000:3.0:1787560470.938050:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1787560470.938065:0:8406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1787560470.940183:0:8434:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787560470.940200:0:8434:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9caffb990000) 00000020:00000080:3.0:1787560470.940224:0:8434:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1787560470.940329:0:8434:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cafeab05000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787560470.940333:0:8434:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cafeab05000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787560470.940336:0:8434:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cafeab05000 3 00010000:00080000:3.0:1787560470.940556:0:8434:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9caec1ef1800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.129@tcp at head 00010000:00010000:2.0:1787560470.944011:0:8434:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1787560470.944257:0:8434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787560470.944312:0:8434:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787560470.944327:0:8434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4642c20bf2f33a73 00000100:00080000:2.0:1787560470.944338:0:8434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787560470.944344:0:8434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9caec1ef1800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560470.944399:0:8434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafeab11f80 x1874392862709120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787560470.944451:0:8434:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787560470.944551:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1874392862709120:0@lo:38: 00000100:00100000:3.0:1787560470.944635:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560470.944929:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862709120 00000100:00100000:2.0:1787560470.944937:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862709120 00000100:00100000:2.0:1787560470.944975:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787560470.944983:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeababb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1874392862709120:12345-0@lo:38: 00010000:00080000:2.0:1787560470.945006:0:6500:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:2.0:1787560470.945042:0:6500:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4642c20bf2f33a7a 00000004:00100000:2.0:1787560470.945056:0:6500:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787560470.945084:0:6500:0:(import.c:65:import_set_state_nolock()) ffff9caec1c35800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787560470.945150:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeababb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1874392862709120:12345-0@lo:38: Request processed in 166us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560470.945158:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787560470.946312:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cafeab11f80 x1874392862709120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787560480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560470.946324:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787560470.946334:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787560470.946343:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787560470.946349:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787560470.946353:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec1ef1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787560470.946359:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1874392862709120:0@lo:38: 00000100:00100000:2.0:1787560470.946940:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc87aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862709248:0@lo:400: 00000100:00100000:2.0:1787560470.947003:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560470.947117:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc87ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862709376:0@lo:400: 00000100:00100000:3.0:1787560470.947149:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560470.947244:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862709376 00000100:00100000:2.0:1787560470.947252:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862709376 00000100:00100000:1.0:1787560470.947352:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862709248 00000100:00100000:1.0:1787560470.947357:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862709248 00000100:00100000:1.0:1787560470.947389:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787560470.947397:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862709248:12345-0@lo:400: 00000100:00100000:1.0:1787560470.947484:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862709248:12345-0@lo:400: Request processed in 87us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560470.947491:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787560470.947561:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787560470.947569:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeabab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862709376:12345-0@lo:400: 00000100:00100000:2.0:1787560470.947616:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeabab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862709376:12345-0@lo:400: Request processed in 48us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560470.947631:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787560470.947979:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc87ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862709376:0@lo:400: 00000100:00100000:1.0:1787560470.948083:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862709504:0@lo:400: 00000100:00100000:1.0:1787560470.948125:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560470.948149:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787560470.948156:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862709632:0@lo:400: 00000100:00100000:1.0:1787560470.948180:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560470.955073:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862709504 00000100:00100000:1.0:1787560470.955085:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862709504 00000100:00100000:1.0:1787560470.955146:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787560470.955155:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862709504:12345-0@lo:400: 00000100:00100000:1.0:1787560470.955230:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862709504:12345-0@lo:400: Request processed in 77us (7105us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560470.955237:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787560470.955285:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9caec2006680 x1874392862709504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560470.955300:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862709504:0@lo:400: 00000100:00100000:3.0:1787560470.955448:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862709632 00000100:00100000:3.0:1787560470.955453:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862709632 00000100:00100000:3.0:1787560470.955483:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787560470.955489:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862709632:12345-0@lo:400: 00000100:00100000:3.0:1787560470.955541:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862709632:12345-0@lo:400: Request processed in 51us (7358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560470.955559:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787560470.955809:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862709632:0@lo:400: 00010000:00080000:2.0:1787560470.956061:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cafc87aea00 x1874392862709248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560470.956072:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc87aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862709248:0@lo:400: 00000020:01000004:2.0:1787560470.956200:0:8434:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787560470.956216:0:8434:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9caff3248000) 00000020:00000080:2.0:1787560470.956237:0:8434:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1787560470.956323:0:8434:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cafeab05000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787560470.956327:0:8434:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cafeab05000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787560470.956329:0:8434:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cafeab05000 3 00010000:00080000:2.0:1787560470.956569:0:8434:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9caec1c32800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.129@tcp at head 00010000:00010000:2.0:1787560470.960172:0:8434:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:2.0:1787560470.960527:0:8434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1787560470.960567:0:8434:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787560470.960582:0:8434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x4642c20bf2f33a88 00000100:00080000:2.0:1787560470.960592:0:8434:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787560470.960598:0:8434:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9caec1c32800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560470.960643:0:8434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafeab12a00 x1874392862709760/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787560470.960662:0:8434:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1787560470.960792:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3622:1874392862709760:0@lo:38: 00000100:00100000:3.0:1787560470.960866:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560470.967167:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862709760 00000100:00100000:3.0:1787560470.967181:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862709760 00000100:00100000:3.0:1787560470.967234:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787560470.967242:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeabaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1874392862709760:12345-0@lo:38: 00010000:00080000:3.0:1787560470.967274:0:6498:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:3.0:1787560470.967326:0:6498:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x4642c20bf2f33a8f 00000004:00100000:3.0:1787560470.967343:0:6498:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787560470.967378:0:6498:0:(import.c:65:import_set_state_nolock()) ffff9caec1ef7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787560470.967478:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeabaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1874392862709760:12345-0@lo:38: Request processed in 235us (6611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560470.967485:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787560470.967531:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cafeab12a00 x1874392862709760/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787560480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560470.967543:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787560470.967551:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787560470.967558:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787560470.967563:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787560470.967565:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec1c32800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787560470.967571:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3622:1874392862709760:0@lo:38: 00000040:00080000:2.0:1787560470.968267:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1787560470.968971:0:8406:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1787560470.968999:0:8406:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787560470.969016:0:8406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49200/0x4642c20bf2f33a5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33a65 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560470.969035:0:8406:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffca49200/0x4642c20bf2f33a5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33a65 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787560470.969083:0:8406:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787560470.969085:0:8406:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787560470.969097:0:8406:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787560470.969098:0:8406:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787560470.969099:0:8406:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787560470.969100:0:8406:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787560470.969102:0:8406:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787560470.969103:0:8406:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787560470.969105:0:8406:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787560470.969106:0:8406:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787560470.969107:0:8406:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787560470.969111:0:8406:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1787560470.969113:0:8406:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787560470.969115:0:8406:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787560470.969116:0:8406:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787560470.969117:0:8406:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787560470.969118:0:8406:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787560470.969119:0:8406:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787560470.969120:0:8406:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787560470.969121:0:8406:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787560470.969122:0:8406:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787560470.969123:0:8406:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787560470.969124:0:8406:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787560470.969146:0:8406:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787560470.969165:0:8406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeabaad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862709888:0@lo:253: 00000100:00100000:3.0:1787560470.969224:0:8406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560470.969261:0:8406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd86bccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560470.969356:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862709888 00000100:00100000:1.0:1787560470.969363:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862709888 00000100:00100000:1.0:1787560470.969412:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787560470.969420:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:8406:x1874392862709888:12345-0@lo:253: 20000000:01000000:1.0:1787560470.969467:0:6494:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787560470.969484:0:6494:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787560470.978134:0:6494:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787560470.978154:0:6494:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787560470.978284:0:6514:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787560470.978289:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787560470.978310:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cafc0030400/0x4642c20bf2f33a96 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.978331:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cafc0030a00/0x4642c20bf2f3398c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33985 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.978338:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cb002177c00/0x4642c20bf2f339a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f339a1 expref: 16 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.978360:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cafc0030400/0x4642c20bf2f33a96 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.978401:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cb002177c00/0x4642c20bf2f339a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f339a1 expref: 16 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.978413:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cb002177c00/0x4642c20bf2f339a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f339a1 expref: 16 pid: 6494 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560470.978936:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1c2aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6514:1874392862710016:0@lo:104: 00000100:00100000:0.0:1787560470.979871:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787560470.979934:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cafc0030a00/0x4642c20bf2f3398c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f33985 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.979946:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cafc0030a00/0x4642c20bf2f3398c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f33985 expref: 16 pid: 6492 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560470.979957:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1c29500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6514:1874392862710144:0@lo:104: 00000100:00100000:0.0:1787560470.979983:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec17c9240 going to sleep for 11 seconds 00000100:00100000:1.0:1787560470.980225:0:6482:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787560470.980245:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560470.980278:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862710016 00000100:00100000:1.0:1787560470.980285:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862710016 00000100:00100000:1.0:1787560470.980318:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862710144 00000100:00100000:1.0:1787560470.980320:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862710144 00000100:00100000:1.0:1787560470.980333:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787560470.980341:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcace850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+4:6514:x1874392862710016:12345-0@lo:104: 00010000:00010000:1.0:1787560470.980354:0:6482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cb002177400/0x4642c20bf2f339a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f339a8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560470.980415:0:6482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787560470.980422:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcace850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+4:6514:x1874392862710016:12345-0@lo:104: Request processed in 81us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560470.980450:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787560470.980486:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787560470.980493:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2006a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:6514:x1874392862710144:12345-0@lo:104: 00010000:00010000:1.0:1787560470.980502:0:6482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cafc0030600/0x4642c20bf2f33985 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f3398c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560470.980532:0:6482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787560470.980537:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2006a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:6514:x1874392862710144:12345-0@lo:104: Request processed in 45us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560470.980542:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1787560470.980559:0:6487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787560470.980564:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cb002177400/0x4642c20bf2f339a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f339a8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560470.980571:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb002177400 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:1.0:1787560470.980588:0:6487:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cb002177400/0x4642c20bf2f339a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f339a8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560470.980596:0:6487:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cb002177400/0x4642c20bf2f339a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f339a8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560470.980603:0:6487:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cb002177400/0x4642c20bf2f339a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f339a8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560470.980609:0:6487:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787560470.981097:0:6487:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cb002177400/0x4642c20bf2f339a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f339a8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560470.981105:0:6487:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560470.981130:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cb002177400/0x4642c20bf2f339a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f339a8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560470.981137:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cb002177400/0x4642c20bf2f339a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f339a8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560470.981152:0:6487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560470.981155:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cafc0030600/0x4642c20bf2f33985 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f3398c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560470.981160:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafc0030600 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:1.0:1787560470.981164:0:6487:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cafc0030600/0x4642c20bf2f33985 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f3398c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560470.981170:0:6487:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cafc0030600/0x4642c20bf2f33985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f3398c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560470.981187:0:6487:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cafc0030600/0x4642c20bf2f33985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f3398c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560470.981193:0:6487:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787560470.981207:0:6487:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cafc0030600/0x4642c20bf2f33985 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f3398c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560470.981213:0:6487:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560470.981219:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cafc0030600/0x4642c20bf2f33985 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f3398c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560470.981225:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cafc0030600/0x4642c20bf2f33985 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f3398c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560470.981238:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560470.981239:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560470.981241:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560470.981254:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2007b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862710400:0@lo:103: 00000100:00100000:1.0:1787560470.981285:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560470.981307:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787560470.981312:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862710272:0@lo:103: 00000100:00100000:1.0:1787560470.981329:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787560470.981823:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560470.981845:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862710400 00000100:00100000:0.0:1787560470.981852:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862710400 00010000:00010000:0.0:1787560470.981878:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cafc0030a00/0x4642c20bf2f3398c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33985 expref: 17 pid: 6492 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560470.981899:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862710272 00000100:00100000:0.0:1787560470.981902:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862710272 00010000:00010000:0.0:1787560470.981913:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cb002177c00/0x4642c20bf2f339a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f339a1 expref: 18 pid: 6494 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560470.981941:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787560470.981949:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2005c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:3626:x1874392862710400:12345-0@lo:103: 00010000:00010000:0.0:1787560470.981960:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560470.981965:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cafc0030a00/0x4642c20bf2f3398c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33985 expref: 18 pid: 6492 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.981975:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cafc0030a00/0x4642c20bf2f3398c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f33985 expref: 18 pid: 6492 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.981991:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560470.982033:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2005c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:3626:x1874392862710400:12345-0@lo:103: Request processed in 84us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560470.982040:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787560470.982055:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787560470.982061:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2005180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:3626:x1874392862710272:12345-0@lo:103: 00010000:00010000:0.0:1787560470.982069:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560470.982073:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cb002177c00/0x4642c20bf2f339a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f339a1 expref: 17 pid: 6494 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.982082:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cb002177c00/0x4642c20bf2f339a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f339a1 expref: 17 pid: 6494 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.982104:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cafc0030400/0x4642c20bf2f33a96 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.982112:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafc0030400/0x4642c20bf2f33a96 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787560470.982137:0:6484:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006100602s 00010000:00010000:0.0:1787560470.982142:0:6484:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cafc0030400/0x4642c20bf2f33a96 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.982149:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cafc0030400/0x4642c20bf2f33a96 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.982156:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cafc0030400/0x4642c20bf2f33a96 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.982163:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cafc0030400/0x4642c20bf2f33a96 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.982168:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafc0030400 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560470.982172:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cafc0030400/0x4642c20bf2f33a96 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.982178:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cafc0030400/0x4642c20bf2f33a96 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.982186:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cafc0030400/0x4642c20bf2f33a96 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.982195:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560470.982218:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2005180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:3626:x1874392862710272:12345-0@lo:103: Request processed in 158us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560470.982225:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787560470.982265:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862710272:0@lo:103: 00000100:00100000:0.0:1787560470.982274:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2007b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862710400:0@lo:103: 00010000:00010000:0.0:1787560470.982316:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cb002177c00/0x4642c20bf2f339a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f339a1 expref: 16 pid: 6494 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560470.982328:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1c2aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6514:1874392862710016:0@lo:104: 00010000:00010000:0.0:1787560470.982338:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafc0030a00/0x4642c20bf2f3398c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f33985 expref: 15 pid: 6492 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560470.982344:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1c29500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6514:1874392862710144:0@lo:104: 00010000:00010000:0.0:1787560470.982358:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cafc0030400/0x4642c20bf2f33a96 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.982366:0:6514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cafc0030400/0x4642c20bf2f33a96 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.982372:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cafc0030400/0x4642c20bf2f33a96 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560470.982378:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafc0030400/0x4642c20bf2f33a96 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560470.983927:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+14:8406:x1874392862709888:12345-0@lo:253: Request processed in 14498us (14693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560470.983944:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787560470.984149:0:8406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeabaad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8406:1874392862709888:0@lo:253: 10000000:01000000:2.0:1787560470.984163:0:8406:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787560470.984166:0:8406:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787560470.984168:0:8406:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787560470.984169:0:8406:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560470.984170:0:8406:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560470.984171:0:8406:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560470.984172:0:8406:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560470.984174:0:8406:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787560470.984175:0:8406:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787560470.984176:0:8406:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787560470.984178:0:8406:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560470.984192:0:8406:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787560470.984208:0:8406:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787560470.990922:0:8406:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1787560470.991129:0:8406:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1787560470.991300:0:8406:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1787560470.991474:0:8406:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1787560470.991669:0:8406:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1787560470.991905:0:8406:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1787560470.993362:0:8406:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787560471.005993:0:8406:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787560471.006003:0:8406:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787560471.006049:0:8406:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787560471.006094:0:8406:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.129@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787560471.006114:0:8406:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787560471.006134:0:8406:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1787560471.010904:0:8406:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787560471.011109:0:8406:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1787560471.541574:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560471.609544:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1c29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862710528:0@lo:41: 00000100:00100000:2.0:1787560471.609615:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560471.609849:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862710528 00000100:00100000:0.0:1787560471.609857:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862710528 00000100:00100000:0.0:1787560471.609906:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787560471.609917:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862710528:12345-0@lo:41: 00000004:00000024:0.0:1787560471.610041:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1787560471.610140:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862710528:12345-0@lo:41: Request processed in 225us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560471.610148:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787560471.610228:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1c29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862710528:0@lo:41: 00000020:00000004:0.0:1787560471.886143:0:8490:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787560471.886365:0:8490:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787560472.568789:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560472.631292:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeaba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862710656:0@lo:41: 00000100:00100000:3.0:1787560472.631370:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560472.631620:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862710656 00000100:00100000:0.0:1787560472.631630:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862710656 00000100:00100000:0.0:1787560472.631677:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787560472.631688:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862710656:12345-0@lo:41: 00000004:00000024:0.0:1787560472.631722:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1787560472.631777:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862710656:12345-0@lo:41: Request processed in 91us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560472.631785:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787560472.631835:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeaba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862710656:0@lo:41: 00010000:00010000:3.0:1787560473.590158:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787560473.846208:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787560473.846215:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9caffba72800 from 30 10000000:01000000:1.0:1787560473.846221:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787560473.846269:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff600/0x4642c20bf2f33a9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.846281:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff600/0x4642c20bf2f33a9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.846307:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff600/0x4642c20bf2f33a9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560473.846331:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2007100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862710784:0@lo:101: 00000100:00100000:1.0:1787560473.846401:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560473.846578:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbdab40 going to sleep for 11 seconds 00000100:00100000:0.0:1787560473.846706:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862710784 00000100:00100000:0.0:1787560473.846714:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862710784 00000100:00100000:0.0:1787560473.846767:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787560473.846776:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+14:6497:x1874392862710784:12345-0@lo:101: 00010000:00010000:0.0:1787560473.846789:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560473.846802:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33aa4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33a9d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560473.846822:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33aa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33a9d expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560473.846831:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33aa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33a9d expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560473.846838:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafc0030600, rc 0) 00000100:00100000:0.0:1787560473.846882:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:6497:x1874392862710784:12345-0@lo:101: Request processed in 108us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560473.846887:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787560473.847263:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2007100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862710784:0@lo:101: 00010000:00010000:1.0:1787560473.847279:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff600/0x4642c20bf2f33a9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33aa4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.847289:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff600/0x4642c20bf2f33a9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33aa4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560473.847349:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2007100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862710912:0@lo:501: 00000100:00100000:1.0:1787560473.847378:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560473.847530:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbdab40 going to sleep for 11 seconds 00000100:00100000:3.0:1787560473.852375:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862710912 00000100:00100000:3.0:1787560473.852391:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862710912 00000100:00100000:3.0:1787560473.852523:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787560473.852534:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:6497:x1874392862710912:12345-0@lo:501: 00000100:00100000:3.0:1787560473.852711:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:6497:x1874392862710912:12345-0@lo:501: Request processed in 178us (5330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560473.852718:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787560473.853256:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2007100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862710912:0@lo:501: 00000100:00100000:1.0:1787560473.853306:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2007100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862711040:0@lo:503: 00000100:00100000:1.0:1787560473.853364:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560473.853395:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbdab40 going to sleep for 11 seconds 00000100:00100000:1.0:1787560473.853685:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862711040 00000100:00100000:1.0:1787560473.853692:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862711040 00000100:00100000:1.0:1787560473.853734:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787560473.853743:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:6497:x1874392862711040:12345-0@lo:503: 00000100:00100000:1.0:1787560473.853832:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:6497:x1874392862711040:12345-0@lo:503: Request processed in 91us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560473.853847:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787560473.853886:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2007100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862711040:0@lo:503: 00000100:00100000:1.0:1787560473.854055:0:8599:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2007100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8599:1874392862711168:0@lo:502: 00000100:00100000:1.0:1787560473.854100:0:8599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560473.854119:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862711168 00000100:00100000:1.0:1787560473.854123:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862711168 00000100:00100000:1.0:1787560473.854145:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787560473.854152:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:8599:x1874392862711168:12345-0@lo:502: 00000100:00100000:1.0:1787560473.854216:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:8599:x1874392862711168:12345-0@lo:502: Request processed in 63us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560473.854222:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787560473.854255:0:8599:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbda3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560473.854267:0:8599:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2007100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8599:1874392862711168:0@lo:502: 00000100:00100000:1.0:1787560473.854304:0:8599:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2007100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8599:1874392862711296:0@lo:502: 00000100:00100000:1.0:1787560473.854334:0:8599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560473.854350:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862711296 00000100:00100000:1.0:1787560473.854354:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862711296 00000100:00100000:1.0:1787560473.854372:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787560473.854378:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:8599:x1874392862711296:12345-0@lo:502: 00000100:00100000:0.0:1787560473.855696:0:8599:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbda3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560473.855716:0:8599:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2007100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8599:1874392862711296:0@lo:502: 00000040:00080000:0.0:1787560473.855744:0:8599:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000100:00100000:1.0:1787560473.856089:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:8599:x1874392862711296:12345-0@lo:502: Request processed in 1709us (1753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560473.856099:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000020:01000000:1.0:1787560473.856351:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787560473.856372:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787560473.856382:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff600/0x4642c20bf2f33a9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33aa4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.856401:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff600/0x4642c20bf2f33a9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33aa4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560473.856420:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787560473.856423:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9caffba72800 from 5 10000000:01000000:1.0:1787560473.856426:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787560473.856484:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff000/0x4642c20bf2f33aab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.856492:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff000/0x4642c20bf2f33aab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.856500:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff000/0x4642c20bf2f33aab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560473.856515:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862711424:0@lo:101: 00000100:00100000:1.0:1787560473.856552:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560473.856574:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbda780 going to sleep for 11 seconds 00000100:00100000:1.0:1787560473.856587:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862711424 00000100:00100000:1.0:1787560473.856592:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862711424 00000100:00100000:1.0:1787560473.856625:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787560473.856633:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:6497:x1874392862711424:12345-0@lo:101: 00010000:00010000:1.0:1787560473.856643:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560473.856655:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cb0021ffa00/0x4642c20bf2f33ab2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33aab expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.856676:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cb0021ffa00/0x4642c20bf2f33ab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33aab expref: 16 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.856696:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cb0021ffa00/0x4642c20bf2f33ab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33aab expref: 16 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.856705:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb0021ffa00, rc 0) 00000100:00100000:1.0:1787560473.856736:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:6497:x1874392862711424:12345-0@lo:101: Request processed in 104us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560473.856742:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787560473.856771:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862711424:0@lo:101: 00010000:00010000:1.0:1787560473.856783:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff000/0x4642c20bf2f33aab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33ab2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.856791:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff000/0x4642c20bf2f33aab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33ab2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560473.856831:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862711552:0@lo:256: 00000100:00100000:1.0:1787560473.856860:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560473.856872:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbda780 going to sleep for 11 seconds 00000100:00100000:1.0:1787560473.856882:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862711552 00000100:00100000:1.0:1787560473.856885:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862711552 00000100:00100000:1.0:1787560473.856904:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787560473.856910:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:6497:x1874392862711552:12345-0@lo:256: 20000000:01000000:1.0:1787560473.856921:0:6492:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787560473.856935:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787560473.856938:0:6492:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1787560473.857007:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:6497:x1874392862711552:12345-0@lo:256: Request processed in 96us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560473.857013:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787560473.857048:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862711552:0@lo:256: 10000000:01000000:1.0:1787560473.857725:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787560473.857733:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff000/0x4642c20bf2f33aab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33ab2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.857742:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff000/0x4642c20bf2f33aab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33ab2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560473.857750:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1787560473.857752:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1787560473.857755:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787560473.857775:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f33ab9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.857782:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f33ab9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.857790:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f33ab9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560473.857802:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862711680:0@lo:101: 00000100:00100000:1.0:1787560473.857835:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560473.858219:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862711680 00000100:00100000:0.0:1787560473.858224:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862711680 00000100:00100000:1.0:1787560473.858226:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbda780 going to sleep for 11 seconds 00000100:00100000:0.0:1787560473.858259:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787560473.858266:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:6497:x1874392862711680:12345-0@lo:101: 00010000:00010000:0.0:1787560473.858276:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560473.858287:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafc0030400/0x4642c20bf2f33ac0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33ab9 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560473.858305:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafc0030400/0x4642c20bf2f33ac0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33ab9 expref: 17 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560473.858313:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafc0030400/0x4642c20bf2f33ac0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33ab9 expref: 17 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560473.858319:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafc0030400, rc 0) 00000100:00100000:0.0:1787560473.858408:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:6497:x1874392862711680:12345-0@lo:101: Request processed in 142us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560473.858414:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787560473.858575:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862711680:0@lo:101: 00010000:00010000:1.0:1787560473.858585:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f33ab9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33ac0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.858590:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f33ab9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33ac0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560473.858654:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862711808:0@lo:501: 00000100:00100000:1.0:1787560473.858681:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560473.858745:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbda780 going to sleep for 11 seconds 00000100:00100000:2.0:1787560473.858773:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862711808 00000100:00100000:2.0:1787560473.858777:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862711808 00000100:00100000:2.0:1787560473.858832:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787560473.858839:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:6497:x1874392862711808:12345-0@lo:501: 00000100:00100000:2.0:1787560473.858953:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:6497:x1874392862711808:12345-0@lo:501: Request processed in 114us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560473.858959:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787560473.858970:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862711808:0@lo:501: 00000100:00100000:1.0:1787560473.858994:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862711936:0@lo:503: 00000100:00100000:1.0:1787560473.859114:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560473.859138:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbda780 going to sleep for 11 seconds 00000100:00100000:0.0:1787560473.859175:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862711936 00000100:00100000:0.0:1787560473.859179:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862711936 00000100:00100000:0.0:1787560473.859233:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787560473.859241:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:6497:x1874392862711936:12345-0@lo:503: 00000100:00100000:0.0:1787560473.859326:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:6497:x1874392862711936:12345-0@lo:503: Request processed in 86us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560473.859418:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787560473.859577:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862711936:0@lo:503: 00000100:00100000:2.0:1787560473.860139:0:8600:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab13b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8600:1874392862712064:0@lo:502: 00000100:00100000:2.0:1787560473.860174:0:8600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560473.860201:0:8600:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd86bccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560473.860262:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862712064 00000100:00100000:1.0:1787560473.860267:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862712064 00000100:00100000:1.0:1787560473.860303:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787560473.860310:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:8600:x1874392862712064:12345-0@lo:502: 00000100:00100000:1.0:1787560473.860643:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:8600:x1874392862712064:12345-0@lo:502: Request processed in 332us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560473.860650:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787560473.860835:0:8600:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab13b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8600:1874392862712064:0@lo:502: 00000020:01000000:2.0:1787560473.860860:0:8600:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787560473.860868:0:8600:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787560473.860874:0:8600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560473.860877:0:8600:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787560473.860882:0:8600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787560473.860886:0:8600:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:01000000:2.0:1787560473.860908:0:8600:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787560473.860911:0:8600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787560473.860936:0:8600:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9caff490cd28) 00000020:00000080:2.0:1787560473.860963:0:8600:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1787560473.860970:0:8600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787560473.861134:0:8600:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1787560473.861140:0:8600:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787560473.861147:0:8600:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4642c20bf2f33ace 00010000:00080000:2.0:1787560473.861176:0:8600:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9caffdf75000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.129@tcp at head 00010000:00010000:2.0:1787560473.861567:0:8600:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1787560473.873527:0:8600:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787560473.873551:0:8600:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1787560473.873747:0:8600:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787560473.873958:0:8600:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787560473.874164:0:8600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1787560473.874249:0:8600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1787560473.875209:0:8601:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787560473.875214:0:8601:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787560473.876426:0:8600:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787560473.876454:0:8600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787560473.876494:0:8600:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787560473.876520:0:8600:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4642c20bf2f33ad5 00000100:00080000:1.0:1787560473.876531:0:8600:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787560473.876536:0:8600:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9caffdf75000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1787560473.876570:0:8600:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caec2004a80 x1874392862712192/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787560473.876687:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862712192:0@lo:8: 00000100:00100000:3.0:1787560473.876756:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787560473.877001:0:8600:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787560473.877077:0:8600:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560473.877082:0:8600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560473.877093:0:8600:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787560473.877097:0:8600:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560473.877102:0:8600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560473.877103:0:8600:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787560473.877106:0:8600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787560473.877108:0:8600:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787560473.877133:0:8600:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8600:1874392862712320:0@lo:502: 00000100:00100000:1.0:1787560473.877180:0:8600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560473.877206:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862712320 00000100:00100000:1.0:1787560473.877213:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862712320 00000100:00100000:1.0:1787560473.877251:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787560473.877259:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:8600:x1874392862712320:12345-0@lo:502: 00000100:00100000:1.0:1787560473.877354:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:8600:x1874392862712320:12345-0@lo:502: Request processed in 95us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560473.877362:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787560473.877401:0:8600:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbdacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560473.877419:0:8600:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8600:1874392862712320:0@lo:502: 00000020:01000000:1.0:1787560473.877457:0:8600:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560473.877461:0:8600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560473.877463:0:8600:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787560473.877466:0:8600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:1.0:1787560473.877508:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1787560473.877526:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787560473.877535:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f33ab9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33ac0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.877546:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f33ab9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33ac0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560473.877556:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787560473.877563:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cb000817800 from 30 10000000:01000000:1.0:1787560473.877566:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787560473.877587:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe600/0x4642c20bf2f33adc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.877595:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe600/0x4642c20bf2f33adc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.877610:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe600/0x4642c20bf2f33adc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560473.877622:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862712448:0@lo:101: 00000100:00100000:1.0:1787560473.877649:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560473.877662:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbdacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560473.877675:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862712448 00000100:00100000:1.0:1787560473.877678:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862712448 00000100:00100000:1.0:1787560473.877697:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787560473.877703:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:6497:x1874392862712448:12345-0@lo:101: 00010000:00010000:1.0:1787560473.877712:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560473.877724:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cb0021ffc00/0x4642c20bf2f33ae3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33adc expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.877745:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cb0021ffc00/0x4642c20bf2f33ae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33adc expref: 18 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.877755:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cb0021ffc00/0x4642c20bf2f33ae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33adc expref: 18 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.877764:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb0021ffc00, rc 0) 00000100:00100000:1.0:1787560473.877807:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:6497:x1874392862712448:12345-0@lo:101: Request processed in 103us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560473.877820:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787560473.877850:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862712448:0@lo:101: 00010000:00010000:1.0:1787560473.877862:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe600/0x4642c20bf2f33adc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33ae3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.877870:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe600/0x4642c20bf2f33adc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33ae3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560473.877908:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862712576:0@lo:501: 00000100:00100000:1.0:1787560473.877932:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560473.877945:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbdacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560473.877956:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862712576 00000100:00100000:1.0:1787560473.877959:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862712576 00000100:00100000:1.0:1787560473.877982:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787560473.877988:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:6497:x1874392862712576:12345-0@lo:501: 00000100:00100000:1.0:1787560473.878095:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:6497:x1874392862712576:12345-0@lo:501: Request processed in 107us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560473.878101:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787560473.878128:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862712576:0@lo:501: 00000100:00100000:1.0:1787560473.878151:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862712704:0@lo:503: 00000100:00100000:1.0:1787560473.878182:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560473.878195:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbdacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560473.878207:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862712704 00000100:00100000:1.0:1787560473.878210:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862712704 00000100:00100000:1.0:1787560473.878231:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787560473.878237:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc8c2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:6497:x1874392862712704:12345-0@lo:503: 00000100:00100000:1.0:1787560473.878303:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc8c2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:6497:x1874392862712704:12345-0@lo:503: Request processed in 66us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560473.878309:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787560473.878345:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862712704:0@lo:503: 00000100:00100000:1.0:1787560473.878596:0:8603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8603:1874392862712832:0@lo:502: 00000100:00100000:1.0:1787560473.878631:0:8603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560473.878649:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862712832 00000100:00100000:1.0:1787560473.878652:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862712832 00000100:00100000:1.0:1787560473.878671:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787560473.878676:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc8c2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:8603:x1874392862712832:12345-0@lo:502: 00000100:00100000:1.0:1787560473.878743:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc8c2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:8603:x1874392862712832:12345-0@lo:502: Request processed in 66us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560473.878749:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787560473.878777:0:8603:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbda840 going to sleep for 11 seconds 00000100:00100000:1.0:1787560473.878788:0:8603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8603:1874392862712832:0@lo:502: 00000100:00100000:1.0:1787560473.878821:0:8603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8603:1874392862712960:0@lo:502: 00000100:00100000:1.0:1787560473.878851:0:8603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560473.878869:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862712960 00000100:00100000:1.0:1787560473.878872:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862712960 00000100:00100000:1.0:1787560473.878891:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787560473.878896:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd840bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:8603:x1874392862712960:12345-0@lo:502: 00000100:00100000:1.0:1787560473.878949:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd840bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:8603:x1874392862712960:12345-0@lo:502: Request processed in 52us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560473.878955:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787560473.878970:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862712192 00000100:00100000:2.0:1787560473.878975:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862712192 00000100:00100000:1.0:1787560473.878981:0:8603:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbda840 going to sleep for 11 seconds 00000100:00100000:1.0:1787560473.878995:0:8603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8603:1874392862712960:0@lo:502: 00000040:00080000:1.0:1787560473.879012:0:8603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787560473.879046:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787560473.879059:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787560473.879065:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe600/0x4642c20bf2f33adc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33ae3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.879087:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe600/0x4642c20bf2f33adc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33ae3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560473.879096:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787560473.879098:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cb000817800 from 5 10000000:01000000:1.0:1787560473.879101:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787560473.879119:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe800/0x4642c20bf2f33aea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.879127:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe800/0x4642c20bf2f33aea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.879134:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe800/0x4642c20bf2f33aea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560473.879145:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862713088:0@lo:101: 00000100:00100000:2.0:1787560473.879169:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787560473.879169:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560473.879174:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3622:x1874392862712192:12345-0@lo:8: 00000100:00100000:1.0:1787560473.879180:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbda840 going to sleep for 11 seconds 00000100:00100000:1.0:1787560473.879190:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862713088 00000100:00100000:1.0:1787560473.879193:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862713088 00010000:00080000:2.0:1787560473.879196:0:8412:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 193 last 0 00000100:00100000:1.0:1787560473.879210:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787560473.879216:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd8409850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:6497:x1874392862713088:12345-0@lo:101: 00010000:00010000:1.0:1787560473.879222:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000020:00000080:2.0:1787560473.879223:0:8412:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4642c20bf2f33af1 00010000:00010000:1.0:1787560473.879238:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cb0021ffe00/0x4642c20bf2f33af8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33aea expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.879252:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cb0021ffe00/0x4642c20bf2f33af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33aea expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1787560473.879259:0:8412:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9caffdf74800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 0 ocd_group 1 00010000:00010000:1.0:1787560473.879260:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cb0021ffe00/0x4642c20bf2f33af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33aea expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1787560473.879263:0:8412:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:2.0:1787560473.879267:0:8412:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1787560473.879267:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb0021ffe00, rc 0) 00000100:00100000:1.0:1787560473.879292:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd8409850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+19:6497:x1874392862713088:12345-0@lo:101: Request processed in 77us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560473.879297:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00002000:00100000:2.0:1787560473.879319:0:8412:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1787560473.879323:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862713088:0@lo:101: 00010000:00010000:1.0:1787560473.879333:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe800/0x4642c20bf2f33aea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33af8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.879341:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe800/0x4642c20bf2f33aea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33af8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560473.879379:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862713216:0@lo:256: 00000100:00100000:1.0:1787560473.879406:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560473.879418:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbda840 going to sleep for 11 seconds 00000100:00100000:1.0:1787560473.879444:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862713216 00000100:00100000:1.0:1787560473.879447:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862713216 00000100:00100000:1.0:1787560473.879468:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787560473.879474:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd8408050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+19:6497:x1874392862713216:12345-0@lo:256: 20000000:01000000:1.0:1787560473.879485:0:6493:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787560473.879499:0:6493:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787560473.879506:0:6493:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1787560473.879568:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd8408050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+19:6497:x1874392862713216:12345-0@lo:256: Request processed in 93us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560473.879574:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787560473.879600:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862713216:0@lo:256: 10000000:01000000:1.0:1787560473.879631:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787560473.879637:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe800/0x4642c20bf2f33aea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33af8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.879644:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe800/0x4642c20bf2f33aea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33af8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560473.879650:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787560473.879652:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1787560473.879654:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787560473.879667:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff400/0x4642c20bf2f33aff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.879673:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff400/0x4642c20bf2f33aff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.879680:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff400/0x4642c20bf2f33aff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560473.879690:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862713344:0@lo:101: 00002000:00080000:2.0:1787560473.879707:0:8412:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00100000:1.0:1787560473.879711:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560473.879722:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbda840 going to sleep for 11 seconds 00000100:00080000:2.0:1787560473.879729:0:8412:0:(import.c:65:import_set_state_nolock()) ffff9caffdf76000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787560473.879731:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862713344 00000100:00100000:1.0:1787560473.879734:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862713344 00000100:00100000:1.0:1787560473.879752:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787560473.879762:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd087b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+19:6497:x1874392862713344:12345-0@lo:101: 00000100:00100000:0.0:1787560473.879896:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1c2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862713472:0@lo:400: 00000100:00100000:0.0:1787560473.879932:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560473.879948:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1c2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862713984:0@lo:400: 00000100:00100000:0.0:1787560473.879965:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560473.879980:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787560473.879984:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1c2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862713600:0@lo:400: 00000100:00100000:0.0:1787560473.880000:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560473.880014:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1c28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862714112:0@lo:400: 00000100:00100000:0.0:1787560473.880034:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560473.880058:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1c29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862713728:0@lo:400: 00000100:00100000:0.0:1787560473.880090:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560473.880102:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560473.880106:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1c29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862713856:0@lo:400: 00000100:00100000:0.0:1787560473.880124:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560473.880152:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862713472 00000100:00100000:0.0:1787560473.880156:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862713472 00000100:00100000:0.0:1787560473.880176:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862713984 00000100:00100000:0.0:1787560473.880178:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862713984 00000100:00100000:0.0:1787560473.880198:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862714112 00000100:00100000:0.0:1787560473.880201:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862714112 00000100:00100000:0.0:1787560473.880213:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862713728 00000100:00100000:0.0:1787560473.880215:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862713728 00000100:00100000:0.0:1787560473.880227:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787560473.880234:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862713472:12345-0@lo:400: 00000100:00100000:0.0:1787560473.880269:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862713472:12345-0@lo:400: Request processed in 36us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560473.880275:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787560473.880287:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787560473.880300:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862713984:12345-0@lo:400: 00000100:00100000:0.0:1787560473.880329:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862713984:12345-0@lo:400: Request processed in 30us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560473.880335:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787560473.880346:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787560473.880351:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862714112:12345-0@lo:400: 00000100:00100000:0.0:1787560473.880375:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862714112:12345-0@lo:400: Request processed in 24us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560473.880381:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787560473.880391:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787560473.880396:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862713728:12345-0@lo:400: 00000100:00100000:0.0:1787560473.880423:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862713728:12345-0@lo:400: Request processed in 27us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560473.880428:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787560473.880473:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862713600 00000100:00100000:0.0:1787560473.880477:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862713600 00000100:00100000:0.0:1787560473.880496:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862713856 00000100:00100000:0.0:1787560473.880499:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862713856 00000100:00100000:0.0:1787560473.880509:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787560473.880515:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862713600:12345-0@lo:400: 00000100:00100000:0.0:1787560473.880544:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862713600:12345-0@lo:400: Request processed in 28us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560473.880549:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787560473.880561:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787560473.880566:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862713856:12345-0@lo:400: 00000100:00100000:0.0:1787560473.880589:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862713856:12345-0@lo:400: Request processed in 23us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560473.880599:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787560473.880632:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1c2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862713600:0@lo:400: 00010000:00080000:0.0:1787560473.880643:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec1c28700 x1874392862714112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560473.880651:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1c28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862714112:0@lo:400: 00010000:00080000:0.0:1787560473.880659:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec1c2aa00 x1874392862713472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560473.880665:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1c2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862713472:0@lo:400: 00010000:00080000:0.0:1787560473.880673:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec1c2b100 x1874392862713984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560473.880679:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1c2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862713984:0@lo:400: 00000100:00100000:0.0:1787560473.880704:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1c29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862713856:0@lo:400: 00010000:00080000:0.0:1787560473.880712:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec1c29c00 x1874392862713728/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560473.880720:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1c29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862713728:0@lo:400: 00000100:00100000:2.0:1787560473.882918:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3622:x1874392862712192:12345-0@lo:8: Request processed in 3736us (6154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560473.882949:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787560473.882983:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787560473.882988:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787560473.883229:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec2004a80 x1874392862712192/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787560483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560473.883241:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787560473.883259:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1787560473.883267:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787560473.883272:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787560473.883276:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffdf75000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787560473.883298:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787560473.883305:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862712192:0@lo:8: 00000004:00080000:0.0:1787560473.883477:0:8601:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787560473.883553:0:8601:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 193223120231ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787560473.883560:0:8601:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787560473.885158:0:8602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeaba8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8602:1874392862714240:0@lo:700: 00000100:00100000:3.0:1787560473.885219:0:8602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560473.885258:0:8602:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc59570c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560473.885639:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862714240 00000100:00100000:0.0:1787560473.885647:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862714240 00000100:00100000:0.0:1787560473.885711:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787560473.885721:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8602:x1874392862714240:12345-0@lo:700: 00000100:00100000:0.0:1787560473.885756:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1c29c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8421:1874392862714368:0@lo:700: 00000100:00100000:0.0:1787560473.885797:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560473.885812:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffba5e600 going to sleep for 11 seconds 00000100:00100000:0.0:1787560473.885827:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862714368 00000100:00100000:0.0:1787560473.885830:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862714368 00000100:00100000:0.0:1787560473.885853:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787560473.885859:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8421:x1874392862714368:12345-0@lo:700: 00000100:00080000:2.0:1787560473.885917:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1787560473.887260:0:7430:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00010000:00010000:1.0:1787560473.887660:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560473.887861:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffcbff200/0x4642c20bf2f33b06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33aff expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.887892:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffcbff200/0x4642c20bf2f33b06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33aff expref: 20 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.887904:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffcbff200/0x4642c20bf2f33b06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33aff expref: 20 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.887913:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbff200, rc 0) 00000100:00100000:1.0:1787560473.888258:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd087b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:6497:x1874392862713344:12345-0@lo:101: Request processed in 8493us (8543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560473.888267:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787560473.888683:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862713344:0@lo:101: 00010000:00010000:2.0:1787560473.888703:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff400/0x4642c20bf2f33aff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33b06 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560473.888714:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff400/0x4642c20bf2f33aff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33b06 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560473.888795:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab13b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862714496:0@lo:501: 00000100:00100000:2.0:1787560473.888836:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560473.888899:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd86bcc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787560473.888939:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862714496 00000100:00100000:1.0:1787560473.888946:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862714496 00000100:00100000:1.0:1787560473.889035:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787560473.889045:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd0878450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:6497:x1874392862714496:12345-0@lo:501: 00000100:00100000:1.0:1787560473.889405:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd0878450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:6497:x1874392862714496:12345-0@lo:501: Request processed in 361us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560473.889422:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787560473.889571:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab13b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862714496:0@lo:501: 00000100:00100000:3.0:1787560473.889604:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeabaad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862714624:0@lo:503: 00000100:00100000:3.0:1787560473.889652:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560473.889906:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc5957b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787560473.889961:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862714624 00000100:00100000:1.0:1787560473.889966:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862714624 00000100:00100000:1.0:1787560473.889987:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787560473.890004:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd3219c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:6497:x1874392862714624:12345-0@lo:503: 00000100:00100000:1.0:1787560473.890118:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd3219c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:6497:x1874392862714624:12345-0@lo:503: Request processed in 123us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560473.890135:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787560473.890343:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeabaad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862714624:0@lo:503: 00000100:00100000:0.0:1787560473.891180:0:8604:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1c2b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8604:1874392862714752:0@lo:502: 00000100:00100000:0.0:1787560473.891232:0:8604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560473.891272:0:8604:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffba5e900 going to sleep for 11 seconds 00000100:00100000:1.0:1787560473.891378:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862714752 00000100:00100000:1.0:1787560473.891383:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862714752 00000100:00100000:1.0:1787560473.891447:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787560473.891456:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:8604:x1874392862714752:12345-0@lo:502: 00000100:00100000:1.0:1787560473.891556:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:8604:x1874392862714752:12345-0@lo:502: Request processed in 100us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560473.891562:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787560473.891712:0:8604:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1c2b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8604:1874392862714752:0@lo:502: 00000020:01000000:0.0:1787560473.891737:0:8604:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787560473.891745:0:8604:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787560473.891751:0:8604:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560473.891753:0:8604:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787560473.891758:0:8604:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787560473.891762:0:8604:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:01000000:0.0:1787560473.891797:0:8604:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787560473.891800:0:8604:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787560473.891814:0:8604:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9cafef9fb370) 00000020:00000080:0.0:1787560473.891836:0:8604:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1787560473.891841:0:8604:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787560473.891929:0:8604:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787560473.891935:0:8604:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787560473.891943:0:8604:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4642c20bf2f33b14 00010000:00080000:0.0:1787560473.891973:0:8604:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cafef9be800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.129@tcp at head 00010000:00010000:0.0:1787560473.892218:0:8604:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 40000000:02000000:1.0:1787560473.905033:0:6505:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000040:01000000:2.0:1787560473.909950:0:8604:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787560473.909975:0:8604:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787560473.910213:0:8604:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787560473.910396:0:8604:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787560473.910504:0:8604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1787560473.910594:0:8604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000100:00100000:1.0:1787560473.912487:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8421:x1874392862714368:12345-0@lo:700: Request processed in 26621us (26682us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560473.912505:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787560473.912538:0:8421:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec1c29c00 x1874392862714368/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787560489 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560473.912571:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1c29c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8421:1874392862714368:0@lo:700: 40000000:02000000:0.0:1787560473.912585:0:8421:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:00080000:1.0:1787560473.912891:0:8605:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787560473.912896:0:8605:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787560473.916886:0:8604:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787560473.916902:0:8604:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787560473.916941:0:8604:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787560473.916967:0:8604:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4642c20bf2f33b1b 00000100:00080000:2.0:1787560473.916977:0:8604:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787560473.916983:0:8604:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9cafef9be800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560473.917018:0:8604:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafeab12680 x1874392862714880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787560473.917053:0:8604:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787560473.917150:0:8604:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560473.917154:0:8604:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560473.917156:0:8604:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787560473.917159:0:8604:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787560473.917163:0:8604:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560473.917165:0:8604:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787560473.917168:0:8604:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787560473.917170:0:8604:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787560473.917197:0:8604:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab12300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8604:1874392862715008:0@lo:502: 00000100:00100000:2.0:1787560473.917277:0:8604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560473.917312:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862715008 00000100:00100000:2.0:1787560473.917319:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862715008 00000100:00100000:2.0:1787560473.917360:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787560473.917370:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:8604:x1874392862715008:12345-0@lo:502: 00000100:00100000:2.0:1787560473.917509:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:8604:x1874392862715008:12345-0@lo:502: Request processed in 140us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560473.917517:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787560473.917563:0:8604:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd86bcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787560473.917582:0:8604:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab12300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:8604:1874392862715008:0@lo:502: 00000020:01000000:2.0:1787560473.917619:0:8604:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560473.917623:0:8604:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560473.917624:0:8604:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787560473.917628:0:8604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:3.0:1787560473.919374:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862714880:0@lo:8: 00000100:00100000:3.0:1787560473.919491:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1787560473.919547:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1787560473.919577:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787560473.919587:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff400/0x4642c20bf2f33aff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33b06 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560473.919608:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff400/0x4642c20bf2f33aff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33b06 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560473.919620:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787560473.919633:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9cafe06b3370 from 1 10000000:01000000:3.0:1787560473.919636:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787560473.919666:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6000/0x4642c20bf2f33b22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560473.919674:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6000/0x4642c20bf2f33b22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560473.919684:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6000/0x4642c20bf2f33b22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560473.919699:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeabab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862715136:0@lo:101: 00000100:00100000:3.0:1787560473.919728:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560473.919742:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862714880 00000100:00100000:2.0:1787560473.919749:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862714880 00000100:00100000:3.0:1787560473.919751:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc5957a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787560473.919780:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787560473.919787:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeabaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3622:x1874392862714880:12345-0@lo:8: 00010000:00080000:2.0:1787560473.919822:0:8415:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:2.0:1787560473.919848:0:8415:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4642c20bf2f33b29 00002000:00100000:2.0:1787560473.919860:0:8415:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9caffdfef000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787560473.919865:0:8415:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787560473.919867:0:8415:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787560473.919933:0:8415:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787560473.919957:0:8415:0:(import.c:65:import_set_state_nolock()) ffff9caffdfee800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787560473.920086:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862715136 00000100:00100000:1.0:1787560473.920091:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862715136 00000100:00100000:1.0:1787560473.920124:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787560473.920130:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:6497:x1874392862715136:12345-0@lo:101: 00010000:00010000:1.0:1787560473.920139:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560473.920150:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffcbfe200/0x4642c20bf2f33b30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33b22 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.920170:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffcbfe200/0x4642c20bf2f33b30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33b22 expref: 21 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.920179:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffcbfe200/0x4642c20bf2f33b30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33b22 expref: 21 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560473.920197:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbfe200, rc 0) 00000100:00100000:1.0:1787560473.920228:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:6497:x1874392862715136:12345-0@lo:101: Request processed in 98us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560473.920234:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787560473.920289:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeabaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3622:x1874392862714880:12345-0@lo:8: Request processed in 500us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560473.920295:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787560473.921214:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cafeab12680 x1874392862714880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787560483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560473.921224:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787560473.921231:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787560473.921239:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787560473.921244:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787560473.921246:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafef9be800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787560473.921276:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787560473.921283:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862714880:0@lo:8: 00000100:00100000:3.0:1787560473.921316:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeabab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862715136:0@lo:101: 00000004:00080000:2.0:1787560473.921320:0:8605:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00010000:3.0:1787560473.921331:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6000/0x4642c20bf2f33b22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33b30 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787560473.921379:0:8605:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 193260947264ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787560473.921385:0:8605:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:3.0:1787560473.921725:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6000/0x4642c20bf2f33b22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33b30 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560473.921806:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeabab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862715264:0@lo:501: 00000100:00100000:3.0:1787560473.921854:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560473.921889:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc5957a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787560473.921906:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862715264 00000100:00100000:3.0:1787560473.921910:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862715264 00000100:00100000:3.0:1787560473.921944:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787560473.921953:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:6497:x1874392862715264:12345-0@lo:501: 00000100:00100000:3.0:1787560473.922023:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:6497:x1874392862715264:12345-0@lo:501: Request processed in 71us (168us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787560473.922030:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787560473.922064:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeabab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862715264:0@lo:501: 10000000:01000000:3.0:1787560473.922096:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787560473.922102:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6000/0x4642c20bf2f33b22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33b30 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560473.922110:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6000/0x4642c20bf2f33b22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33b30 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787560473.922836:0:6478:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000001:00100000:1.0:1787560473.930701:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787560473.930711:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1787560473.930985:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8602:x1874392862714240:12345-0@lo:700: Request processed in 45260us (45760us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560473.931013:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787560473.931197:0:8602:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cafeaba8700 x1874392862714240/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787560489 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560473.931212:0:8602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeaba8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8602:1874392862714240:0@lo:700: 00000100:00100000:0.0:1787560473.934898:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862715392:0@lo:13: 00000100:00100000:0.0:1787560473.934971:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560473.935054:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862715392 00000100:00100000:1.0:1787560473.935062:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862715392 00000100:00100000:1.0:1787560473.935133:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787560473.935142:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862715392:12345-0@lo:13: 00002000:00000024:1.0:1787560473.935168:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00080000:3.0:1787560473.935280:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1787560473.935551:0:8606:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787560473.935573:0:8606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab12d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8606:1874392862715520:0@lo:7: 00000100:00100000:2.0:1787560473.935649:0:8606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560473.935704:0:8606:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbdacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560473.935799:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862715520 00000100:00100000:3.0:1787560473.935803:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862715520 00000100:00100000:3.0:1787560473.935836:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787560473.935843:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8606:x1874392862715520:12345-0@lo:7: 00000100:00100000:1.0:1787560473.939387:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1874392862715392:12345-0@lo:13: Request processed in 4238us (4407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560473.939400:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787560473.939666:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cafeab12300 x1874392862715392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560473.939689:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862715392:0@lo:13: 00002000:00080000:3.0:1787560473.941125:0:8414:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1787560473.941134:0:8414:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787560473.941225:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8606:x1874392862715520:12345-0@lo:7: Request processed in 5379us (5572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560473.941234:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787560473.941358:0:8606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cafeab12d80 x1874392862715520/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787560489 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560473.941373:0:8606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab12d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8606:1874392862715520:0@lo:7: 00000004:00080000:2.0:1787560473.941386:0:8606:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787560473.941457:0:8606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab12d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8606:1874392862715648:0@lo:5: 00000100:00100000:2.0:1787560473.941489:0:8606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560473.941519:0:8606:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbdacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560473.941637:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862715648 00000100:00100000:3.0:1787560473.941644:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862715648 00000100:00100000:3.0:1787560473.941681:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787560473.941689:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8606:x1874392862715648:12345-0@lo:5: 00002000:00080000:3.0:1787560473.941712:0:8412:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787560473.941716:0:8412:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787560473.941949:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8606:x1874392862715648:12345-0@lo:5: Request processed in 259us (457us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787560473.941955:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787560473.942092:0:8606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cafeab12d80 x1874392862715648/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787560489 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560473.942116:0:8606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab12d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8606:1874392862715648:0@lo:5: 00000004:00080000:2.0:1787560473.942124:0:8606:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787560473.942146:0:8606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab12a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8606:1874392862715776:0@lo:700: 00000100:00100000:2.0:1787560473.942169:0:8606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560473.942191:0:8606:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbdacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560473.942228:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862715776 00000100:00100000:3.0:1787560473.942233:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862715776 00000100:00100000:3.0:1787560473.942264:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787560473.942272:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:8606:x1874392862715776:12345-0@lo:700: 00000100:00100000:0.0:1787560473.942817:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeabab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862715904:0@lo:13: 00000100:00100000:0.0:1787560473.942853:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560473.942918:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862715904 00000100:00100000:2.0:1787560473.942923:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862715904 00000100:00100000:2.0:1787560473.942955:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787560473.942962:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862715904:12345-0@lo:13: 00002000:00000024:2.0:1787560473.942974:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000004:00080000:3.0:1787560473.943131:0:8602:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787560473.943152:0:8602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeaba8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8602:1874392862716032:0@lo:7: 00000100:00100000:3.0:1787560473.943198:0:8602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560473.943217:0:8602:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc5957300 going to sleep for 11 seconds 00000100:00100000:3.0:1787560473.943230:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862716032 00000100:00100000:3.0:1787560473.943234:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862716032 00000100:00100000:3.0:1787560473.943264:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787560473.943270:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:8602:x1874392862716032:12345-0@lo:7: 00000100:00100000:2.0:1787560473.946741:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3624:x1874392862715904:12345-0@lo:13: Request processed in 3771us (3878us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560473.946756:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787560473.947226:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cafeabab100 x1874392862715904/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560473.947249:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeabab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862715904:0@lo:13: 00002000:00080000:3.0:1787560473.949125:0:8412:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1787560473.949134:0:8412:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787560473.949239:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8602:x1874392862716032:12345-0@lo:7: Request processed in 5964us (6037us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560473.949255:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787560473.949453:0:8602:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cafeaba8700 x1874392862716032/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787560489 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560473.949467:0:8602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeaba8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8602:1874392862716032:0@lo:7: 00000004:00080000:1.0:1787560473.949480:0:8602:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787560473.949518:0:8602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8602:1874392862716160:0@lo:5: 00000100:00100000:1.0:1787560473.949555:0:8602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560473.949579:0:8602:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc5812480 going to sleep for 11 seconds 00000100:00100000:3.0:1787560473.949834:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862716160 00000100:00100000:3.0:1787560473.949840:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862716160 00000100:00100000:3.0:1787560473.949879:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787560473.949888:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8602:x1874392862716160:12345-0@lo:5: 00002000:00080000:3.0:1787560473.949911:0:8415:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1787560473.950106:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8602:x1874392862716160:12345-0@lo:5: Request processed in 219us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560473.950114:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787560473.950390:0:8602:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec2004e00 x1874392862716160/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787560489 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560473.950402:0:8602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8602:1874392862716160:0@lo:5: 00000004:00080000:2.0:1787560473.950633:0:8602:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787560473.950742:0:8602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b86a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8602:1874392862716288:0@lo:5: 00000100:00100000:3.0:1787560473.950773:0:8602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560473.950830:0:8602:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc5957300 going to sleep for 11 seconds 00000100:00100000:0.0:1787560473.950868:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862716288 00000100:00100000:0.0:1787560473.950873:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862716288 00000100:00100000:0.0:1787560473.950943:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787560473.950953:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8602:x1874392862716288:12345-0@lo:5: 00002000:00080000:0.0:1787560473.950986:0:8414:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000001:00080000:3.0:1787560473.956723:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:1.0:1787560473.958246:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8602:x1874392862716288:12345-0@lo:5: Request processed in 7287us (7465us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787560473.958262:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787560473.958411:0:8602:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caff4b86a00 x1874392862716288/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787560489 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560473.958441:0:8602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b86a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8602:1874392862716288:0@lo:5: 00000004:00080000:0.0:1787560473.958455:0:8602:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1787560473.958492:0:8602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1c2aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8602:1874392862716416:0@lo:900: 00000100:00100000:0.0:1787560473.958538:0:8602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560473.958565:0:8602:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffba5e600 going to sleep for 11 seconds 00000100:00100000:3.0:1787560473.958840:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862716416 00000100:00100000:3.0:1787560473.958847:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862716416 00000100:00100000:3.0:1787560473.958892:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787560473.958900:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8602:x1874392862716416:12345-0@lo:900: 00000100:00100000:3.0:1787560473.958945:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8602:x1874392862716416:12345-0@lo:900: Request processed in 47us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560473.958951:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787560473.961508:0:8602:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec1c2aa00 x1874392862716416/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787560489 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560473.961528:0:8602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1c2aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8602:1874392862716416:0@lo:900: 00000100:00100000:3.0:1787560473.961938:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8606:x1874392862715776:12345-0@lo:700: Request processed in 19665us (19766us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560473.961948:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787560473.962061:0:8606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cafeab12a00 x1874392862715776/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787560489 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560473.962114:0:8606:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787560473.962126:0:8606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab12a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8606:1874392862715776:0@lo:700: 00000004:02000040:3.0:1787560473.963958:0:8606:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:3.0:1787560473.968616:0:8606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b85500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8606:1874392862716544:0@lo:5: 00000100:00100000:3.0:1787560473.968682:0:8606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560473.968788:0:8606:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc59570c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560473.968825:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862716544 00000100:00100000:2.0:1787560473.968832:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862716544 00000100:00100000:2.0:1787560473.968916:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787560473.968925:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8606:x1874392862716544:12345-0@lo:5: 00002000:00080000:3.0:1787560473.973781:0:8415:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1787560473.973801:0:8415:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1787560473.979559:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8606:x1874392862716544:12345-0@lo:5: Request processed in 10629us (10870us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787560473.979577:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787560473.980286:0:8606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caff4b85500 x1874392862716544/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787560489 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560473.980304:0:8606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b85500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8606:1874392862716544:0@lo:5: 00000004:00080000:2.0:1787560473.980319:0:8606:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:0.0:1787560474.611622:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560475.637828:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560476.674577:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560476.724549:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862716672:0@lo:41: 00000100:00100000:2.0:1787560476.724621:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560476.724701:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862716672 00000100:00100000:2.0:1787560476.724708:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862716672 00000100:00100000:2.0:1787560476.724756:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787560476.724766:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862716672:12345-0@lo:41: 00000004:00000024:2.0:1787560476.724796:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1787560476.724836:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862716672:12345-0@lo:41: Request processed in 71us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560476.724843:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787560476.724886:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862716672:0@lo:41: 00000001:02000400:1.0:1787560477.481944:0:8788:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787560477.683584:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560477.758183:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862716800:0@lo:41: 00000100:00100000:2.0:1787560477.758257:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560477.758380:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862716800 00000100:00100000:3.0:1787560477.758389:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862716800 00000100:00100000:3.0:1787560477.758461:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787560477.758472:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862716800:12345-0@lo:41: 00000004:00000024:3.0:1787560477.758504:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1787560477.758548:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862716800:12345-0@lo:41: Request processed in 77us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560477.758556:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787560477.758641:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862716800:0@lo:41: 00000020:00000004:1.0:1787560478.516066:0:8840:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787560478.516322:0:8840:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787560478.717525:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560479.283761:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2005880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862716928:0@lo:13: 00000100:00100000:1.0:1787560479.283855:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560479.283950:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862716928 00000100:00100000:1.0:1787560479.283959:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862716928 00000100:00100000:1.0:1787560479.284044:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787560479.284057:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3623:x1874392862716928:12345-0@lo:13: 00002000:00000024:1.0:1787560479.284096:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787560479.284146:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3623:x1874392862716928:12345-0@lo:13: Request processed in 91us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560479.284153:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1787560479.284178:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787560479.284211:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec2005880 x1874392862716928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560495 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560479.284234:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2005880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862716928:0@lo:13: 00000100:00100000:2.0:1787560479.285162:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862717184:0@lo:400: 00000100:00100000:2.0:1787560479.285223:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560479.285251:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862717696:0@lo:400: 00000100:00100000:2.0:1787560479.285286:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560479.285313:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787560479.285319:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862717312:0@lo:400: 00000100:00100000:2.0:1787560479.285345:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560479.285365:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862717824:0@lo:400: 00000100:00100000:2.0:1787560479.285393:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560479.285486:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862717184 00000100:00100000:2.0:1787560479.285493:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862717184 00000100:00100000:2.0:1787560479.285525:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862717696 00000100:00100000:2.0:1787560479.285529:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862717696 00000100:00100000:2.0:1787560479.285550:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862717824 00000100:00100000:2.0:1787560479.285553:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862717824 00000100:00100000:2.0:1787560479.285569:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787560479.285577:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862717184:12345-0@lo:400: 00000100:00100000:2.0:1787560479.285630:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862717184:12345-0@lo:400: Request processed in 53us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560479.285637:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787560479.285654:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787560479.285660:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862717696:12345-0@lo:400: 00000100:00100000:2.0:1787560479.285686:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862717696:12345-0@lo:400: Request processed in 27us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560479.285693:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787560479.285704:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787560479.285710:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862717824:12345-0@lo:400: 00000100:00100000:2.0:1787560479.285737:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862717824:12345-0@lo:400: Request processed in 28us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560479.285743:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787560479.285769:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862717312 00000100:00100000:2.0:1787560479.285773:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862717312 00000100:00100000:2.0:1787560479.285798:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787560479.285805:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862717312:12345-0@lo:400: 00000100:00100000:1.0:1787560479.286132:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862717056:0@lo:400: 00000100:00100000:1.0:1787560479.286179:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560479.286211:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862717568:0@lo:400: 00000100:00100000:1.0:1787560479.286234:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560479.286252:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862718080:0@lo:13: 00000100:00100000:1.0:1787560479.286280:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560479.286303:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787560479.286310:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862717440:0@lo:400: 00000100:00100000:1.0:1787560479.286334:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560479.286469:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862717952:0@lo:400: 00000100:00100000:1.0:1787560479.286494:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560479.286597:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862717568 00000100:00100000:1.0:1787560479.286603:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862717568 00000100:00100000:1.0:1787560479.286628:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787560479.286634:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862717568:12345-0@lo:400: 00000100:00100000:1.0:1787560479.286742:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862717568:12345-0@lo:400: Request processed in 107us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560479.286749:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787560479.286773:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862717952 00000100:00100000:1.0:1787560479.286776:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862717952 00000100:00100000:1.0:1787560479.286806:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787560479.286813:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3624:x1874392862717952:12345-0@lo:400: 00000100:00100000:1.0:1787560479.286844:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3624:x1874392862717952:12345-0@lo:400: Request processed in 32us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560479.286850:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787560479.286871:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787560479.286877:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787560479.286879:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560479.286899:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862718080 00000100:00100000:1.0:1787560479.286903:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862718080 00000100:00100000:1.0:1787560479.286927:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787560479.286934:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2005f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1874392862718080:12345-0@lo:13: 00002000:00000024:1.0:1787560479.286950:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560479.287474:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862717056 00000100:00100000:0.0:1787560479.287479:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862717056 00000100:00100000:0.0:1787560479.287529:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787560479.287537:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:3624:x1874392862717056:12345-0@lo:400: 00000100:00100000:0.0:1787560479.287578:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:3624:x1874392862717056:12345-0@lo:400: Request processed in 42us (1398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560479.287584:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787560479.287802:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2005f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1874392862718080:12345-0@lo:13: Request processed in 48us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560479.287812:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787560479.287837:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862717440 00000100:00100000:1.0:1787560479.287841:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862717440 00000100:00100000:2.0:1787560479.287903:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862717312:12345-0@lo:400: Request processed in 2097us (2555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560479.287905:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787560479.287911:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787560479.287913:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862717440:12345-0@lo:400: 00000100:00100000:1.0:1787560479.288601:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862717440:12345-0@lo:400: Request processed in 676us (2253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560479.288610:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787560479.295747:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862717312:0@lo:400: 00010000:00080000:2.0:1787560479.295775:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caffcaa8000 x1874392862717824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560479.295787:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862717824:0@lo:400: 00010000:00080000:2.0:1787560479.295801:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cafeab10700 x1874392862717184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560479.295809:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862717184:0@lo:400: 00010000:00080000:2.0:1787560479.295822:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cafeab13b80 x1874392862717696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560479.295830:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862717696:0@lo:400: 00010000:00080000:1.0:1787560479.302472:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cafeab12300 x1874392862717440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560479.302498:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862717440:0@lo:400: 00010000:00080000:1.0:1787560479.302527:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caffcaa9880 x1874392862717952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560479.302538:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862717952:0@lo:400: 00000100:00100000:1.0:1787560479.302552:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862717056:0@lo:400: 00000100:00100000:1.0:1787560479.302565:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862717568:0@lo:400: 00010000:00080000:1.0:1787560479.302577:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caffcaaa680 x1874392862718080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560495 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560479.302620:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862718080:0@lo:13: 00000001:00080000:3.0:1787560479.464635:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:3.0:1787560479.464656:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1787560479.731693:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560480.763638:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787560481.475667:0:8942:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787560481.477256:0:8942:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787560481.779676:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560481.843865:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862718208:0@lo:41: 00000100:00100000:2.0:1787560481.844056:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560481.847907:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862718208 00000100:00100000:1.0:1787560481.847926:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862718208 00000100:00100000:2.0:1787560481.849087:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787560481.849109:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862718208:12345-0@lo:41: 00000004:00000024:2.0:1787560481.849164:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1787560481.852512:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862718208:12345-0@lo:41: Request processed in 3396us (8441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560481.852556:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787560481.853325:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862718208:0@lo:41: 00000020:00000004:0.0:1787560482.547567:0:8990:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787560482.547581:0:8990:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1787560482.806052:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560482.868124:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787560482.868164:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862718336:0@lo:41: 00000100:00100000:0.0:1787560482.868260:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560482.868792:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862718336 00000100:00100000:3.0:1787560482.868804:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862718336 00000100:00100000:3.0:1787560482.868883:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787560482.868895:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862718336:12345-0@lo:41: 00000004:00000024:3.0:1787560482.869179:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1787560482.869259:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862718336:12345-0@lo:41: Request processed in 366us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560482.869268:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787560482.869366:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862718336:0@lo:41: 00010000:00010000:2.0:1787560483.827613:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560484.404005:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862718464:0@lo:13: 00000100:00100000:3.0:1787560484.404118:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560484.404211:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862718464 00000100:00100000:3.0:1787560484.404221:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862718464 00000100:00100000:3.0:1787560484.404299:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787560484.404311:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862718464:12345-0@lo:13: 00002000:00000024:3.0:1787560484.404349:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787560484.404400:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862718464:12345-0@lo:13: Request processed in 92us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560484.404409:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787560484.404469:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787560484.404505:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caff4b87100 x1874392862718464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560500 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560484.404518:0:3623:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1787560484.404542:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862718464:0@lo:13: 00000100:00100000:3.0:1787560484.408636:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862718848:0@lo:400: 00000100:00100000:3.0:1787560484.408750:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560484.408790:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874392862719360:0@lo:400: 00000100:00100000:3.0:1787560484.408813:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560484.408838:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787560484.408843:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862718720:0@lo:400: 00000100:00100000:3.0:1787560484.408859:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560484.408883:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862719232:0@lo:400: 00000100:00100000:3.0:1787560484.408902:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560484.408943:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862718848 00000100:00100000:3.0:1787560484.408952:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862718848 00000100:00100000:3.0:1787560484.409018:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787560484.409045:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862718848:12345-0@lo:400: 00000100:00100000:3.0:1787560484.409114:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862718848:12345-0@lo:400: Request processed in 70us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560484.409121:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787560484.409146:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862719360 00000100:00100000:3.0:1787560484.409150:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862719360 00000100:00100000:3.0:1787560484.409182:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862718720 00000100:00100000:3.0:1787560484.409186:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862718720 00000100:00100000:3.0:1787560484.409196:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862719232 00000100:00100000:3.0:1787560484.409199:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862719232 00000100:00100000:3.0:1787560484.409211:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787560484.409216:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874392862719360:12345-0@lo:400: 00000100:00100000:3.0:1787560484.409260:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874392862719360:12345-0@lo:400: Request processed in 43us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560484.409266:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787560484.409278:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787560484.409283:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862718720:12345-0@lo:400: 00000100:00100000:3.0:1787560484.409308:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862718720:12345-0@lo:400: Request processed in 25us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560484.409314:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787560484.409323:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787560484.409329:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862719232:12345-0@lo:400: 00000100:00100000:3.0:1787560484.409351:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862719232:12345-0@lo:400: Request processed in 23us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560484.409356:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1787560484.409393:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787560484.409397:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787560484.409408:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862718976:0@lo:400: 00000100:00100000:3.0:1787560484.409468:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560484.409488:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862719488:0@lo:400: 00000100:00100000:3.0:1787560484.409530:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560484.409561:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787560484.409567:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862718592:0@lo:400: 00000100:00100000:3.0:1787560484.409596:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560484.409618:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862719104:0@lo:400: 00000100:00100000:3.0:1787560484.409640:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560484.409666:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862719488 00000100:00100000:3.0:1787560484.409669:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862719488 00000100:00100000:3.0:1787560484.409706:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787560484.409713:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862719488:12345-0@lo:400: 00000100:00100000:3.0:1787560484.409749:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862719488:12345-0@lo:400: Request processed in 36us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560484.409755:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787560484.409773:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862718592 00000100:00100000:3.0:1787560484.409777:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862718592 00000100:00100000:3.0:1787560484.409808:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787560484.409815:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:3623:x1874392862718592:12345-0@lo:400: 00000100:00100000:3.0:1787560484.409844:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:3623:x1874392862718592:12345-0@lo:400: Request processed in 30us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560484.409850:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787560484.409882:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862719104 00000100:00100000:3.0:1787560484.409885:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862719104 00000100:00100000:3.0:1787560484.409905:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787560484.409911:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862719104:12345-0@lo:400: 00000100:00100000:3.0:1787560484.409939:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862719104:12345-0@lo:400: Request processed in 28us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560484.409951:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1787560484.409969:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787560484.409978:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862718976 00000100:00100000:3.0:1787560484.409981:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862718976 00000100:00100000:3.0:1787560484.410013:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787560484.410020:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862718976:12345-0@lo:400: 00000100:00100000:3.0:1787560484.410050:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862718976:12345-0@lo:400: Request processed in 31us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560484.410056:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1787560484.410101:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caff4b85500 x1874392862718720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560484.410118:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862718720:0@lo:400: 00010000:00080000:3.0:1787560484.410131:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caff4b84000 x1874392862719232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560484.410140:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862719232:0@lo:400: 00000100:00100000:3.0:1787560484.410152:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862718848:0@lo:400: 00010000:00080000:3.0:1787560484.410163:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caff4b85880 x1874392862719360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560484.410171:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874392862719360:0@lo:400: 00000100:00100000:3.0:1787560484.410206:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862718592:0@lo:400: 00000100:00100000:3.0:1787560484.410216:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862719104:0@lo:400: 00010000:00080000:3.0:1787560484.410224:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caff4b84380 x1874392862718976/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560484.410244:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862718976:0@lo:400: 00010000:00080000:3.0:1787560484.410256:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caff4b86d80 x1874392862719488/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560484.410264:0:3623:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787560484.410274:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862719488:0@lo:400: 00000100:00100000:0.0:1787560484.415168:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560484.415202:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1c29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862719616:0@lo:13: 00000100:00100000:0.0:1787560484.415301:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560484.415364:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862719616 00000100:00100000:0.0:1787560484.415373:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862719616 00000100:00100000:0.0:1787560484.415449:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787560484.415462:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862719616:12345-0@lo:13: 00002000:00000024:0.0:1787560484.415491:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560484.415550:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862719616:12345-0@lo:13: Request processed in 89us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560484.415558:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787560484.415652:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec1c29f80 x1874392862719616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560500 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560484.415676:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1c29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862719616:0@lo:13: 00010000:00010000:1.0:1787560484.854894:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560485.877424:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560486.901138:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560486.965181:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862719744:0@lo:41: 00000100:00100000:0.0:1787560486.965266:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560486.965353:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862719744 00000100:00100000:1.0:1787560486.965362:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862719744 00000100:00100000:1.0:1787560486.965415:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787560486.965425:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862719744:12345-0@lo:41: 00000004:00000024:1.0:1787560486.965482:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1787560486.966270:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862719744:12345-0@lo:41: Request processed in 844us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560486.966279:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787560486.967019:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862719744:0@lo:41: 00010000:00010000:0.0:1787560487.926585:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560487.990131:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafe0685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862719872:0@lo:41: 00000100:00100000:2.0:1787560487.990215:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560487.990316:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862719872 00000100:00100000:3.0:1787560487.990324:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862719872 00000100:00100000:3.0:1787560487.990383:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787560487.990394:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862719872:12345-0@lo:41: 00000004:00000024:3.0:1787560487.990427:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1787560487.990529:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862719872:12345-0@lo:41: Request processed in 136us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560487.990536:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787560487.991585:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafe0685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862719872:0@lo:41: 00010000:00010000:2.0:1787560488.951509:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560489.524497:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862720000:0@lo:400: 00000100:00100000:1.0:1787560489.524572:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560489.524617:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862720512:0@lo:400: 00000100:00100000:1.0:1787560489.524641:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560489.524659:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeabab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862721024:0@lo:400: 00000100:00100000:1.0:1787560489.524680:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560489.524703:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787560489.524709:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862720128:0@lo:400: 00000100:00100000:1.0:1787560489.524741:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560489.524761:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2007b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874392862720640:0@lo:400: 00000100:00100000:1.0:1787560489.524787:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560489.524827:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862720512 00000100:00100000:1.0:1787560489.524834:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862720512 00000100:00100000:1.0:1787560489.524889:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787560489.524952:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862721152:0@lo:13: 00000100:00100000:2.0:1787560489.524991:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560489.525023:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862721152 00000100:00100000:2.0:1787560489.525027:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862721152 00000100:00100000:2.0:1787560489.525061:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787560489.525070:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862721152:12345-0@lo:13: 00002000:00000024:2.0:1787560489.525097:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560489.525140:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862721152:12345-0@lo:13: Request processed in 71us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560489.525147:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1787560489.525167:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787560489.525196:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caffcaabb80 x1874392862721152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560505 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560489.525213:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862721152:0@lo:13: 00000100:00100000:1.0:1787560489.525620:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc87aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862720512:12345-0@lo:400: 00000100:00100000:1.0:1787560489.525675:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc87aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862720512:12345-0@lo:400: Request processed in 59us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560489.525682:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787560489.525706:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862721024 00000100:00100000:1.0:1787560489.525709:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862721024 00000100:00100000:1.0:1787560489.525736:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787560489.525742:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc87ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862721024:12345-0@lo:400: 00000100:00100000:1.0:1787560489.525772:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc87ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862721024:12345-0@lo:400: Request processed in 30us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560489.525777:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787560489.525795:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862720128 00000100:00100000:1.0:1787560489.525799:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862720128 00000100:00100000:1.0:1787560489.525820:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862720640 00000100:00100000:1.0:1787560489.525823:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862720640 00000100:00100000:1.0:1787560489.525853:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787560489.525859:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1fad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862720128:12345-0@lo:400: 00000100:00100000:1.0:1787560489.525901:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1fad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862720128:12345-0@lo:400: Request processed in 41us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560489.525907:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787560489.525919:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787560489.525925:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1fafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874392862720640:12345-0@lo:400: 00000100:00100000:1.0:1787560489.525952:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1fafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874392862720640:12345-0@lo:400: Request processed in 27us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560489.525967:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1787560489.526826:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787560489.526865:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec2004380 x1874392862720128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560489.526880:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862720128:0@lo:400: 00010000:00080000:2.0:1787560489.526892:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec2007b80 x1874392862720640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560489.526912:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2007b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874392862720640:0@lo:400: 00000100:00100000:2.0:1787560489.526926:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862720512:0@lo:400: 00010000:00080000:2.0:1787560489.526935:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cafeabab100 x1874392862721024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560489.526943:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeabab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862721024:0@lo:400: 00000100:00100000:0.0:1787560489.530581:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862720256:0@lo:400: 00000100:00100000:0.0:1787560489.530649:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560489.530686:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862720768:0@lo:400: 00000100:00100000:0.0:1787560489.530709:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560489.530726:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1c2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862721280:0@lo:13: 00000100:00100000:0.0:1787560489.530746:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560489.531081:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787560489.531093:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862720384:0@lo:400: 00000100:00100000:0.0:1787560489.531120:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560489.531148:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeaba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862720896:0@lo:400: 00000100:00100000:0.0:1787560489.531169:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560489.531210:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862720000 00000100:00100000:0.0:1787560489.531217:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862720000 00000100:00100000:0.0:1787560489.531266:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787560489.531275:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:3623:x1874392862720000:12345-0@lo:400: 00000100:00100000:0.0:1787560489.531329:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:3623:x1874392862720000:12345-0@lo:400: Request processed in 54us (6756us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560489.531336:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787560489.531372:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862721280 00000100:00100000:0.0:1787560489.531376:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862721280 00000100:00100000:0.0:1787560489.531409:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787560489.531426:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862721280:12345-0@lo:13: 00000100:00100000:2.0:1787560489.531427:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862720768 00000100:00100000:2.0:1787560489.531450:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862720768 00002000:00000024:0.0:1787560489.531460:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560489.531478:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862720384 00000100:00100000:2.0:1787560489.531481:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862720384 00000100:00100000:0.0:1787560489.531493:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862721280:12345-0@lo:13: Request processed in 69us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560489.531495:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787560489.531499:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787560489.531501:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862720768:12345-0@lo:400: 00000100:00100000:0.0:1787560489.531515:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862720896 00000100:00100000:0.0:1787560489.531518:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862720896 00000100:00100000:2.0:1787560489.531535:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862720768:12345-0@lo:400: Request processed in 34us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560489.531537:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787560489.531542:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787560489.531543:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862720896:12345-0@lo:400: 00000100:00100000:2.0:1787560489.531553:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787560489.531558:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862720384:12345-0@lo:400: 00000100:00100000:0.0:1787560489.531569:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862720896:12345-0@lo:400: Request processed in 26us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560489.531575:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787560489.531578:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862720384:12345-0@lo:400: Request processed in 21us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560489.531583:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787560489.531609:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862720000:0@lo:400: 00000100:00080000:0.0:1787560489.531630:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787560489.531634:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787560489.531649:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862720256 00000100:00100000:3.0:1787560489.531653:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862720256 00010000:00080000:0.0:1787560489.531654:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec2004700 x1874392862720384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560489.531665:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862720384:0@lo:400: 00010000:00080000:0.0:1787560489.531674:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cafeaba8700 x1874392862720896/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560489.531683:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeaba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862720896:0@lo:400: 00010000:00080000:0.0:1787560489.531693:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec2006680 x1874392862720768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560489.531701:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862720768:0@lo:400: 00000100:00100000:3.0:1787560489.531719:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787560489.531726:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862720256:12345-0@lo:400: 00000100:00100000:3.0:1787560489.531761:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862720256:12345-0@lo:400: Request processed in 36us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560489.531766:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1787560489.532360:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec1c2a680 x1874392862721280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560505 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560489.532382:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1c2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862721280:0@lo:13: 00000100:00100000:0.0:1787560489.532410:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862720256:0@lo:400: 00010000:00010000:3.0:1787560489.972092:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560490.998270:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560492.034659:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560492.103206:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787560492.103906:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1fadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862721408:0@lo:41: 00000100:00100000:1.0:1787560492.104117:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560492.104201:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862721408 00000100:00100000:1.0:1787560492.104210:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862721408 00000100:00100000:1.0:1787560492.104269:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787560492.104280:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1fad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862721408:12345-0@lo:41: 00000004:00000024:1.0:1787560492.104322:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1787560492.104377:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1fad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862721408:12345-0@lo:41: Request processed in 98us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560492.104384:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787560492.104466:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1fadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862721408:0@lo:41: 00000020:01000004:3.0:1787560492.880971:0:9489:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787560492.880976:0:9489:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1787560492.880978:0:9489:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787560492.881141:0:9489:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9caec1ef6000 00000020:01000004:3.0:1787560492.881161:0:9489:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787560492.881179:0:9489:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787560492.881198:0:9489:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9caffb994d28) 00000020:00000080:3.0:1787560492.881217:0:9489:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787560492.935625:0:9489:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787560492.935707:0:9489:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1787560492.976307:0:9489:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787560492.978163:0:9489:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787560492.978185:0:9489:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787560492.978286:0:9489:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4642c20bf2f33b3e 00000020:01000004:2.0:1787560492.978297:0:9489:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787560492.978326:0:9489:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.129@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787560492.978330:0:9489:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787560492.978352:0:9489:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787560492.978398:0:9489:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1787560492.978403:0:9489:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.129@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787560493.012142:0:9489:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787560493.012196:0:9489:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.129@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1787560493.012201:0:9489:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787560493.012203:0:9489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787560493.012205:0:9489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787560493.012206:0:9489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787560493.012207:0:9489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787560493.012209:0:9489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787560493.012211:0:9489:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787560493.012214:0:9489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787560493.012215:0:9489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787560493.012217:0:9489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787560493.012219:0:9489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787560493.012224:0:9489:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1787560493.012227:0:9489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787560493.012228:0:9489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787560493.012230:0:9489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787560493.012231:0:9489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787560493.012232:0:9489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787560493.012233:0:9489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787560493.012234:0:9489:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787560493.012235:0:9489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787560493.012236:0:9489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787560493.012238:0:9489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787560493.012239:0:9489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787560493.012273:0:9489:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787560493.012297:0:9489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffb884380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862721536:0@lo:253: 00000100:00100000:0.0:1787560493.012593:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560493.012640:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862721536 00000100:00100000:2.0:1787560493.012650:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862721536 00000100:00100000:0.0:1787560493.012729:0:9489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd3214000 going to sleep for 11 seconds 00000100:00100000:2.0:1787560493.012987:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787560493.013000:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:9489:x1874392862721536:12345-0@lo:253: 20000000:01000000:2.0:1787560493.013043:0:6493:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787560493.013048:0:6493:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1787560493.013054:0:6493:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1787560493.013059:0:6493:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1787560493.014264:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787560493.016216:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1787560493.016262:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1787560493.016313:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1787560493.016321:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1787560493.016336:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1787560493.016356:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1787560493.017303:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1787560493.017330:0:6493:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.129@tcp 20000000:01000000:0.0:1787560493.017333:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.129@tcp (null) (null) (null) 00000040:00080000:0.0:1787560493.017350:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1787560493.017357:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787560493.017371:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1787560493.017378:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.129@tcp (null) (null) 00000040:00080000:0.0:1787560493.017392:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1787560493.018171:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787560493.018226:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1787560493.018252:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1787560493.018362:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1787560493.018379:0:6493:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.129@tcp 20000000:01000000:0.0:1787560493.018381:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.129@tcp (null) (null) (null) 00000040:00080000:0.0:1787560493.018396:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1787560493.018403:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787560493.018417:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1787560493.018422:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.129@tcp (null) (null) 00000040:00080000:0.0:1787560493.019510:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1787560493.019534:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787560493.019557:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1787560493.019578:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1787560493.022888:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1787560493.022931:0:6493:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.129@tcp 20000000:01000000:0.0:1787560493.022944:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.129@tcp (null) (null) (null) 00000040:00080000:0.0:1787560493.023321:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1787560493.023332:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787560493.023373:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1787560493.023380:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.129@tcp (null) (null) 00000040:00080000:0.0:1787560493.023397:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1787560493.023407:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787560493.023421:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1787560493.023481:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1787560493.023504:0:6493:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787560493.023508:0:6493:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787560493.023513:0:6493:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787560493.023758:0:6493:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1787560493.023762:0:6493:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787560493.025796:0:9495:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:1.0:1787560493.025851:0:9495:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:1.0:1787560493.025871:0:9495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:0.0:1787560493.026208:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:0.0:1787560493.026254:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:0.0:1787560493.026273:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:0.0:1787560493.026287:0:6493:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787560493.026291:0:6493:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787560493.027629:0:9496:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1787560493.027957:0:9496:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1787560493.027975:0:9496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1787560493.028666:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1787560493.029029:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:2.0:1787560493.029050:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:2.0:1787560493.029065:0:6493:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787560493.029068:0:6493:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787560493.042131:0:9497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1787560493.042611:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1787560493.042646:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:0.0:1787560493.043193:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:0.0:1787560493.043216:0:6493:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787560493.043220:0:6493:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787560493.044298:0:9498:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:2.0:1787560493.044336:0:9498:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:2.0:1787560493.044353:0:9498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1787560493.046553:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1787560493.046589:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1787560493.046605:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:1.0:1787560493.046618:0:6493:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787560493.046621:0:6493:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00010000:00010000:3.0:1787560493.046969:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:1.0:1787560493.052909:0:9499:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1787560493.053108:0:9499:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1787560493.053133:0:9499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:0.0:1787560493.055279:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:0.0:1787560493.055321:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:0.0:1787560493.055336:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 10000000:01000000:0.0:1787560493.055355:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787560493.055383:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cafc0030a00/0x4642c20bf2f33b45 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.055405:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33a3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33a34 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.055797:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cb0021fee00/0x4642c20bf2f33a65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33a5e expref: 21 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.055805:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33aa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33a9d expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.055813:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cafc0030400/0x4642c20bf2f33ac0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33ab9 expref: 21 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.055820:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cb0021ffc00/0x4642c20bf2f33ae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33adc expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.055827:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caffcbff200/0x4642c20bf2f33b06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33aff expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.055834:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caffcbfe200/0x4642c20bf2f33b30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33b22 expref: 21 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.055842:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cafc0030a00/0x4642c20bf2f33b45 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.055893:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caffcbfe200/0x4642c20bf2f33b30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f33b22 expref: 21 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.055912:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9caffcbfe200/0x4642c20bf2f33b30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f33b22 expref: 21 pid: 6494 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560493.055931:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffb885c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1874392862721664:0@lo:104: 00000100:00100000:0.0:1787560493.056157:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787560493.056245:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caffcbff200/0x4642c20bf2f33b06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f33aff expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.056254:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9caffcbff200/0x4642c20bf2f33b06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f33aff expref: 21 pid: 6492 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560493.056263:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1c2a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1874392862721792:0@lo:104: 00000100:00100000:0.0:1787560493.056305:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787560493.056416:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cb0021ffc00/0x4642c20bf2f33ae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f33adc expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.056424:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cb0021ffc00/0x4642c20bf2f33ae3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f33adc expref: 21 pid: 6493 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560493.056464:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccc000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1874392862721920:0@lo:104: 00000100:00100000:0.0:1787560493.056501:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787560493.059305:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cafc0030400/0x4642c20bf2f33ac0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f33ab9 expref: 21 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.059329:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cafc0030400/0x4642c20bf2f33ac0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f33ab9 expref: 21 pid: 6494 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560493.059345:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2cced80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1874392862722048:0@lo:104: 00000100:00100000:0.0:1787560493.059410:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560493.059463:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862721664 00000100:00100000:2.0:1787560493.059472:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862721664 00000100:00100000:2.0:1787560493.059534:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862721792 00000100:00100000:2.0:1787560493.059537:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862721792 00000100:00100000:2.0:1787560493.059549:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862721920 00000100:00100000:2.0:1787560493.059552:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862721920 00000100:00100000:2.0:1787560493.059567:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787560493.059578:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb887800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+5:6493:x1874392862721664:12345-0@lo:104: 00010000:00010000:2.0:1787560493.059595:0:6482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6000/0x4642c20bf2f33b22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33b30 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.059704:0:6482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787560493.059712:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb887800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+5:6493:x1874392862721664:12345-0@lo:104: Request processed in 135us (3556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560493.059720:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787560493.059741:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787560493.059748:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+4:6493:x1874392862721792:12345-0@lo:104: 00010000:00010000:2.0:1787560493.059756:0:6482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff400/0x4642c20bf2f33aff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33b06 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.059796:0:6482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787560493.059802:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+4:6493:x1874392862721792:12345-0@lo:104: Request processed in 55us (3498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560493.059809:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787560493.059822:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787560493.059828:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:6493:x1874392862721920:12345-0@lo:104: 00010000:00010000:2.0:1787560493.059836:0:6482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe600/0x4642c20bf2f33adc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33ae3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.059865:0:6482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787560493.059870:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:6493:x1874392862721920:12345-0@lo:104: Request processed in 43us (3381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560493.059876:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1787560493.059896:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787560493.059903:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6000/0x4642c20bf2f33b22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33b30 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.059910:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6000 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:2.0:1787560493.059922:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6000/0x4642c20bf2f33b22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33b30 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.059943:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6000/0x4642c20bf2f33b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33b30 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560493.059952:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6000/0x4642c20bf2f33b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33b30 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560493.059959:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787560493.060178:0:6487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787560493.060361:0:9500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560493.060369:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff400/0x4642c20bf2f33aff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33b06 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.060376:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ff400 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:1.0:1787560493.060386:0:6487:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff400/0x4642c20bf2f33aff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33b06 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.060393:0:6487:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff400/0x4642c20bf2f33aff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33b06 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560493.060399:0:6487:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff400/0x4642c20bf2f33aff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33b06 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560493.060404:0:6487:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787560493.060481:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6000/0x4642c20bf2f33b22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33b30 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.060488:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787560493.060509:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6000/0x4642c20bf2f33b22 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33b30 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.060516:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6000/0x4642c20bf2f33b22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33b30 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.060531:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560493.060533:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560493.060534:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560493.060551:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862722176:0@lo:103: 00000100:00100000:2.0:1787560493.060594:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560493.060662:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862722176 00000100:00100000:2.0:1787560493.060667:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862722176 00010000:00010000:2.0:1787560493.060691:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caffcbfe200/0x4642c20bf2f33b30 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33b22 expref: 22 pid: 6494 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560493.060718:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787560493.060734:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:3623:x1874392862722176:12345-0@lo:103: 00010000:00010000:2.0:1787560493.060748:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560493.060755:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caffcbfe200/0x4642c20bf2f33b30 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33b22 expref: 22 pid: 6494 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.060769:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caffcbfe200/0x4642c20bf2f33b30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f33b22 expref: 22 pid: 6494 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.060791:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560493.060825:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:3623:x1874392862722176:12345-0@lo:103: Request processed in 92us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560493.060833:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787560493.060878:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862722176:0@lo:103: 00010000:00010000:0.0:1787560493.061340:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33aa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f33a9d expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.061355:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33aa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f33a9d expref: 21 pid: 6493 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560493.061366:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2cce300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1874392862722304:0@lo:104: 00000100:00100000:0.0:1787560493.061406:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787560493.061476:0:6487:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff400/0x4642c20bf2f33aff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33b06 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.061483:0:6487:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560493.061496:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff400/0x4642c20bf2f33aff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33b06 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.061502:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff400/0x4642c20bf2f33aff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33b06 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.061516:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560493.061518:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560493.061519:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560493.061836:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cb0021fee00/0x4642c20bf2f33a65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f33a5e expref: 21 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.061846:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cb0021fee00/0x4642c20bf2f33a65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f33a5e expref: 21 pid: 6494 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560493.061855:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2cce680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1874392862722560:0@lo:104: 00000100:00100000:0.0:1787560493.061883:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560493.061941:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862722048 00000100:00100000:2.0:1787560493.061949:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862722048 00000100:00100000:2.0:1787560493.062115:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862722304 00000100:00100000:2.0:1787560493.062120:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862722304 00000100:00100000:2.0:1787560493.062137:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787560493.062146:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+4:6493:x1874392862722048:12345-0@lo:104: 00010000:00010000:2.0:1787560493.062158:0:6482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f33ab9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33ac0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.062220:0:6482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787560493.062227:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+4:6493:x1874392862722048:12345-0@lo:104: Request processed in 82us (2817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560493.062234:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787560493.062250:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787560493.062257:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:6493:x1874392862722304:12345-0@lo:104: 00010000:00010000:2.0:1787560493.062273:0:6482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff600/0x4642c20bf2f33a9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33aa4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.062313:0:6482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787560493.062318:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:6493:x1874392862722304:12345-0@lo:104: Request processed in 63us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560493.062324:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787560493.062346:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1fadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862722432:0@lo:103: 00000100:00100000:2.0:1787560493.062373:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787560493.062408:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787560493.062413:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f33ab9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33ac0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.062421:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021fe000 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:2.0:1787560493.062425:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f33ab9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33ac0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.062453:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f33ab9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33ac0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560493.062461:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f33ab9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33ac0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560493.062466:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787560493.062484:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f33ab9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33ac0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.062490:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787560493.062509:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f33ab9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33ac0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.062522:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f33ab9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33ac0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.062535:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560493.062538:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff600/0x4642c20bf2f33a9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33aa4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.062545:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ff600 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:2.0:1787560493.062548:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff600/0x4642c20bf2f33a9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33aa4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.062554:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff600/0x4642c20bf2f33a9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33aa4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560493.062560:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff600/0x4642c20bf2f33a9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33aa4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560493.062564:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787560493.062579:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff600/0x4642c20bf2f33a9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33aa4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.062585:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787560493.062590:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff600/0x4642c20bf2f33a9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33aa4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.062596:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff600/0x4642c20bf2f33a9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33aa4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.062604:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560493.062612:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560493.062614:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560493.062626:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862722816:0@lo:103: 00000100:00100000:2.0:1787560493.062723:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560493.062746:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787560493.062751:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862722688:0@lo:103: 00000100:00100000:2.0:1787560493.062773:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560493.062801:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862722432 00000100:00100000:2.0:1787560493.062805:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862722432 00010000:00010000:2.0:1787560493.062823:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caffcbff200/0x4642c20bf2f33b06 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33aff expref: 22 pid: 6492 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560493.062838:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862722816 00000100:00100000:2.0:1787560493.062841:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862722816 00010000:00010000:2.0:1787560493.062851:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33aa4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33a9d expref: 23 pid: 6493 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560493.062860:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862722688 00000100:00100000:2.0:1787560493.062863:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862722688 00010000:00010000:2.0:1787560493.062873:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cafc0030400/0x4642c20bf2f33ac0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33ab9 expref: 24 pid: 6494 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560493.062885:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787560493.062891:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3624:x1874392862722432:12345-0@lo:103: 00010000:00010000:2.0:1787560493.062900:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560493.062906:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caffcbff200/0x4642c20bf2f33b06 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33aff expref: 24 pid: 6492 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.062916:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caffcbff200/0x4642c20bf2f33b06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f33aff expref: 24 pid: 6492 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.062957:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560493.063106:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3624:x1874392862722432:12345-0@lo:103: Request processed in 214us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560493.063114:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787560493.063129:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787560493.063136:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:3626:x1874392862722816:12345-0@lo:103: 00010000:00010000:2.0:1787560493.063144:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560493.063149:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33aa4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33a9d expref: 23 pid: 6493 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.063159:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33aa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f33a9d expref: 23 pid: 6493 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.063169:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560493.063196:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:3626:x1874392862722816:12345-0@lo:103: Request processed in 60us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560493.063203:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787560493.063215:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787560493.063221:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd7cb7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:3626:x1874392862722688:12345-0@lo:103: 00010000:00010000:2.0:1787560493.063228:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787560493.063416:0:6482:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787560493.063458:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862722560 00000100:00100000:0.0:1787560493.063462:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862722560 00000100:00100000:0.0:1787560493.063496:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787560493.063503:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:6493:x1874392862722560:12345-0@lo:104: 00010000:00010000:0.0:1787560493.063511:0:6482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9caffca49200/0x4642c20bf2f33a5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33a65 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.063549:0:6482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787560493.063555:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:6493:x1874392862722560:12345-0@lo:104: Request processed in 53us (1671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560493.063561:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1787560493.063616:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560493.063621:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caffca49200/0x4642c20bf2f33a5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33a65 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.063628:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49200 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:0.0:1787560493.063644:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caffca49200/0x4642c20bf2f33a5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33a65 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.063665:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caffca49200/0x4642c20bf2f33a5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33a65 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787560493.063671:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caffca49200/0x4642c20bf2f33a5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33a65 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560493.063677:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787560493.063695:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caffca49200/0x4642c20bf2f33a5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33a65 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.063701:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787560493.063713:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caffca49200/0x4642c20bf2f33a5e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33a65 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.063720:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caffca49200/0x4642c20bf2f33a5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33a65 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.063733:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560493.063734:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560493.063736:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560493.063746:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862722944:0@lo:103: 00000100:00100000:0.0:1787560493.063774:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787560493.063822:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33a3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f33a34 expref: 22 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.063834:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33a3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f33a34 expref: 22 pid: 6492 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560493.063844:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccdf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1874392862723072:0@lo:104: 00000100:00100000:0.0:1787560493.063874:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560493.063893:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862723072 00000100:00100000:0.0:1787560493.063896:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862723072 00000100:00100000:0.0:1787560493.063913:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787560493.063919:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:6493:x1874392862723072:12345-0@lo:104: 00010000:00010000:0.0:1787560493.063928:0:6482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33a34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33a3b expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.064180:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cafc0030400/0x4642c20bf2f33ac0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33ab9 expref: 22 pid: 6494 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.064191:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cafc0030400/0x4642c20bf2f33ac0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f33ab9 expref: 22 pid: 6494 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.064205:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787560493.064307:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560493.064318:0:6484:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787560493.064327:0:6484:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1787560493.064565:0:6486:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787560493.064576:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862722944 00000100:00100000:3.0:1787560493.064580:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862722944 00010000:00010000:3.0:1787560493.064602:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cb0021fee00/0x4642c20bf2f33a65 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33a5e expref: 23 pid: 6494 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560493.064617:0:6486:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787560493.064623:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787560493.064629:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:3623:x1874392862722944:12345-0@lo:103: 00010000:00010000:3.0:1787560493.064638:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560493.064642:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cb0021fee00/0x4642c20bf2f33a65 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33a5e expref: 23 pid: 6494 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560493.064650:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cb0021fee00/0x4642c20bf2f33a65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f33a5e expref: 23 pid: 6494 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560493.064660:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560493.065096:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd7cb7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:3626:x1874392862722688:12345-0@lo:103: Request processed in 1872us (2319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560493.065105:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787560493.065194:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1fadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862722432:0@lo:103: 00000100:00100000:2.0:1787560493.065230:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862722688:0@lo:103: 00000100:00100000:2.0:1787560493.065240:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862722816:0@lo:103: 00010000:00010000:0.0:1787560493.065381:0:6482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787560493.065388:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:6493:x1874392862723072:12345-0@lo:104: Request processed in 1468us (1513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560493.065397:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787560493.065471:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc5812cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1787560493.065489:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffcbfe200/0x4642c20bf2f33b30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f33b22 expref: 22 pid: 6494 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560493.065502:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffb885c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1874392862721664:0@lo:104: 00010000:00010000:0.0:1787560493.065513:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffcbff200/0x4642c20bf2f33b06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f33aff expref: 21 pid: 6492 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560493.065521:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1c2a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1874392862721792:0@lo:104: 00000100:00100000:0.0:1787560493.065530:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccc000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1874392862721920:0@lo:104: 00010000:00010000:0.0:1787560493.065539:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafc0030400/0x4642c20bf2f33ac0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f33ab9 expref: 20 pid: 6494 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560493.065547:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2cced80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1874392862722048:0@lo:104: 00010000:00010000:0.0:1787560493.065556:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33aa4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f33a9d expref: 19 pid: 6493 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560493.065580:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2cce300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1874392862722304:0@lo:104: 00010000:00010000:0.0:1787560493.065591:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cb0021fee00/0x4642c20bf2f33a65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f33a5e expref: 18 pid: 6494 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560493.065599:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2cce680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1874392862722560:0@lo:104: 00000100:00100000:0.0:1787560493.065608:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccdf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1874392862723072:0@lo:104: 00010000:00010000:0.0:1787560493.065650:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cafc0030a00/0x4642c20bf2f33b45 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560493.067959:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:3623:x1874392862722944:12345-0@lo:103: Request processed in 3046us (3901us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560493.067997:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:1.0:1787560493.069034:0:9501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560493.069045:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33a34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33a3b expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.069058:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6200 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:1.0:1787560493.069063:0:9501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33a34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33a3b expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.069085:0:9501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33a34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33a3b expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560493.069094:0:9501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33a34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33a3b expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560493.069101:0:9501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787560493.069156:0:9500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe600/0x4642c20bf2f33adc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33ae3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.069164:0:9500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021fe600 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:1.0:1787560493.069168:0:9500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe600/0x4642c20bf2f33adc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33ae3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.069175:0:9500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe600/0x4642c20bf2f33adc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33ae3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560493.069183:0:9500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe600/0x4642c20bf2f33adc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33ae3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560493.069189:0:9500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787560493.069266:0:9500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe600/0x4642c20bf2f33adc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33ae3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.069274:0:9500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560493.069295:0:9500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe600/0x4642c20bf2f33adc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33ae3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.069302:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe600/0x4642c20bf2f33adc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33ae3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.069326:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560493.069328:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560493.069466:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862722944:0@lo:103: 00000100:00100000:0.0:1787560493.069497:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560493.069509:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1faf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862723200:0@lo:103: 00000100:00100000:0.0:1787560493.069573:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560493.069770:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862723200 00000100:00100000:3.0:1787560493.069779:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862723200 00010000:00010000:3.0:1787560493.069827:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cb0021ffc00/0x4642c20bf2f33ae3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33adc expref: 17 pid: 6493 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560493.070751:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1787560493.070761:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560493.070768:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:3623:x1874392862723200:12345-0@lo:103: 00010000:00010000:3.0:1787560493.070787:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560493.070795:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cb0021ffc00/0x4642c20bf2f33ae3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33adc expref: 17 pid: 6493 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560493.070809:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cb0021ffc00/0x4642c20bf2f33ae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f33adc expref: 17 pid: 6493 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560493.070829:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cb0021ffc00/0x4642c20bf2f33ae3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f33adc expref: 17 pid: 6493 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560493.070847:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560493.070929:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:3623:x1874392862723200:12345-0@lo:103: Request processed in 168us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560493.070946:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787560493.071117:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1faf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862723200:0@lo:103: 00010000:00010000:0.0:1787560493.078628:0:9501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33a34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33a3b expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.078650:0:9501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787560493.078684:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33a34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33a3b expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.078692:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33a34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33a3b expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.078723:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560493.078725:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560493.078728:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560493.078770:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787560493.078799:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862723328:0@lo:103: 00000100:00100000:2.0:1787560493.078904:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560493.078996:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862723328 00000100:00100000:0.0:1787560493.079024:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862723328 00010000:00010000:0.0:1787560493.079062:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33a3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33a34 expref: 16 pid: 6492 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560493.079100:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787560493.079111:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaa8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:3626:x1874392862723328:12345-0@lo:103: 00010000:00010000:0.0:1787560493.079126:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560493.079132:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33a3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33a34 expref: 16 pid: 6492 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.079146:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33a3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f33a34 expref: 16 pid: 6492 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.079163:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33a3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f33a34 expref: 16 pid: 6492 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.079180:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cafc0030a00/0x4642c20bf2f33b45 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.079189:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafc0030a00/0x4642c20bf2f33b45 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.079207:0:6484:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cafc0030a00/0x4642c20bf2f33b45 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.079215:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cafc0030a00/0x4642c20bf2f33b45 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.079224:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cafc0030a00/0x4642c20bf2f33b45 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.079231:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cafc0030a00/0x4642c20bf2f33b45 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.079245:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafc0030a00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560493.079249:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cafc0030a00/0x4642c20bf2f33b45 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.079257:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cafc0030a00/0x4642c20bf2f33b45 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.079288:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cafc0030a00/0x4642c20bf2f33b45 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.079298:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787560493.079307:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560493.079338:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaa8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:3626:x1874392862723328:12345-0@lo:103: Request processed in 229us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560493.079346:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787560493.079382:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862723328:0@lo:103: 00010000:00010000:2.0:1787560493.079410:0:6493:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cafc0030a00/0x4642c20bf2f33b45 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.079419:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cafc0030a00/0x4642c20bf2f33b45 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.079426:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafc0030a00/0x4642c20bf2f33b45 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787560493.079462:0:6493:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787560493.082179:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+14:9489:x1874392862721536:12345-0@lo:253: Request processed in 69170us (69574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560493.082196:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787560493.082413:0:9489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffb884380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862721536:0@lo:253: 10000000:01000000:0.0:1787560493.082744:0:9489:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787560493.082749:0:9489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787560493.082751:0:9489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787560493.082752:0:9489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787560493.082754:0:9489:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1787560493.082755:0:9489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787560493.082756:0:9489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787560493.082757:0:9489:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787560493.082759:0:9489:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787560493.082761:0:9489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787560493.082762:0:9489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787560493.082789:0:9489:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9caec1ef6000 from lustre-OST0001 10000000:01000000:0.0:1787560493.082824:0:9489:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787560493.082828:0:9489:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787560493.082840:0:9489:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9cafe06b3370 local copy 10000000:01000000:0.0:1787560493.082845:0:9489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787560493.082905:0:9489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc0030800/0x4642c20bf2f33b4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.082919:0:9489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.129@tcp lock: ffff9cafc0030800/0x4642c20bf2f33b4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.082930:0:9489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cafc0030800/0x4642c20bf2f33b4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560493.082962:0:9489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2cce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862723456:0@lo:101: 00000100:00100000:0.0:1787560493.083012:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560493.083064:0:9489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd3214000 going to sleep for 11 seconds 00000100:00100000:3.0:1787560493.083120:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862723456 00000100:00100000:3.0:1787560493.083130:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862723456 00000100:00100000:3.0:1787560493.083181:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787560493.083192:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+14:9489:x1874392862723456:12345-0@lo:101: 00010000:00010000:3.0:1787560493.083208:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560493.083224:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafda2f7e00/0x4642c20bf2f33b53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33b4c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560493.083265:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafda2f7e00/0x4642c20bf2f33b53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33b4c expref: 15 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560493.083389:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafda2f7e00/0x4642c20bf2f33b53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33b4c expref: 15 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560493.083401:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f7e00, rc 0) 00000100:00100000:3.0:1787560493.083466:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:9489:x1874392862723456:12345-0@lo:101: Request processed in 276us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560493.083544:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787560493.083689:0:9489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2cce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862723456:0@lo:101: 00010000:00010000:0.0:1787560493.083704:0:9489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cafc0030800/0x4642c20bf2f33b4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x4642c20bf2f33b53 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.083714:0:9489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cafc0030800/0x4642c20bf2f33b4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4642c20bf2f33b53 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560493.083819:0:9489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2cce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862723584:0@lo:501: 00000100:00100000:0.0:1787560493.083849:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560493.083881:0:9489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd3214000 going to sleep for 11 seconds 00000100:00100000:2.0:1787560493.083956:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862723584 00000100:00100000:2.0:1787560493.084082:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862723584 00000100:00100000:2.0:1787560493.084131:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787560493.084139:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:9489:x1874392862723584:12345-0@lo:501: 00000100:00100000:2.0:1787560493.084223:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:9489:x1874392862723584:12345-0@lo:501: Request processed in 84us (373us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787560493.084230:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787560493.084544:0:9489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2cce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862723584:0@lo:501: 10000000:01000000:3.0:1787560493.084562:0:9489:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787560493.084587:0:9489:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787560493.084593:0:9489:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc0030800/0x4642c20bf2f33b4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4642c20bf2f33b53 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560493.084602:0:9489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc0030800/0x4642c20bf2f33b4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4642c20bf2f33b53 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560493.084609:0:9489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9cafc0030800/0x4642c20bf2f33b4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4642c20bf2f33b53 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560493.084636:0:9489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787560493.084669:0:9489:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9caec1ef6000 10000000:01000000:3.0:1787560493.084674:0:9489:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787560493.084680:0:9489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787560493.084683:0:9489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787560493.084695:0:9489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787560493.084699:0:9489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787560493.084725:0:9489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f33b5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560493.084732:0:9489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f33b5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560493.084742:0:9489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f33b5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.084780:0:6487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560493.084789:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cafc0030800/0x4642c20bf2f33b4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4642c20bf2f33b53 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.084797:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafc0030800 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:1.0:1787560493.084801:0:6487:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cafc0030800/0x4642c20bf2f33b4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4642c20bf2f33b53 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.084810:0:6487:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cafc0030800/0x4642c20bf2f33b4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x4642c20bf2f33b53 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560493.084818:0:6487:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cafc0030800/0x4642c20bf2f33b4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x4642c20bf2f33b53 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560493.084825:0:6487:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787560493.084847:0:6487:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cafc0030800/0x4642c20bf2f33b4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4642c20bf2f33b53 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.084853:0:6487:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560493.084888:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cafc0030800/0x4642c20bf2f33b4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4642c20bf2f33b53 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.084896:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cafc0030800/0x4642c20bf2f33b4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4642c20bf2f33b53 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.084910:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560493.084914:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1787560493.084919:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560493.084921:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560493.084928:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1fac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862723840:0@lo:103: 00000100:00100000:0.0:1787560493.084982:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560493.085071:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862723840 00000100:00100000:1.0:1787560493.085077:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862723840 00000100:00100000:1.0:1787560493.085126:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787560493.085135:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2cce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:3625:x1874392862723840:12345-0@lo:103: 00010000:00010000:1.0:1787560493.085148:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560493.085164:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafda2f7e00/0x4642c20bf2f33b53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4642c20bf2f33b4c expref: 15 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.085179:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560493.085215:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2cce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+14:3625:x1874392862723840:12345-0@lo:103: Request processed in 81us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560493.085222:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787560493.085236:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1fac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862723840:0@lo:103: 00000100:00100000:3.0:1787560493.085424:0:9489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafe0687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862723712:0@lo:101: 00000100:00100000:3.0:1787560493.086108:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560493.086287:0:9489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc59570c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560493.088824:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862723712 00000100:00100000:0.0:1787560493.088844:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862723712 00000100:00100000:1.0:1787560493.089156:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787560493.089170:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5802450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+14:9489:x1874392862723712:12345-0@lo:101: 00010000:00010000:1.0:1787560493.089190:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560493.089213:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffcbfee00/0x4642c20bf2f33b61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33b5a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.089245:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffcbfee00/0x4642c20bf2f33b61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33b5a expref: 15 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.089258:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffcbfee00/0x4642c20bf2f33b61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33b5a expref: 15 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.089269:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbfee00, rc 0) 00000100:00100000:1.0:1787560493.089874:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5802450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:9489:x1874392862723712:12345-0@lo:101: Request processed in 705us (3765us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560493.089903:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787560493.094122:0:9489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafe0687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862723712:0@lo:101: 00010000:00010000:3.0:1787560493.094165:0:9489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f33b5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33b61 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560493.094181:0:9489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f33b5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33b61 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560493.094572:0:9489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafe0687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862723968:0@lo:501: 00000100:00100000:3.0:1787560493.094651:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560493.094698:0:9489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc59570c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560493.094812:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862723968 00000100:00100000:0.0:1787560493.094821:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862723968 00000100:00100000:0.0:1787560493.094888:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787560493.094911:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5801450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:9489:x1874392862723968:12345-0@lo:501: 00000100:00100000:0.0:1787560493.095076:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5801450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:9489:x1874392862723968:12345-0@lo:501: Request processed in 168us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560493.095085:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787560493.095177:0:9489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafe0687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862723968:0@lo:501: 00000100:00100000:3.0:1787560493.095223:0:9489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafe0687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862724096:0@lo:503: 00000100:00100000:3.0:1787560493.095267:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560493.095403:0:9489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc59570c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560493.098621:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862724096 00000100:00100000:1.0:1787560493.098641:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862724096 00000100:00100000:1.0:1787560493.098726:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787560493.098740:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5801850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:9489:x1874392862724096:12345-0@lo:503: 00000100:00100000:1.0:1787560493.098978:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5801850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:9489:x1874392862724096:12345-0@lo:503: Request processed in 240us (3709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560493.098985:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787560493.099903:0:9489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafe0687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862724096:0@lo:503: 00000040:00080000:3.0:1787560493.100268:0:9489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787560493.100398:0:9489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafe0687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862724224:0@lo:502: 00000100:00100000:3.0:1787560493.100506:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560493.100557:0:9489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc59570c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560493.101098:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862724224 00000100:00100000:0.0:1787560493.101107:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862724224 00000100:00100000:0.0:1787560493.101176:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787560493.101187:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5803450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:9489:x1874392862724224:12345-0@lo:502: 00000100:00100000:0.0:1787560493.101346:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5803450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:9489:x1874392862724224:12345-0@lo:502: Request processed in 160us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560493.101354:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787560493.101377:0:9489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafe0687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862724224:0@lo:502: 00000040:00080000:2.0:1787560493.101756:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787560493.101788:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787560493.101802:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787560493.101813:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787560493.101825:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787560493.101836:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787560493.101878:0:9489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862724352:0@lo:502: 00000100:00100000:2.0:1787560493.101925:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560493.102743:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862724352 00000100:00100000:1.0:1787560493.102753:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862724352 00000100:00100000:1.0:1787560493.102820:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787560493.102830:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5802850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:9489:x1874392862724352:12345-0@lo:502: 00000100:00100000:1.0:1787560493.102979:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5802850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:9489:x1874392862724352:12345-0@lo:502: Request processed in 151us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560493.102987:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787560493.103088:0:9489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffb8aff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787560493.103114:0:9489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862724352:0@lo:502: 00000040:00080000:2.0:1787560493.103190:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787560493.103204:0:9489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000100:00100000:3.0:1787560493.108390:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787560493.108427:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafe0684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862724480:0@lo:41: 00000100:00100000:3.0:1787560493.108832:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560493.108986:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862724480 00000100:00100000:0.0:1787560493.108997:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862724480 00000100:00100000:0.0:1787560493.109069:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787560493.109081:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862724480:12345-0@lo:41: 00000004:00000024:0.0:1787560493.109129:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1787560493.109195:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862724480:12345-0@lo:41: Request processed in 116us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560493.109204:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787560493.109790:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafe0684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862724480:0@lo:41: 00000020:01000000:0.0:1787560493.110405:0:9503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787560493.110415:0:9503:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1787560493.110423:0:9503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560493.110427:0:9503:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787560493.110458:0:9503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787560493.110486:0:9503:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9caec2d019b8) 00000020:00000080:0.0:1787560493.110516:0:9503:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787560493.110525:0:9503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787560493.110605:0:9503:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9caec1ef6000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787560493.110622:0:9503:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787560493.110631:0:9503:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4642c20bf2f33b6f 00010000:00010000:0.0:1787560493.114770:0:9503:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:0.0:1787560493.115178:0:9503:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1787560493.119234:0:9503:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787560493.120080:0:9503:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1787560493.130684:0:9503:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1787560493.130952:0:9503:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1787560493.145465:0:9503:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1787560493.151183:0:9503:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787560493.151202:0:9503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560493.151210:0:9503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560493.151212:0:9503:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787560493.151216:0:9503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560493.151221:0:9503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560493.151223:0:9503:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787560493.151226:0:9503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787560493.151229:0:9503:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787560493.151261:0:9503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560493.151264:0:9503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560493.151265:0:9503:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787560493.151269:0:9503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787560493.151646:0:9489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1787560493.151690:0:9489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787560493.151714:0:9489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f33b5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33b61 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.151729:0:9489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f33b5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33b61 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560493.151740:0:9489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9caec1ef6000 from 1 10000000:01000000:2.0:1787560493.151755:0:9489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787560493.151801:0:9489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca48c00/0x4642c20bf2f33b76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.151810:0:9489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffca48c00/0x4642c20bf2f33b76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.151823:0:9489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffca48c00/0x4642c20bf2f33b76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560493.151851:0:9489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862724608:0@lo:101: 00000100:00100000:2.0:1787560493.151956:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560493.152019:0:9489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffb8af840 going to sleep for 11 seconds 00000100:00100000:2.0:1787560493.152056:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862724608 00000100:00100000:2.0:1787560493.152065:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862724608 00000100:00100000:2.0:1787560493.152119:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787560493.152129:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5800c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:9489:x1874392862724608:12345-0@lo:101: 00010000:00010000:2.0:1787560493.152145:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560493.152160:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca49a00/0x4642c20bf2f33b7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33b76 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.152187:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca49a00/0x4642c20bf2f33b7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33b76 expref: 16 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.152198:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca49a00/0x4642c20bf2f33b7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33b76 expref: 16 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.152207:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca49a00, rc 0) 00000100:00100000:2.0:1787560493.152256:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5800c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:9489:x1874392862724608:12345-0@lo:101: Request processed in 127us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560493.152274:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787560493.152331:0:9489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862724608:0@lo:101: 00010000:00010000:2.0:1787560493.152346:0:9489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffca48c00/0x4642c20bf2f33b76 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33b7d expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560493.152355:0:9489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffca48c00/0x4642c20bf2f33b76 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33b7d expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560493.153562:0:9489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862724736:0@lo:501: 00000100:00100000:2.0:1787560493.154653:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560493.154707:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862724736 00000100:00100000:3.0:1787560493.154720:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862724736 00000100:00100000:3.0:1787560493.154756:0:9489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffb8af840 going to sleep for 11 seconds 00000100:00100000:2.0:1787560493.154974:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787560493.154989:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5803850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:9489:x1874392862724736:12345-0@lo:501: 00000100:00100000:2.0:1787560493.155152:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5803850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:9489:x1874392862724736:12345-0@lo:501: Request processed in 166us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560493.155160:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787560493.155221:0:9489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862724736:0@lo:501: 00000100:00100000:2.0:1787560493.155271:0:9489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862724864:0@lo:503: 00000100:00100000:2.0:1787560493.155321:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560493.155337:0:9489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffb8af840 going to sleep for 11 seconds 00000100:00100000:2.0:1787560493.155354:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862724864 00000100:00100000:2.0:1787560493.155359:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862724864 00000100:00100000:2.0:1787560493.155403:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787560493.155412:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5800450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:9489:x1874392862724864:12345-0@lo:503: 00000100:00100000:2.0:1787560493.156789:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5800450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:9489:x1874392862724864:12345-0@lo:503: Request processed in 1368us (1457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560493.156812:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787560493.156911:0:9489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862724864:0@lo:503: 00000040:00080000:2.0:1787560493.157244:0:9489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787560493.157332:0:9489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862724992:0@lo:502: 00000100:00100000:2.0:1787560493.157381:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560493.157463:0:9489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffb8af840 going to sleep for 11 seconds 00000100:00100000:3.0:1787560493.159115:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862724992 00000100:00100000:3.0:1787560493.159132:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862724992 00000100:00100000:3.0:1787560493.159282:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787560493.159296:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5800050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:9489:x1874392862724992:12345-0@lo:502: 00000100:00100000:2.0:1787560493.163721:0:9489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862724992:0@lo:502: 00000100:00100000:3.0:1787560493.164266:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5800050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:9489:x1874392862724992:12345-0@lo:502: Request processed in 4299us (6211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560493.164284:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000040:00080000:2.0:1787560493.164423:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787560493.164498:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787560493.164549:0:9489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862725120:0@lo:502: 00000100:00100000:2.0:1787560493.164696:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560493.164821:0:9489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffb8af840 going to sleep for 11 seconds 00000100:00100000:1.0:1787560493.164971:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862725120 00000100:00100000:1.0:1787560493.164982:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862725120 00000100:00100000:1.0:1787560493.165038:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787560493.165049:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5802c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:9489:x1874392862725120:12345-0@lo:502: 00000100:00100000:1.0:1787560493.165210:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5802c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:9489:x1874392862725120:12345-0@lo:502: Request processed in 163us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560493.165219:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787560493.165393:0:9489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862725120:0@lo:502: 00000040:00080000:2.0:1787560493.165472:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787560493.165482:0:9489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787560493.170830:0:9507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787560493.170851:0:9507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560493.170854:0:9507:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787560493.171416:0:9507:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9caec1ef6000 00000020:00000080:2.0:1787560493.171420:0:9507:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787560493.171477:0:9507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560493.171481:0:9507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560493.171483:0:9507:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787560493.171486:0:9507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787560493.172546:0:9489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787560493.172590:0:9489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787560493.172613:0:9489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca48c00/0x4642c20bf2f33b76 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33b7d expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560493.172629:0:9489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffca48c00/0x4642c20bf2f33b76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33b7d expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560493.172701:0:9489:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787560493.172722:0:9489:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9caec1ef6000 10000000:01000000:3.0:1787560493.172725:0:9489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9caec1ef6000 10000000:01000000:3.0:1787560493.172729:0:9489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787560493.172736:0:9489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9caec1ef6000 from 1 10000000:01000000:3.0:1787560493.172739:0:9489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787560493.172788:0:9489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6400/0x4642c20bf2f33b84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560493.172798:0:9489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6400/0x4642c20bf2f33b84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560493.172812:0:9489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6400/0x4642c20bf2f33b84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560493.172842:0:9489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafe0684700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862725248:0@lo:101: 00000100:00100000:3.0:1787560493.173332:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560493.173393:0:9489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc5955f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787560493.173726:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862725248 00000100:00100000:1.0:1787560493.173749:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862725248 00000100:00100000:1.0:1787560493.173823:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787560493.173834:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:9489:x1874392862725248:12345-0@lo:101: 00010000:00010000:1.0:1787560493.173853:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560493.173881:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffcbff600/0x4642c20bf2f33b8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33b84 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.173911:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffcbff600/0x4642c20bf2f33b8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33b84 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.173922:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffcbff600/0x4642c20bf2f33b8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33b84 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.173941:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbff600, rc 0) 00000100:00100000:1.0:1787560493.174001:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:9489:x1874392862725248:12345-0@lo:101: Request processed in 168us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560493.174008:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787560493.174180:0:9489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafe0684700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862725248:0@lo:101: 00010000:00010000:3.0:1787560493.174199:0:9489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6400/0x4642c20bf2f33b84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33b8b expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560493.174209:0:9489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6400/0x4642c20bf2f33b84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33b8b expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560493.174326:0:9489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafe0684700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862725376:0@lo:501: 00000100:00100000:3.0:1787560493.174374:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560493.174406:0:9489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc5955f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787560493.174472:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862725376 00000100:00100000:1.0:1787560493.174478:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862725376 00000100:00100000:1.0:1787560493.174515:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787560493.174523:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:9489:x1874392862725376:12345-0@lo:501: 00000100:00100000:1.0:1787560493.174651:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:9489:x1874392862725376:12345-0@lo:501: Request processed in 128us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560493.174658:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787560493.174690:0:9489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafe0684700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862725376:0@lo:501: 00000100:00100000:1.0:1787560493.174720:0:9489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1faca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862725504:0@lo:503: 00000100:00100000:1.0:1787560493.174765:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560493.174783:0:9489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc7ed40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560493.174802:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862725504 00000100:00100000:1.0:1787560493.174806:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862725504 00000100:00100000:1.0:1787560493.174822:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787560493.174828:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:9489:x1874392862725504:12345-0@lo:503: 00000100:00100000:1.0:1787560493.174984:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:9489:x1874392862725504:12345-0@lo:503: Request processed in 155us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560493.174991:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787560493.175036:0:9489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1faca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862725504:0@lo:503: 00000040:00080000:1.0:1787560493.175318:0:9489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787560493.175401:0:9489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1faca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862725632:0@lo:502: 00000100:00100000:1.0:1787560493.175474:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560493.175490:0:9489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc7ed40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560493.175505:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862725632 00000100:00100000:1.0:1787560493.175508:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862725632 00000100:00100000:1.0:1787560493.175529:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787560493.175535:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:9489:x1874392862725632:12345-0@lo:502: 00000100:00100000:1.0:1787560493.175614:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:9489:x1874392862725632:12345-0@lo:502: Request processed in 79us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560493.175621:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787560493.175660:0:9489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1faca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862725632:0@lo:502: 00000040:00080000:1.0:1787560493.176653:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787560493.176699:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787560493.176713:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787560493.176725:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787560493.176752:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787560493.176767:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787560493.176779:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787560493.176792:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787560493.176817:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787560493.176829:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787560493.176842:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787560493.176855:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787560493.177085:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787560493.177102:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787560493.177117:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787560493.177131:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787560493.177146:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787560493.177158:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787560493.177169:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787560493.177179:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787560493.177202:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787560493.177216:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787560493.177228:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787560493.177241:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787560493.177255:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1787560493.177268:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1787560493.177279:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1787560493.177291:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1787560493.177303:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1787560493.177315:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1787560493.177326:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1787560493.177580:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1787560493.177606:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1787560493.177621:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1787560493.177637:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1787560493.177650:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1787560493.177677:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:1.0:1787560493.177693:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1787560493.177706:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:1.0:1787560493.177718:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:1.0:1787560493.177730:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:1.0:1787560493.177755:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:1.0:1787560493.177769:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:1.0:1787560493.177783:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:1.0:1787560493.177799:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:1.0:1787560493.177813:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:1.0:1787560493.178412:0:9489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1faca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862725760:0@lo:502: 00000100:00100000:1.0:1787560493.178649:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560493.181767:0:9489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc7ed40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560493.184662:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862725760 00000100:00100000:2.0:1787560493.184684:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862725760 00000100:00100000:2.0:1787560493.184772:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787560493.184786:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:9489:x1874392862725760:12345-0@lo:502: 00000100:00100000:2.0:1787560493.185173:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:9489:x1874392862725760:12345-0@lo:502: Request processed in 389us (6522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560493.185183:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787560493.185316:0:9489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1faca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862725760:0@lo:502: 00000040:00080000:1.0:1787560493.185425:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:1.0:1787560493.185470:0:9489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1787560493.188604:0:9508:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787560493.188637:0:9508:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9caec2fb0000) 00000020:00000080:3.0:1787560493.188670:0:9508:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1787560493.188805:0:9508:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9caec1ef6000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787560493.188811:0:9508:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9caec1ef6000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787560493.188813:0:9508:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9caec1ef6000 3 00010000:00080000:3.0:1787560493.188853:0:9508:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9caec2fc0800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.129@tcp at head 00010000:00010000:3.0:1787560493.191082:0:9508:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1787560493.191352:0:9508:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787560493.191407:0:9508:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787560493.191423:0:9508:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x4642c20bf2f33b99 00000100:00080000:3.0:1787560493.191462:0:9508:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787560493.191469:0:9508:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9caec2fc0800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787560493.191518:0:9508:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafe0684380 x1874392862725888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787560493.191546:0:9508:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787560493.196875:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafe0684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1874392862725888:0@lo:38: 00000100:00100000:2.0:1787560493.196989:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560493.197190:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862726016:0@lo:400: 00000100:00100000:2.0:1787560493.197221:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560493.197240:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862726528:0@lo:400: 00000100:00100000:2.0:1787560493.197259:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560493.197278:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787560493.197283:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862726400:0@lo:400: 00000100:00100000:2.0:1787560493.197303:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560493.197323:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862726144:0@lo:400: 00000100:00100000:2.0:1787560493.197351:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560493.197372:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862726656:0@lo:400: 00000100:00100000:2.0:1787560493.197397:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560493.197418:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787560493.197423:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862726272:0@lo:400: 00000100:00100000:2.0:1787560493.197476:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560493.197487:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862726784:0@lo:400: 00000100:00100000:2.0:1787560493.197508:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560493.197546:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862725888 00000100:00100000:2.0:1787560493.197555:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862725888 00000100:00100000:2.0:1787560493.197588:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862726016 00000100:00100000:2.0:1787560493.197592:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862726016 00000100:00100000:2.0:1787560493.197617:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862726528 00000100:00100000:2.0:1787560493.197633:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862726528 00000100:00100000:2.0:1787560493.197662:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862726400 00000100:00100000:2.0:1787560493.197665:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862726400 00000100:00100000:2.0:1787560493.197677:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862726272 00000100:00100000:2.0:1787560493.197680:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862726272 00000100:00100000:2.0:1787560493.197697:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787560493.197706:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862726016:12345-0@lo:400: 00000100:00100000:2.0:1787560493.197770:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862726016:12345-0@lo:400: Request processed in 64us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560493.197778:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787560493.197796:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787560493.197802:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862726528:12345-0@lo:400: 00000100:00100000:2.0:1787560493.197829:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862726528:12345-0@lo:400: Request processed in 28us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560493.197835:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787560493.197846:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787560493.197852:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862726400:12345-0@lo:400: 00000100:00100000:2.0:1787560493.197878:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862726400:12345-0@lo:400: Request processed in 26us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560493.197884:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787560493.197894:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787560493.197900:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeabab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862726272:12345-0@lo:400: 00000100:00100000:2.0:1787560493.197929:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeabab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862726272:12345-0@lo:400: Request processed in 30us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560493.197947:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787560493.197959:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787560493.197963:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1874392862725888:12345-0@lo:38: 00010000:00080000:2.0:1787560493.197994:0:6499:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:2.0:1787560493.198032:0:6499:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4642c20bf2f33ba0 00000004:00100000:2.0:1787560493.198051:0:6499:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787560493.198088:0:6499:0:(import.c:65:import_set_state_nolock()) ffff9caec1c44000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787560493.198130:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1874392862725888:12345-0@lo:38: Request processed in 165us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560493.198136:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787560493.198162:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862726144 00000100:00100000:2.0:1787560493.198166:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862726144 00000100:00100000:2.0:1787560493.198196:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787560493.198203:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862726144:12345-0@lo:400: 00000100:00100000:2.0:1787560493.198236:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862726144:12345-0@lo:400: Request processed in 34us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560493.198242:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787560493.198261:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862726656 00000100:00100000:2.0:1787560493.198265:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862726656 00000100:00100000:2.0:1787560493.198291:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862726784 00000100:00100000:2.0:1787560493.198295:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862726784 00000100:00100000:2.0:1787560493.198309:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787560493.198315:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862726656:12345-0@lo:400: 00000100:00100000:2.0:1787560493.198346:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862726656:12345-0@lo:400: Request processed in 31us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560493.198352:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787560493.198363:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787560493.198369:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862726784:12345-0@lo:400: 00000100:00100000:2.0:1787560493.198394:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862726784:12345-0@lo:400: Request processed in 26us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560493.198410:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787560493.198457:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787560493.198461:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787560493.198464:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787560493.198499:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caffcaa8380 x1874392862726400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560493.198517:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862726400:0@lo:400: 00010000:00080000:2.0:1787560493.198531:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caffcaa9180 x1874392862726016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560493.198540:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862726016:0@lo:400: 00010000:00080000:2.0:1787560493.198551:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caffcaa8e00 x1874392862726528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560493.198560:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862726528:0@lo:400: 00010000:00080000:2.0:1787560493.198595:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caffcaa8a80 x1874392862726272/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560493.198604:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862726272:0@lo:400: 00010000:00080000:2.0:1787560493.198613:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caffcaa8000 x1874392862726784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560493.198621:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862726784:0@lo:400: 00000100:00100000:2.0:1787560493.198631:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862726144:0@lo:400: 00010000:00080000:2.0:1787560493.198641:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caffcaab800 x1874392862726656/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560493.198650:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862726656:0@lo:400: 00010000:00080000:2.0:1787560493.198694:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cafe0684380 x1874392862725888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787560503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560493.198703:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787560493.198711:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787560493.198719:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787560493.198725:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787560493.198728:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec2fc0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787560493.198734:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafe0684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1874392862725888:0@lo:38: 00000020:01000004:2.0:1787560493.199036:0:9508:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787560493.199054:0:9508:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9caff49099b8) 00000020:00000080:2.0:1787560493.199076:0:9508:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:2.0:1787560493.199178:0:9508:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9caec1ef6000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787560493.199183:0:9508:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9caec1ef6000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787560493.199186:0:9508:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9caec1ef6000 3 00010000:00080000:2.0:1787560493.199220:0:9508:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9caffca5a000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.129@tcp at head 00010000:00010000:2.0:1787560493.207734:0:9508:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:2.0:1787560493.207993:0:9508:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1787560493.208052:0:9508:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787560493.208067:0:9508:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x4642c20bf2f33bae 00000100:00080000:2.0:1787560493.208080:0:9508:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787560493.208088:0:9508:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9caffca5a000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560493.208135:0:9508:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caec2005180 x1874392862726912/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787560493.208166:0:9508:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1787560493.208301:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2006a00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9510:1874392862727040:0@lo:901: 00000100:00100000:2.0:1787560493.208385:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560493.208469:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffb8af600 going to sleep for 11 seconds 00000100:00100000:3.0:1787560493.208689:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3622:1874392862726912:0@lo:38: 00000100:00100000:3.0:1787560493.208729:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560493.210816:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862727040 00000100:00100000:0.0:1787560493.210836:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862727040 00000100:00100000:0.0:1787560493.210915:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787560493.210928:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9510:x1874392862727040:12345-0@lo:901: 00000100:00100000:0.0:1787560493.211103:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9510:x1874392862727040:12345-0@lo:901: Request processed in 177us (2718us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560493.211110:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787560493.215138:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862726912 00000100:00100000:2.0:1787560493.215158:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862726912 00000100:00100000:2.0:1787560493.215657:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787560493.215669:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1874392862726912:12345-0@lo:38: 00010000:00080000:2.0:1787560493.215712:0:6499:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 212 last 0 00000100:00080000:1.0:1787560493.216487:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1787560493.217719:0:6499:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x4642c20bf2f33bb5 00000004:00100000:2.0:1787560493.217748:0:6499:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787560493.217804:0:6499:0:(import.c:65:import_set_state_nolock()) ffff9caec3217800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787560493.217959:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1874392862726912:12345-0@lo:38: Request processed in 2288us (9226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560493.217972:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787560493.218086:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec2005180 x1874392862726912/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787560503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560493.218100:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787560493.218112:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1787560493.218122:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787560493.218128:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787560493.218130:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffca5a000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787560493.218138:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3622:1874392862726912:0@lo:38: 00010000:00080000:3.0:1787560493.220269:0:9510:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec2006a00 x1874392862727040/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787560509 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560493.220291:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2006a00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9510:1874392862727040:0@lo:901: 00000040:00080000:3.0:1787560493.220653:0:9508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:1.0:1787560493.220836:0:9489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:1.0:1787560493.220872:0:9489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787560493.220900:0:9489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6400/0x4642c20bf2f33b84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33b8b expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.220912:0:9489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6400/0x4642c20bf2f33b84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33b8b expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787560493.220997:0:9489:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787560493.220999:0:9489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787560493.221001:0:9489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787560493.221002:0:9489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787560493.221003:0:9489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787560493.221005:0:9489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787560493.221006:0:9489:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787560493.221008:0:9489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787560493.221009:0:9489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787560493.221011:0:9489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787560493.221013:0:9489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787560493.221017:0:9489:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1787560493.221021:0:9489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787560493.221022:0:9489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787560493.221023:0:9489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787560493.221025:0:9489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787560493.221026:0:9489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787560493.221027:0:9489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787560493.221028:0:9489:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787560493.221029:0:9489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787560493.221030:0:9489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787560493.221031:0:9489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787560493.221032:0:9489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787560493.221060:0:9489:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787560493.221081:0:9489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1faca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862727168:0@lo:253: 00000100:00100000:1.0:1787560493.221163:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560493.221209:0:9489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec31eccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560493.221233:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862727168 00000100:00100000:1.0:1787560493.221240:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862727168 00000100:00100000:1.0:1787560493.221289:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787560493.221299:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:9489:x1874392862727168:12345-0@lo:253: 20000000:01000000:1.0:1787560493.221329:0:6492:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787560493.221360:0:6492:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787560493.229575:0:6492:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787560493.229619:0:6492:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787560493.230406:0:6514:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787560493.230415:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787560493.230466:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33bbc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.230490:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cb0021ffa00/0x4642c20bf2f33ab2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33aab expref: 17 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.230591:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cb0021ffe00/0x4642c20bf2f33af8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33aea expref: 17 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.230600:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33bbc lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560493.230717:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cb0021ffe00/0x4642c20bf2f33af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f33aea expref: 17 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560493.230734:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cb0021ffe00/0x4642c20bf2f33af8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f33aea expref: 17 pid: 6494 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560493.230845:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafe0684000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6514:1874392862727296:0@lo:104: 00000100:00100000:3.0:1787560493.230903:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787560493.230990:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cb0021ffa00/0x4642c20bf2f33ab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f33aab expref: 17 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560493.230999:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cb0021ffa00/0x4642c20bf2f33ab2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f33aab expref: 17 pid: 6493 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560493.231008:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafe0686d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6514:1874392862727424:0@lo:104: 00000100:00100000:3.0:1787560493.231032:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560493.231048:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc4cc4180 going to sleep for 11 seconds 00000100:00100000:1.0:1787560493.231117:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:9489:x1874392862727168:12345-0@lo:253: Request processed in 9816us (9951us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560493.231130:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787560493.231233:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862727296 00000100:00100000:0.0:1787560493.231242:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862727296 00000100:00100000:0.0:1787560493.231284:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862727424 00000100:00100000:0.0:1787560493.231286:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862727424 00000100:00100000:0.0:1787560493.231301:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787560493.231310:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0685880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+4:6514:x1874392862727296:12345-0@lo:104: 00010000:00010000:0.0:1787560493.231326:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe800/0x4642c20bf2f33aea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33af8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.231829:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787560493.231838:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0685880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+4:6514:x1874392862727296:12345-0@lo:104: Request processed in 528us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560493.231846:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787560493.231866:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787560493.231873:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0685f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:6514:x1874392862727424:12345-0@lo:104: 00010000:00010000:0.0:1787560493.231883:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff000/0x4642c20bf2f33aab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33ab2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.231920:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787560493.231925:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0685f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:6514:x1874392862727424:12345-0@lo:104: Request processed in 54us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560493.231942:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1787560493.231971:0:9501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787560493.231978:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe800/0x4642c20bf2f33aea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33af8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.231986:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021fe800 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:0.0:1787560493.231991:0:9501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe800/0x4642c20bf2f33aea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33af8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.231999:0:9501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe800/0x4642c20bf2f33aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33af8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787560493.232007:0:9501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe800/0x4642c20bf2f33aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33af8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560493.232014:0:9501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787560493.232046:0:9501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe800/0x4642c20bf2f33aea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33af8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.232052:0:9501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787560493.232075:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe800/0x4642c20bf2f33aea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33af8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.232081:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe800/0x4642c20bf2f33aea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33af8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.232100:0:9501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560493.232103:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff000/0x4642c20bf2f33aab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33ab2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.232108:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ff000 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:0.0:1787560493.232111:0:9501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff000/0x4642c20bf2f33aab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33ab2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.232123:0:9501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff000/0x4642c20bf2f33aab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33ab2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787560493.232129:0:9501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff000/0x4642c20bf2f33aab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33ab2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560493.232134:0:9501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787560493.232148:0:9501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff000/0x4642c20bf2f33aab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33ab2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.232153:0:9501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787560493.232159:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff000/0x4642c20bf2f33aab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33ab2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.232166:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff000/0x4642c20bf2f33aab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33ab2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560493.232184:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560493.232186:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560493.232188:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560493.232192:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560493.232276:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafe0684000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6514:1874392862727296:0@lo:104: 00000100:00100000:3.0:1787560493.232286:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafe0686d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6514:1874392862727424:0@lo:104: 00010000:00010000:3.0:1787560493.232311:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33bbc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560493.233553:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862727680:0@lo:103: 00000100:00100000:1.0:1787560493.233611:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862727552:0@lo:103: 00000100:00100000:0.0:1787560493.233629:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560493.233718:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862727680 00000100:00100000:3.0:1787560493.233728:0:9502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862727680 00010000:00010000:3.0:1787560493.233768:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cb0021ffa00/0x4642c20bf2f33ab2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33aab expref: 17 pid: 6493 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560493.233807:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787560493.233817:0:9502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:3624:x1874392862727680:12345-0@lo:103: 00010000:00010000:3.0:1787560493.233833:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560493.233839:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cb0021ffa00/0x4642c20bf2f33ab2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33aab expref: 17 pid: 6493 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560493.233851:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cb0021ffa00/0x4642c20bf2f33ab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f33aab expref: 17 pid: 6493 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560493.233870:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cb0021ffa00/0x4642c20bf2f33ab2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f33aab expref: 17 pid: 6493 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560493.233910:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560493.236483:0:9489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1faca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9489:1874392862727168:0@lo:253: 10000000:01000000:2.0:1787560493.237031:0:9489:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787560493.237036:0:9489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787560493.237038:0:9489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787560493.237039:0:9489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560493.237041:0:9489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560493.237042:0:9489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560493.237043:0:9489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560493.237045:0:9489:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787560493.237047:0:9489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787560493.237049:0:9489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787560493.237050:0:9489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560493.237051:0:9489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787560493.237070:0:9489:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1787560493.241532:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560493.241791:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862727552 00000100:00100000:1.0:1787560493.241805:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862727552 00010000:00010000:1.0:1787560493.241877:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cb0021ffe00/0x4642c20bf2f33af8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33aea expref: 17 pid: 6494 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560493.242101:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787560493.242113:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1fac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:3623:x1874392862727552:12345-0@lo:103: 00010000:00010000:1.0:1787560493.242133:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560493.242140:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cb0021ffe00/0x4642c20bf2f33af8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33aea expref: 17 pid: 6494 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.242154:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cb0021ffe00/0x4642c20bf2f33af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f33aea expref: 17 pid: 6494 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.242175:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cb0021ffe00/0x4642c20bf2f33af8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f33aea expref: 17 pid: 6494 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.242196:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33bbc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.242205:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33bbc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787560493.242225:0:6486:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011811242s 00010000:00010000:1.0:1787560493.242249:0:6486:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33bbc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.242256:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33bbc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.242264:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33bbc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.242271:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33bbc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.242277:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafc0030600 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560493.242282:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33bbc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.242291:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33bbc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.242311:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33bbc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.242324:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560493.242688:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1fac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:3623:x1874392862727552:12345-0@lo:103: Request processed in 575us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560493.242696:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787560493.242758:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862727552:0@lo:103: 00010000:00010000:1.0:1787560493.242792:0:6514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33bbc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.242801:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33bbc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560493.242816:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33bbc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560493.243315:0:9502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:3624:x1874392862727680:12345-0@lo:103: Request processed in 9498us (9684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560493.243324:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787560493.244553:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862727680:0@lo:103: 00080000:10000000:3.0:1787560493.250035:0:9489:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1787560493.250210:0:9489:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1787560493.250380:0:9489:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1787560493.253124:0:9489:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1787560493.253495:0:9489:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1787560493.256049:0:9489:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1787560493.260904:0:9489:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787560493.280578:0:9489:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787560493.280592:0:9489:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787560493.280651:0:9489:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787560493.280723:0:9489:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.129@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787560493.280745:0:9489:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1787560493.280773:0:9489:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1787560493.281792:0:9489:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787560493.282063:0:9489:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1787560494.068809:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787560494.361111:0:9565:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787560494.361346:0:9565:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787560494.647799:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787560494.647839:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862727808:0@lo:13: 00000100:00100000:3.0:1787560494.647958:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560494.648142:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862727808 00000100:00100000:0.0:1787560494.648154:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862727808 00000100:00100000:0.0:1787560494.648231:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787560494.648243:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0686d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862727808:12345-0@lo:13: 00002000:00000024:0.0:1787560494.648285:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560494.648360:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0686d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862727808:12345-0@lo:13: Request processed in 119us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560494.648369:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787560494.648417:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2ccc000 x1874392862727808/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560494.648468:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862727808:0@lo:13: 00000100:00100000:2.0:1787560494.653096:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787560494.653127:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862727936:0@lo:13: 00000100:00100000:2.0:1787560494.653226:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560494.653306:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862727936 00000100:00100000:2.0:1787560494.653315:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862727936 00000100:00100000:2.0:1787560494.653370:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787560494.653380:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2004700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862727936:12345-0@lo:13: 00002000:00000024:2.0:1787560494.653407:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560494.653483:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2004700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862727936:12345-0@lo:13: Request processed in 102us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560494.653491:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1787560494.653539:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2006680 x1874392862727936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560494.653561:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862727936:0@lo:13: 00010000:00010000:1.0:1787560495.094614:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560496.115617:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560497.139624:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560497.203621:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787560497.203646:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1face00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862728064:0@lo:41: 00000100:00100000:0.0:1787560497.203715:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560497.203779:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862728064 00000100:00100000:0.0:1787560497.203788:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862728064 00000100:00100000:0.0:1787560497.203947:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787560497.203959:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862728064:12345-0@lo:41: 00000004:00000024:0.0:1787560497.203992:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1787560497.204043:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862728064:12345-0@lo:41: Request processed in 86us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560497.204051:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787560497.204134:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1face00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862728064:0@lo:41: 00010000:00010000:1.0:1787560498.169969:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560498.228544:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafe0684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862728192:0@lo:41: 00000100:00100000:3.0:1787560498.228622:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560498.228704:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862728192 00000100:00100000:3.0:1787560498.228713:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862728192 00000100:00100000:3.0:1787560498.228764:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787560498.228784:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862728192:12345-0@lo:41: 00000004:00000024:3.0:1787560498.228819:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1787560498.228864:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862728192:12345-0@lo:41: Request processed in 81us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560498.228871:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787560498.228924:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862728448:0@lo:400: 00000100:00100000:3.0:1787560498.228950:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560498.228972:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787560498.228976:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862728320:0@lo:400: 00000100:00100000:3.0:1787560498.229005:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560498.229036:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874392862728960:0@lo:400: 00000100:00100000:2.0:1787560498.229050:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862728832:0@lo:400: 00000100:00100000:3.0:1787560498.229063:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560498.229088:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862729472:0@lo:400: 00000100:00100000:2.0:1787560498.229094:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560498.229122:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874392862729344:0@lo:400: 00000100:00100000:3.0:1787560498.229125:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560498.229156:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560498.229161:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862728448 00000100:00100000:3.0:1787560498.229166:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862728448 00000100:00100000:2.0:1787560498.229189:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862728960 00000100:00100000:2.0:1787560498.229195:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862728960 00000100:00100000:3.0:1787560498.229200:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862728832 00000100:00100000:3.0:1787560498.229205:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862728832 00000100:00100000:3.0:1787560498.229236:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862729472 00000100:00100000:2.0:1787560498.229297:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862729344 00000100:00100000:2.0:1787560498.229304:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862729344 00000100:00100000:2.0:1787560498.229325:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787560498.229332:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862728448:12345-0@lo:400: 00000100:00100000:2.0:1787560498.229374:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862728448:12345-0@lo:400: Request processed in 43us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560498.229381:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787560498.229394:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787560498.229399:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874392862728960:12345-0@lo:400: 00000100:00100000:2.0:1787560498.229427:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874392862728960:12345-0@lo:400: Request processed in 28us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560498.229461:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787560498.229475:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787560498.229480:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862728832:12345-0@lo:400: 00000100:00100000:2.0:1787560498.229611:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862728832:12345-0@lo:400: Request processed in 129us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560498.229617:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787560498.229630:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787560498.229636:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874392862729344:12345-0@lo:400: 00000100:00100000:2.0:1787560498.230005:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874392862729344:12345-0@lo:400: Request processed in 370us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560498.230012:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1787560498.230032:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787560498.230036:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787560498.230059:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2004380 x1874392862728832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560498.230074:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862728832:0@lo:400: 00010000:00080000:2.0:1787560498.230085:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcaabb80 x1874392862729344/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560498.230095:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874392862729344:0@lo:400: 00000100:00100000:3.0:1787560498.230099:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862729472 00000100:00100000:3.0:1787560498.230143:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787560498.230152:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874392862729472:12345-0@lo:400: 00000100:00100000:3.0:1787560498.230192:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874392862729472:12345-0@lo:400: Request processed in 42us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560498.230199:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787560498.230221:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862728320 00000100:00100000:3.0:1787560498.230225:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862728320 00000100:00100000:3.0:1787560498.230273:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787560498.230280:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:3626:x1874392862728320:12345-0@lo:400: 00000100:00100000:3.0:1787560498.230311:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:3626:x1874392862728320:12345-0@lo:400: Request processed in 32us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560498.230317:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787560498.230360:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862728576:0@lo:400: 00000100:00100000:3.0:1787560498.230387:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560498.230408:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862729088:0@lo:400: 00000100:00100000:3.0:1787560498.230447:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560498.230469:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787560498.230476:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2007b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862728704:0@lo:400: 00000100:00100000:3.0:1787560498.230500:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560498.230517:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862729216:0@lo:400: 00000100:00100000:3.0:1787560498.230536:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560498.230561:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862728576 00000100:00100000:3.0:1787560498.230565:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862728576 00000100:00100000:3.0:1787560498.230588:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787560498.230595:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862728576:12345-0@lo:400: 00000100:00100000:3.0:1787560498.230629:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862728576:12345-0@lo:400: Request processed in 34us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560498.230634:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787560498.230653:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862729088 00000100:00100000:3.0:1787560498.230656:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862729088 00000100:00100000:3.0:1787560498.230679:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862729216 00000100:00100000:3.0:1787560498.230682:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862729216 00000100:00100000:3.0:1787560498.230696:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787560498.230701:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862729088:12345-0@lo:400: 00000100:00100000:3.0:1787560498.230740:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862729088:12345-0@lo:400: Request processed in 38us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560498.230748:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787560498.230758:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787560498.230763:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862729216:12345-0@lo:400: 00000100:00100000:3.0:1787560498.230787:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862729216:12345-0@lo:400: Request processed in 24us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560498.230794:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1787560498.230820:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787560498.230824:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787560498.230844:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcaab800 x1874392862729216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560498.230857:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862729216:0@lo:400: 00000100:00100000:3.0:1787560498.230868:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862728576:0@lo:400: 00010000:00080000:3.0:1787560498.230877:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2005180 x1874392862729088/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560498.230885:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862729088:0@lo:400: 00000100:00100000:3.0:1787560498.230933:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafe0684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862728192:0@lo:41: 00010000:00080000:3.0:1787560498.230962:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2006a00 x1874392862728960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560498.230972:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874392862728960:0@lo:400: 00010000:00080000:3.0:1787560498.230983:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcaa8000 x1874392862729472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560498.230991:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862729472:0@lo:400: 00000100:00100000:3.0:1787560498.231009:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862728320:0@lo:400: 00010000:00080000:3.0:1787560498.231020:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2004e00 x1874392862728448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560498.231027:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862728448:0@lo:400: 00000100:00100000:3.0:1787560498.231048:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862728704 00000100:00100000:3.0:1787560498.231051:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862728704 00000100:00100000:3.0:1787560498.231072:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787560498.231078:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862728704:12345-0@lo:400: 00000100:00100000:3.0:1787560498.231111:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862728704:12345-0@lo:400: Request processed in 33us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560498.231117:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1787560498.231142:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2007b80 x1874392862728704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560498.231151:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2007b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862728704:0@lo:400: 00010000:00010000:1.0:1787560499.187689:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787560499.442146:0:9854:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1787560499.765275:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862729600:0@lo:13: 00000100:00100000:2.0:1787560499.765356:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560499.765456:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862729600 00000100:00100000:2.0:1787560499.765464:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862729600 00000100:00100000:2.0:1787560499.765515:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787560499.765525:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862729600:12345-0@lo:13: 00002000:00000024:2.0:1787560499.765572:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560499.765619:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862729600:12345-0@lo:13: Request processed in 93us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560499.765626:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1787560499.765671:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcaabb80 x1874392862729600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560499.765691:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862729600:0@lo:13: 00000100:00100000:2.0:1787560499.770110:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1face00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862729728:0@lo:13: 00000100:00100000:2.0:1787560499.770186:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560499.770262:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862729728 00000100:00100000:2.0:1787560499.770269:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862729728 00000100:00100000:2.0:1787560499.770314:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787560499.770324:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862729728:12345-0@lo:13: 00002000:00000024:2.0:1787560499.770348:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560499.770393:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862729728:12345-0@lo:13: Request processed in 70us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560499.770400:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1787560499.770465:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec1face00 x1874392862729728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560499.770482:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1face00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862729728:0@lo:13: 00010000:00010000:3.0:1787560500.211779:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787560500.445072:0:9906:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787560500.445304:0:9906:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1787560500.787964:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787560500.787973:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cafeab05000 from 39 10000000:01000000:3.0:1787560500.787979:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787560500.788153:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f33bc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560500.788166:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f33bc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560500.788179:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f33bc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560500.788218:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafe0684000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862729856:0@lo:101: 00000100:00100000:3.0:1787560500.788293:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560500.788395:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862729856 00000100:00100000:1.0:1787560500.788404:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862729856 00000100:00100000:1.0:1787560500.788497:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787560500.788500:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c5180 going to sleep for 11 seconds 00000100:00100000:1.0:1787560500.788510:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:6497:x1874392862729856:12345-0@lo:101: 00010000:00010000:1.0:1787560500.788525:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560500.788541:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffcbff000/0x4642c20bf2f33bca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33bc3 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560500.788569:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffcbff000/0x4642c20bf2f33bca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33bc3 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560500.788580:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffcbff000/0x4642c20bf2f33bca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33bc3 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560500.788589:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbff000, rc 0) 00000100:00100000:1.0:1787560500.788641:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:6497:x1874392862729856:12345-0@lo:101: Request processed in 135us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560500.788658:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787560500.788837:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafe0684000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862729856:0@lo:101: 00010000:00010000:3.0:1787560500.788851:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f33bc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33bca expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560500.788860:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f33bc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33bca expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560500.788930:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafe0684000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862729984:0@lo:501: 00000100:00100000:3.0:1787560500.788957:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560500.788987:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c5180 going to sleep for 11 seconds 00000100:00100000:1.0:1787560500.789170:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862729984 00000100:00100000:1.0:1787560500.789175:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862729984 00000100:00100000:1.0:1787560500.789209:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787560500.789217:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:6497:x1874392862729984:12345-0@lo:501: 00000100:00100000:1.0:1787560500.792009:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:6497:x1874392862729984:12345-0@lo:501: Request processed in 2781us (3039us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560500.792026:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787560500.792385:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafe0684000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862729984:0@lo:501: 00000100:00100000:3.0:1787560500.792534:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafe0684000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862730112:0@lo:503: 00000100:00100000:3.0:1787560500.792605:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560500.792641:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c5000 going to sleep for 11 seconds 00000100:00100000:2.0:1787560500.792697:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862730112 00000100:00100000:2.0:1787560500.792703:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862730112 00000100:00100000:2.0:1787560500.792749:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787560500.792758:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:6497:x1874392862730112:12345-0@lo:503: 00000100:00100000:2.0:1787560500.793074:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:6497:x1874392862730112:12345-0@lo:503: Request processed in 316us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560500.793082:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787560500.793145:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafe0684000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862730112:0@lo:503: 00000100:00100000:0.0:1787560500.793545:0:9926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9926:1874392862730240:0@lo:502: 00000100:00100000:0.0:1787560500.793584:0:9926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560500.793649:0:9926:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe0a659c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560500.793683:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862730240 00000100:00100000:1.0:1787560500.793688:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862730240 00000100:00100000:1.0:1787560500.793749:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787560500.793757:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:9926:x1874392862730240:12345-0@lo:502: 00000100:00100000:1.0:1787560500.793872:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:9926:x1874392862730240:12345-0@lo:502: Request processed in 115us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560500.793887:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787560500.793959:0:9926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9926:1874392862730240:0@lo:502: 00000100:00100000:0.0:1787560500.794000:0:9926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9926:1874392862730368:0@lo:502: 00000100:00100000:0.0:1787560500.794031:0:9926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560500.794206:0:9926:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe0a659c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560500.794274:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862730368 00000100:00100000:3.0:1787560500.794280:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862730368 00000100:00100000:3.0:1787560500.794303:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787560500.794309:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:9926:x1874392862730368:12345-0@lo:502: 00000100:00100000:3.0:1787560500.794422:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:9926:x1874392862730368:12345-0@lo:502: Request processed in 111us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560500.794449:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787560500.794559:0:9926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9926:1874392862730368:0@lo:502: 00000040:00080000:0.0:1787560500.794580:0:9926:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1787560500.794741:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1787560500.794767:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787560500.794778:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f33bc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33bca expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560500.794789:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f33bc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33bca expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560500.794798:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787560500.794801:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1787560500.794803:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787560500.794934:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33bd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560500.794940:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33bd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560500.794950:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33bd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560500.794959:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafe0684000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862730496:0@lo:101: 00000100:00100000:3.0:1787560500.795040:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560500.795070:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787560500.795087:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862730496 00000100:00100000:1.0:1787560500.795092:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862730496 00000100:00100000:1.0:1787560500.795119:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787560500.795127:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:6497:x1874392862730496:12345-0@lo:101: 00010000:00010000:1.0:1787560500.795136:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560500.795149:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffcbffa00/0x4642c20bf2f33bd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33bd1 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560500.795168:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffcbffa00/0x4642c20bf2f33bd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33bd1 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560500.795178:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffcbffa00/0x4642c20bf2f33bd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33bd1 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560500.795192:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbffa00, rc 0) 00000100:00100000:1.0:1787560500.795276:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:6497:x1874392862730496:12345-0@lo:101: Request processed in 149us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560500.795283:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787560500.795344:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafe0684000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862730496:0@lo:101: 00010000:00010000:2.0:1787560500.795358:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33bd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33bd8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560500.795367:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33bd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33bd8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560500.795416:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862730624:0@lo:501: 00000100:00100000:2.0:1787560500.795572:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560500.795626:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffba5e540 going to sleep for 11 seconds 00000100:00100000:0.0:1787560500.795660:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862730624 00000100:00100000:0.0:1787560500.795664:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862730624 00000100:00100000:0.0:1787560500.795727:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787560500.795735:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:6497:x1874392862730624:12345-0@lo:501: 00000100:00100000:0.0:1787560500.795983:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:6497:x1874392862730624:12345-0@lo:501: Request processed in 248us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560500.795991:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787560500.796051:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862730624:0@lo:501: 00000100:00100000:2.0:1787560500.796078:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862730752:0@lo:503: 00000100:00100000:2.0:1787560500.796115:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560500.801128:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862730752 00000100:00100000:1.0:1787560500.801143:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862730752 00000100:00100000:1.0:1787560500.801209:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787560500.801220:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:6497:x1874392862730752:12345-0@lo:503: 00000100:00100000:1.0:1787560500.801388:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:6497:x1874392862730752:12345-0@lo:503: Request processed in 170us (5271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560500.801396:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787560500.801521:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffba5e540 going to sleep for 11 seconds 00000100:00100000:2.0:1787560500.801545:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862730752:0@lo:503: 00000100:00100000:2.0:1787560500.805489:0:9927:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9927:1874392862730880:0@lo:502: 00000100:00100000:2.0:1787560500.805573:0:9927:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560500.805659:0:9927:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffba5e540 going to sleep for 11 seconds 00000100:00100000:3.0:1787560500.805771:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862730880 00000100:00100000:3.0:1787560500.805779:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862730880 00000100:00100000:3.0:1787560500.805976:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787560500.805987:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:9927:x1874392862730880:12345-0@lo:502: 00000100:00100000:3.0:1787560500.806115:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:9927:x1874392862730880:12345-0@lo:502: Request processed in 130us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560500.806123:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787560500.806201:0:9927:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9927:1874392862730880:0@lo:502: 00000020:01000000:2.0:1787560500.806231:0:9927:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787560500.806240:0:9927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560500.806242:0:9927:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787560500.806252:0:9927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787560500.806254:0:9927:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787560500.806269:0:9927:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9927:1874392862731008:0@lo:502: 00000100:00100000:2.0:1787560500.806300:0:9927:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560500.806359:0:9927:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffba5e540 going to sleep for 11 seconds 00000100:00100000:1.0:1787560500.806416:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862731008 00000100:00100000:1.0:1787560500.806421:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862731008 00000100:00100000:1.0:1787560500.806460:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787560500.806467:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd8e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:9927:x1874392862731008:12345-0@lo:502: 00000100:00100000:1.0:1787560500.806545:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd8e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:9927:x1874392862731008:12345-0@lo:502: Request processed in 78us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560500.806552:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787560500.806627:0:9927:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9927:1874392862731008:0@lo:502: 00000020:01000000:2.0:1787560500.806645:0:9927:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560500.806649:0:9927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560500.806651:0:9927:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787560500.806654:0:9927:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1787560500.806801:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1787560500.806953:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787560500.806963:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33bd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33bd8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560500.806975:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33bd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33bd8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560500.806995:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787560500.806998:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9caffba72800 from 39 10000000:01000000:1.0:1787560500.807000:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787560500.807022:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbfec00/0x4642c20bf2f33bdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560500.807029:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffcbfec00/0x4642c20bf2f33bdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560500.807037:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffcbfec00/0x4642c20bf2f33bdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560500.807047:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1fac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862731136:0@lo:101: 00000100:00100000:1.0:1787560500.807073:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560500.807104:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec31ec240 going to sleep for 11 seconds 00000100:00100000:2.0:1787560500.807150:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862731136 00000100:00100000:2.0:1787560500.807155:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862731136 00000100:00100000:2.0:1787560500.807175:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787560500.807181:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd86eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:6497:x1874392862731136:12345-0@lo:101: 00010000:00010000:2.0:1787560500.807189:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560500.807201:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca49400/0x4642c20bf2f33be6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33bdf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560500.807220:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca49400/0x4642c20bf2f33be6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33bdf expref: 18 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560500.807230:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca49400/0x4642c20bf2f33be6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33bdf expref: 18 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560500.807238:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca49400, rc 0) 00000100:00100000:2.0:1787560500.807274:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd86eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:6497:x1874392862731136:12345-0@lo:101: Request processed in 92us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560500.807281:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787560500.807342:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1fac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862731136:0@lo:101: 00010000:00010000:1.0:1787560500.807354:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffcbfec00/0x4642c20bf2f33bdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33be6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560500.807364:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffcbfec00/0x4642c20bf2f33bdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33be6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560500.807410:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1fac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862731264:0@lo:501: 00000100:00100000:1.0:1787560500.807489:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560500.807531:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec31ec240 going to sleep for 11 seconds 00000100:00100000:3.0:1787560500.807622:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862731264 00000100:00100000:3.0:1787560500.807633:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862731264 00000100:00100000:2.0:1787560500.807708:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787560500.807722:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd86e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:6497:x1874392862731264:12345-0@lo:501: 00000100:00100000:2.0:1787560500.807932:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd86e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:6497:x1874392862731264:12345-0@lo:501: Request processed in 210us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560500.807940:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787560500.808039:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1fac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862731264:0@lo:501: 00000100:00100000:1.0:1787560500.808066:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1fac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862731392:0@lo:503: 00000100:00100000:1.0:1787560500.808105:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560500.808169:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec31ec240 going to sleep for 11 seconds 00000100:00100000:0.0:1787560500.808239:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862731392 00000100:00100000:0.0:1787560500.808245:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862731392 00000100:00100000:0.0:1787560500.808268:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787560500.808274:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd86e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:6497:x1874392862731392:12345-0@lo:503: 00000100:00100000:0.0:1787560500.808355:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd86e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:6497:x1874392862731392:12345-0@lo:503: Request processed in 80us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560500.808361:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787560500.808453:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1fac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862731392:0@lo:503: 00000100:00100000:1.0:1787560500.808890:0:9928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1fac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9928:1874392862731520:0@lo:502: 00000100:00100000:1.0:1787560500.808926:0:9928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560500.808955:0:9928:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec31ec240 going to sleep for 11 seconds 00000100:00100000:3.0:1787560500.809057:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862731520 00000100:00100000:3.0:1787560500.809062:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862731520 00000100:00100000:3.0:1787560500.809095:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787560500.809101:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:9928:x1874392862731520:12345-0@lo:502: 00000100:00100000:3.0:1787560500.809180:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:9928:x1874392862731520:12345-0@lo:502: Request processed in 78us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560500.809187:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787560500.809324:0:9928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1fac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9928:1874392862731520:0@lo:502: 00000100:00100000:1.0:1787560500.809365:0:9928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1fac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9928:1874392862731648:0@lo:502: 00000100:00100000:1.0:1787560500.809397:0:9928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560500.809419:0:9928:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc5812cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560500.809479:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862731648 00000100:00100000:3.0:1787560500.809483:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862731648 00000100:00100000:3.0:1787560500.809511:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787560500.809517:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:9928:x1874392862731648:12345-0@lo:502: 00000100:00100000:3.0:1787560500.809577:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:9928:x1874392862731648:12345-0@lo:502: Request processed in 59us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560500.809585:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787560500.809660:0:9928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1fac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9928:1874392862731648:0@lo:502: 00000040:00080000:1.0:1787560500.809679:0:9928:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1787560500.809820:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1787560500.809849:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787560500.809860:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbfec00/0x4642c20bf2f33bdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33be6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560500.809870:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffcbfec00/0x4642c20bf2f33bdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33be6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560500.809888:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787560500.809892:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9caffba72800 from 6 10000000:01000000:3.0:1787560500.809895:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787560500.809919:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6000/0x4642c20bf2f33bed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560500.809928:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6000/0x4642c20bf2f33bed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560500.809955:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6000/0x4642c20bf2f33bed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560500.809968:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafe0687100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862731776:0@lo:101: 00000100:00100000:3.0:1787560500.809994:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560500.810023:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c5780 going to sleep for 11 seconds 00000100:00100000:1.0:1787560500.810122:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862731776 00000100:00100000:1.0:1787560500.810127:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862731776 00000100:00100000:1.0:1787560500.810158:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787560500.810165:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:6497:x1874392862731776:12345-0@lo:101: 00010000:00010000:1.0:1787560500.810173:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560500.810186:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffcbfe600/0x4642c20bf2f33bf4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33bed expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560500.810205:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffcbfe600/0x4642c20bf2f33bf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33bed expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560500.810215:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffcbfe600/0x4642c20bf2f33bf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33bed expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560500.810223:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbfe600, rc 0) 00000100:00100000:1.0:1787560500.810265:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+19:6497:x1874392862731776:12345-0@lo:101: Request processed in 100us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560500.810270:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787560500.810300:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafe0687100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862731776:0@lo:101: 00010000:00010000:1.0:1787560500.810311:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6000/0x4642c20bf2f33bed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33bf4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560500.810320:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6000/0x4642c20bf2f33bed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33bf4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560500.810361:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1fac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862731904:0@lo:256: 00000100:00100000:1.0:1787560500.810390:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560500.810408:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862731904 00000100:00100000:1.0:1787560500.810412:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862731904 00000100:00100000:1.0:1787560500.810458:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787560500.810466:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+19:6497:x1874392862731904:12345-0@lo:256: 20000000:01000000:1.0:1787560500.810479:0:6494:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787560500.810493:0:6494:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787560500.810497:0:6494:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1787560500.810560:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+19:6497:x1874392862731904:12345-0@lo:256: Request processed in 94us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560500.810568:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787560500.810594:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc5812cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560500.810605:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1fac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862731904:0@lo:256: 10000000:01000000:1.0:1787560500.810643:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787560500.810649:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6000/0x4642c20bf2f33bed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33bf4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560500.810665:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6000/0x4642c20bf2f33bed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33bf4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560500.810672:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1787560500.810674:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1787560500.810676:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787560500.810690:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f33bfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560500.810697:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f33bfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560500.810705:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f33bfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560500.810716:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1fac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862732032:0@lo:101: 00000100:00100000:1.0:1787560500.810739:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560500.810757:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862732032 00000100:00100000:1.0:1787560500.810760:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862732032 00000100:00100000:1.0:1787560500.810776:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787560500.810782:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+19:6497:x1874392862732032:12345-0@lo:101: 00010000:00010000:1.0:1787560500.810788:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560500.810796:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffcbff800/0x4642c20bf2f33c02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33bfb expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560500.810810:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffcbff800/0x4642c20bf2f33c02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33bfb expref: 20 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560500.810818:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffcbff800/0x4642c20bf2f33c02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33bfb expref: 20 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560500.810847:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbff800, rc 0) 00000100:00100000:1.0:1787560500.810870:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:6497:x1874392862732032:12345-0@lo:101: Request processed in 88us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560500.810876:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787560500.810908:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc5812cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560500.810918:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1fac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862732032:0@lo:101: 00010000:00010000:1.0:1787560500.810929:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f33bfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33c02 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560500.810938:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f33bfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33c02 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560500.810981:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1fac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862732160:0@lo:501: 00000100:00100000:1.0:1787560500.811003:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560500.811020:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862732160 00000100:00100000:1.0:1787560500.811023:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862732160 00000100:00100000:1.0:1787560500.811040:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787560500.811045:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:6497:x1874392862732160:12345-0@lo:501: 00000100:00100000:1.0:1787560500.811128:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:6497:x1874392862732160:12345-0@lo:501: Request processed in 82us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560500.811134:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787560500.811151:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc5812cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560500.811160:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1fac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862732160:0@lo:501: 00000100:00100000:1.0:1787560500.811181:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1fac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862732288:0@lo:503: 00000100:00100000:1.0:1787560500.811212:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560500.811232:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862732288 00000100:00100000:1.0:1787560500.811235:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862732288 00000100:00100000:1.0:1787560500.811248:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787560500.811253:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:6497:x1874392862732288:12345-0@lo:503: 00000100:00100000:1.0:1787560500.811311:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:6497:x1874392862732288:12345-0@lo:503: Request processed in 57us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560500.811317:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787560500.811341:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc5812cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560500.811352:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1fac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862732288:0@lo:503: 00000100:00100000:1.0:1787560500.811693:0:9929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1fac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9929:1874392862732416:0@lo:502: 00000100:00100000:1.0:1787560500.811724:0:9929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560500.811742:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862732416 00000100:00100000:1.0:1787560500.811745:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862732416 00000100:00100000:1.0:1787560500.811763:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787560500.811769:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:9929:x1874392862732416:12345-0@lo:502: 00000100:00100000:1.0:1787560500.811952:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:9929:x1874392862732416:12345-0@lo:502: Request processed in 182us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560500.811959:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787560500.811992:0:9929:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffbb62240 going to sleep for 11 seconds 00000100:00100000:1.0:1787560500.812004:0:9929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1fac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9929:1874392862732416:0@lo:502: 00000020:01000000:1.0:1787560500.812025:0:9929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787560500.812031:0:9929:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787560500.812038:0:9929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560500.812040:0:9929:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787560500.812044:0:9929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787560500.812048:0:9929:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:01000000:1.0:1787560500.812069:0:9929:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787560500.812077:0:9929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787560500.812092:0:9929:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9cafeabd19b8) 00000020:00000080:1.0:1787560500.812116:0:9929:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1787560500.812123:0:9929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787560500.812198:0:9929:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1787560500.812204:0:9929:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787560500.812212:0:9929:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4642c20bf2f33c10 00010000:00080000:1.0:1787560500.812240:0:9929:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9caec2f9d800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.129@tcp at head 00010000:00010000:1.0:1787560500.812493:0:9929:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1787560500.812608:0:9929:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1787560500.812619:0:9929:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1787560500.812785:0:9929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787560500.813043:0:9929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787560500.813170:0:9929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1787560500.813254:0:9929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1787560500.818977:0:9930:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787560500.818986:0:9930:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787560500.820166:0:9929:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787560500.820179:0:9929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787560500.820221:0:9929:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787560500.820250:0:9929:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4642c20bf2f33c17 00000100:00080000:3.0:1787560500.820261:0:9929:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787560500.820267:0:9929:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9caec2f9d800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787560500.820302:0:9929:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafe0685180 x1874392862732544/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787560500.820329:0:9929:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787560500.820383:0:9929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560500.820387:0:9929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560500.820389:0:9929:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787560500.820392:0:9929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560500.820396:0:9929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560500.820398:0:9929:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787560500.820401:0:9929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787560500.820402:0:9929:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787560500.820454:0:9929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafe0687100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9929:1874392862732672:0@lo:502: 00000100:00100000:3.0:1787560500.820530:0:9929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560500.820563:0:9929:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c5780 going to sleep for 11 seconds 00000100:00100000:0.0:1787560500.820722:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862732928:0@lo:400: 00000100:00100000:0.0:1787560500.820757:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560500.820778:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874392862733440:0@lo:400: 00000100:00100000:0.0:1787560500.820800:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560500.820832:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862733952:0@lo:400: 00000100:00100000:0.0:1787560500.820856:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560500.820873:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787560500.820891:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862732800:0@lo:400: 00000100:00100000:0.0:1787560500.820911:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560500.820926:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862733312:0@lo:400: 00000100:00100000:0.0:1787560500.820944:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560500.820951:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862733824:0@lo:400: 00000100:00100000:0.0:1787560500.820990:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560500.821010:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862733056:0@lo:400: 00000100:00100000:0.0:1787560500.821029:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560500.821038:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862733568:0@lo:400: 00000100:00100000:0.0:1787560500.821055:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560500.821073:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787560500.821078:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862733184:0@lo:400: 00000100:00100000:0.0:1787560500.821096:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560500.821110:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862733696:0@lo:400: 00000100:00100000:0.0:1787560500.821128:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560500.821154:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862732928 00000100:00100000:0.0:1787560500.821159:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862732928 00000100:00100000:0.0:1787560500.821195:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862733184 00000100:00100000:0.0:1787560500.821198:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862733184 00000100:00100000:0.0:1787560500.821212:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787560500.821221:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2cce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862732928:12345-0@lo:400: 00000100:00100000:0.0:1787560500.821269:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2cce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862732928:12345-0@lo:400: Request processed in 49us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560500.821276:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787560500.821290:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787560500.821296:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862733184:12345-0@lo:400: 00000100:00100000:0.0:1787560500.821323:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862733184:12345-0@lo:400: Request processed in 27us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560500.821328:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787560500.821342:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862733440 00000100:00100000:0.0:1787560500.821345:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862733440 00000100:00100000:0.0:1787560500.821369:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862733952 00000100:00100000:0.0:1787560500.821377:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862733952 00000100:00100000:0.0:1787560500.821391:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862732800 00000100:00100000:0.0:1787560500.821393:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862732800 00000100:00100000:0.0:1787560500.821408:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862733312 00000100:00100000:0.0:1787560500.821410:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862733312 00000100:00100000:0.0:1787560500.821422:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862733824 00000100:00100000:0.0:1787560500.821424:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862733824 00000100:00100000:0.0:1787560500.821463:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862733056 00000100:00100000:0.0:1787560500.821466:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862733056 00000100:00100000:0.0:1787560500.821479:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787560500.821485:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874392862733440:12345-0@lo:400: 00000100:00100000:0.0:1787560500.821513:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874392862733440:12345-0@lo:400: Request processed in 29us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560500.821519:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787560500.821531:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787560500.821537:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874392862733952:12345-0@lo:400: 00000100:00100000:0.0:1787560500.821561:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874392862733952:12345-0@lo:400: Request processed in 24us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560500.821567:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787560500.821577:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787560500.821583:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862732800:12345-0@lo:400: 00000100:00100000:0.0:1787560500.821608:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862732800:12345-0@lo:400: Request processed in 25us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560500.821614:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787560500.821625:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787560500.821630:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862733312:12345-0@lo:400: 00000100:00100000:0.0:1787560500.821654:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862733312:12345-0@lo:400: Request processed in 24us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560500.821670:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787560500.821682:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787560500.821688:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862733824:12345-0@lo:400: 00000100:00100000:0.0:1787560500.821714:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862733824:12345-0@lo:400: Request processed in 26us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560500.821720:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787560500.821730:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787560500.821736:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862733056:12345-0@lo:400: 00000100:00100000:0.0:1787560500.821760:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862733056:12345-0@lo:400: Request processed in 25us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560500.821766:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787560500.821791:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862733568 00000100:00100000:0.0:1787560500.821795:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862733568 00000100:00100000:0.0:1787560500.821818:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862733696 00000100:00100000:0.0:1787560500.821821:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862733696 00000100:00100000:0.0:1787560500.821834:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787560500.821840:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862733568:12345-0@lo:400: 00000100:00100000:0.0:1787560500.821867:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862733568:12345-0@lo:400: Request processed in 27us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560500.821873:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787560500.821896:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787560500.821902:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862733696:12345-0@lo:400: 00000100:00100000:0.0:1787560500.821926:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862733696:12345-0@lo:400: Request processed in 25us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560500.821931:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787560500.822344:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafe0685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862732544:0@lo:8: 00000100:00080000:2.0:1787560500.822523:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787560500.822528:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787560500.822531:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787560500.822562:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862733184:0@lo:400: 00010000:00080000:2.0:1787560500.822576:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2ccca80 x1874392862733696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560500.822592:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862733696:0@lo:400: 00010000:00080000:2.0:1787560500.822604:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2ccfb80 x1874392862733056/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560500.822611:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862733056:0@lo:400: 00010000:00080000:2.0:1787560500.822621:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2ccc700 x1874392862733568/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560500.822629:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862733568:0@lo:400: 00000100:00100000:1.0:1787560500.822725:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560500.822779:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862732672 00000100:00100000:1.0:1787560500.822784:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862732672 00000100:00100000:3.0:1787560500.822892:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862732544 00000100:00100000:3.0:1787560500.822897:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862732544 00000100:00100000:3.0:1787560500.822936:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787560500.822941:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1fac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3622:x1874392862732544:12345-0@lo:8: 00010000:00080000:3.0:1787560500.822967:0:8415:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:3.0:1787560500.822996:0:8415:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4642c20bf2f33c1e 00002000:00100000:3.0:1787560500.823010:0:8415:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9caec2fc7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1787560500.823014:0:8415:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1787560500.823017:0:8415:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787560500.823088:0:8415:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787560500.823317:0:8415:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1787560500.823340:0:8415:0:(import.c:65:import_set_state_nolock()) ffff9caec2fc6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787560500.823396:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1fac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3622:x1874392862732544:12345-0@lo:8: Request processed in 452us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560500.823402:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787560500.823500:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787560500.823510:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:9929:x1874392862732672:12345-0@lo:502: 00000100:00100000:1.0:1787560500.823626:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:9929:x1874392862732672:12345-0@lo:502: Request processed in 118us (3096us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560500.823632:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00010000:00080000:1.0:1787560500.823684:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cafe0685180 x1874392862732544/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787560510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560500.823693:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787560500.823707:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1787560500.823715:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787560500.823720:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787560500.823722:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec2f9d800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787560500.823733:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787560500.823738:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafe0685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862732544:0@lo:8: 00000004:00080000:1.0:1787560500.823760:0:9930:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1787560500.823946:0:9931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9931:1874392862734080:0@lo:700: 00000100:00100000:2.0:1787560500.823983:0:9931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560500.824017:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862734080 00000100:00100000:2.0:1787560500.824022:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862734080 00000100:00100000:2.0:1787560500.824058:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787560500.824065:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9931:x1874392862734080:12345-0@lo:700: 00000100:00100000:2.0:1787560500.824094:0:8422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaab800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8422:1874392862734208:0@lo:700: 00000100:00100000:2.0:1787560500.824132:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560500.824155:0:8422:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffba5e840 going to sleep for 11 seconds 00000100:00080000:2.0:1787560500.824168:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787560500.824177:0:9931:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffba5e000 going to sleep for 11 seconds 00010000:00080000:0.0:1787560500.824729:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2ccf800 x1874392862732800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560500.824750:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862732800:0@lo:400: 00010000:00080000:0.0:1787560500.824767:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2ccd180 x1874392862733312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560500.824776:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862733312:0@lo:400: 00010000:00080000:0.0:1787560500.824786:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2ccc380 x1874392862733824/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560500.824794:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862733824:0@lo:400: 00000100:00100000:0.0:1787560500.824817:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862732928:0@lo:400: 00010000:00080000:0.0:1787560500.824830:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2ccf100 x1874392862733440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560500.824838:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874392862733440:0@lo:400: 00010000:00080000:0.0:1787560500.824849:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2cced80 x1874392862733952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560500.824856:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862733952:0@lo:400: 00000100:00100000:1.0:1787560500.825056:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862734208 00000100:00100000:1.0:1787560500.825062:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862734208 00000100:00100000:1.0:1787560500.825105:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787560500.825113:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8422:x1874392862734208:12345-0@lo:700: 00000004:00080000:1.0:1787560500.825203:0:9930:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 220164770802ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787560500.825213:0:9930:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787560500.825731:0:9929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafe0687100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9929:1874392862732672:0@lo:502: 00000020:01000000:3.0:1787560500.825766:0:9929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560500.825774:0:9929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560500.825776:0:9929:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787560500.825780:0:9929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:1.0:1787560500.825948:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:1.0:1787560500.825970:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787560500.825980:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f33bfb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33c02 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560500.825991:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f33bfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33c02 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560500.826001:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787560500.826004:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cb000817800 from 39 10000000:01000000:1.0:1787560500.826007:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787560500.826037:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe000/0x4642c20bf2f33c25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560500.826046:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe000/0x4642c20bf2f33c25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560500.826065:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe000/0x4642c20bf2f33c25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560500.826153:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1fad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862734336:0@lo:101: 00000100:00100000:1.0:1787560500.826206:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560500.826237:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc5812cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560500.826252:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862734336 00000100:00100000:1.0:1787560500.826256:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862734336 00000100:00100000:1.0:1787560500.826284:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787560500.826292:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:6497:x1874392862734336:12345-0@lo:101: 00010000:00010000:1.0:1787560500.826301:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560500.826312:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffcbff400/0x4642c20bf2f33c2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33c25 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560500.826331:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffcbff400/0x4642c20bf2f33c2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33c25 expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560500.826341:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffcbff400/0x4642c20bf2f33c2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33c25 expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560500.826350:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbff400, rc 0) 00000100:00100000:1.0:1787560500.826383:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:6497:x1874392862734336:12345-0@lo:101: Request processed in 92us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560500.826390:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787560500.826451:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1fad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862734336:0@lo:101: 00010000:00010000:1.0:1787560500.826465:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe000/0x4642c20bf2f33c25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33c2c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560500.826484:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe000/0x4642c20bf2f33c25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33c2c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560500.826538:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1fad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862734464:0@lo:501: 00000100:00100000:1.0:1787560500.826565:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560500.826579:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbda900 going to sleep for 11 seconds 00000100:00100000:1.0:1787560500.826590:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862734464 00000100:00100000:1.0:1787560500.826594:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862734464 00000100:00100000:1.0:1787560500.826616:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787560500.826622:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:6497:x1874392862734464:12345-0@lo:501: 00000100:00100000:1.0:1787560500.826730:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:6497:x1874392862734464:12345-0@lo:501: Request processed in 107us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560500.826737:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787560500.826765:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1fad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862734464:0@lo:501: 00000100:00100000:1.0:1787560500.826788:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1fad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862734592:0@lo:503: 00000100:00100000:1.0:1787560500.826825:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560500.826839:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbda900 going to sleep for 11 seconds 00000100:00100000:1.0:1787560500.826850:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862734592 00000100:00100000:1.0:1787560500.826854:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862734592 00000100:00100000:1.0:1787560500.826875:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787560500.826893:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:6497:x1874392862734592:12345-0@lo:503: 00000100:00100000:1.0:1787560500.826970:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:6497:x1874392862734592:12345-0@lo:503: Request processed in 89us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560500.826977:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787560500.827019:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1fad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862734592:0@lo:503: 00000004:00080000:3.0:1787560500.828675:0:7430:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1787560500.830191:0:9932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f44a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9932:1874392862734720:0@lo:502: 00000100:00100000:0.0:1787560500.830279:0:9932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560500.830316:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862734720 00000100:00100000:0.0:1787560500.830323:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862734720 00000100:00100000:0.0:1787560500.830370:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787560500.830380:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:9932:x1874392862734720:12345-0@lo:502: 00000100:00100000:0.0:1787560500.830528:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:9932:x1874392862734720:12345-0@lo:502: Request processed in 148us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560500.830546:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787560500.830602:0:9932:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe0a65540 going to sleep for 11 seconds 00000100:00100000:0.0:1787560500.830621:0:9932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f44a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9932:1874392862734720:0@lo:502: 00000100:00100000:0.0:1787560500.830665:0:9932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f44a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9932:1874392862734848:0@lo:502: 00000100:00100000:0.0:1787560500.830695:0:9932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560500.830718:0:9932:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe0a65540 going to sleep for 11 seconds 00000100:00100000:1.0:1787560500.830898:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862734848 00000100:00100000:1.0:1787560500.830903:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862734848 00000100:00100000:1.0:1787560500.830936:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787560500.830945:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:9932:x1874392862734848:12345-0@lo:502: 00000100:00100000:1.0:1787560500.831030:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:9932:x1874392862734848:12345-0@lo:502: Request processed in 86us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560500.831038:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 40000000:02000000:3.0:1787560500.832014:0:6505:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:0.0:1787560500.832862:0:9932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f44a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9932:1874392862734848:0@lo:502: 00000040:00080000:0.0:1787560500.832914:0:9932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1787560500.836052:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1787560500.836096:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787560500.836109:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe000/0x4642c20bf2f33c25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33c2c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560500.836122:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe000/0x4642c20bf2f33c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33c2c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560500.836132:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787560500.836135:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cb000817800 from 6 10000000:01000000:1.0:1787560500.836138:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787560500.836174:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe800/0x4642c20bf2f33c33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560500.836183:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe800/0x4642c20bf2f33c33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560500.836195:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe800/0x4642c20bf2f33c33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560500.836216:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1fad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862734976:0@lo:101: 00000100:00100000:1.0:1787560500.836277:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560500.836335:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbda600 going to sleep for 11 seconds 00000100:00100000:0.0:1787560500.836924:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862734976 00000100:00100000:0.0:1787560500.836933:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862734976 00000100:00100000:0.0:1787560500.836988:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787560500.836998:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:6497:x1874392862734976:12345-0@lo:101: 00010000:00010000:0.0:1787560500.837013:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560500.837027:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafc0030a00/0x4642c20bf2f33c3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33c33 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560500.837053:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafc0030a00/0x4642c20bf2f33c3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33c33 expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560500.837063:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafc0030a00/0x4642c20bf2f33c3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33c33 expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560500.837072:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafc0030a00, rc 0) 00000100:00100000:0.0:1787560500.837124:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:6497:x1874392862734976:12345-0@lo:101: Request processed in 128us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560500.837130:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787560500.837322:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1fad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862734976:0@lo:101: 00010000:00010000:1.0:1787560500.837336:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe800/0x4642c20bf2f33c33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33c3a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560500.837347:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe800/0x4642c20bf2f33c33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33c3a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560500.837399:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1fad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862735104:0@lo:256: 00000100:00100000:1.0:1787560500.837445:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560500.837460:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbda600 going to sleep for 11 seconds 00000100:00100000:0.0:1787560500.838491:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862735104 00000100:00100000:0.0:1787560500.838510:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862735104 00000100:00100000:0.0:1787560500.838561:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787560500.838569:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:6497:x1874392862735104:12345-0@lo:256: 20000000:01000000:0.0:1787560500.838588:0:6494:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787560500.838604:0:6494:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787560500.838607:0:6494:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1787560500.838704:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:6497:x1874392862735104:12345-0@lo:256: Request processed in 136us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560500.838711:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787560500.838748:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1fad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862735104:0@lo:256: 10000000:01000000:0.0:1787560500.838797:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787560500.838805:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe800/0x4642c20bf2f33c33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33c3a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560500.838816:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe800/0x4642c20bf2f33c33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33c3a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560500.838825:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787560500.838827:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1787560500.838829:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787560500.838853:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc0030800/0x4642c20bf2f33c41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560500.838861:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cafc0030800/0x4642c20bf2f33c41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560500.838870:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cafc0030800/0x4642c20bf2f33c41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560500.838895:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f44a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862735232:0@lo:101: 00000100:00100000:0.0:1787560500.838929:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560500.838947:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe0a65a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787560500.838961:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862735232 00000100:00100000:0.0:1787560500.838965:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862735232 00000100:00100000:0.0:1787560500.838987:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787560500.838994:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc8c2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:6497:x1874392862735232:12345-0@lo:101: 00010000:00010000:0.0:1787560500.839001:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560500.839013:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33c48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33c41 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560500.839029:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33c48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33c41 expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560500.839038:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33c48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33c41 expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560500.839046:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafc0030600, rc 0) 00000100:00100000:0.0:1787560500.839073:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc8c2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:6497:x1874392862735232:12345-0@lo:101: Request processed in 79us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560500.839080:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787560500.839112:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f44a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862735232:0@lo:101: 00010000:00010000:0.0:1787560500.839124:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cafc0030800/0x4642c20bf2f33c41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33c48 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560500.839132:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cafc0030800/0x4642c20bf2f33c41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33c48 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560500.839185:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f44a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862735360:0@lo:501: 00000100:00100000:0.0:1787560500.839218:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560500.839239:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe0a65a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787560500.839469:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862735360 00000100:00100000:1.0:1787560500.839474:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862735360 00000100:00100000:1.0:1787560500.839616:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787560500.839626:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc8c2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:6497:x1874392862735360:12345-0@lo:501: 00000100:00100000:1.0:1787560500.839747:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc8c2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:6497:x1874392862735360:12345-0@lo:501: Request processed in 123us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560500.839753:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787560500.839871:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f44a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862735360:0@lo:501: 00000100:00100000:2.0:1787560500.839912:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862735488:0@lo:503: 00000100:00100000:2.0:1787560500.839951:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560500.839973:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffba5e600 going to sleep for 11 seconds 00000100:00100000:1.0:1787560500.840011:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862735488 00000100:00100000:1.0:1787560500.840016:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862735488 00000100:00100000:1.0:1787560500.840071:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787560500.840077:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd840bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:6497:x1874392862735488:12345-0@lo:503: 00000100:00100000:1.0:1787560500.840154:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd840bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:6497:x1874392862735488:12345-0@lo:503: Request processed in 77us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560500.840161:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787560500.842015:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8422:x1874392862734208:12345-0@lo:700: Request processed in 16896us (17875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560500.842034:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787560500.842090:0:8422:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcaab800 x1874392862734208/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787560516 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560500.842103:0:8422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaab800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8422:1874392862734208:0@lo:700: 40000000:02000000:3.0:1787560500.842130:0:8422:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:1.0:1787560500.842683:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862735488:0@lo:503: 00000100:00100000:1.0:1787560500.846800:0:9933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1faed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9933:1874392862735616:0@lo:502: 00000100:00100000:1.0:1787560500.846897:0:9933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560500.846944:0:9933:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbdab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787560500.846993:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862735616 00000100:00100000:2.0:1787560500.847000:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862735616 00000100:00100000:2.0:1787560500.847048:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787560500.847057:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd8409850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:9933:x1874392862735616:12345-0@lo:502: 00000100:00100000:2.0:1787560500.847184:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd8409850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:9933:x1874392862735616:12345-0@lo:502: Request processed in 127us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560500.847193:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787560500.848240:0:9933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1faed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9933:1874392862735616:0@lo:502: 00000020:01000000:0.0:1787560500.848289:0:9933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787560500.848297:0:9933:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787560500.848305:0:9933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560500.848308:0:9933:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787560500.848314:0:9933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787560500.848318:0:9933:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:01000000:0.0:1787560500.848341:0:9933:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787560500.848345:0:9933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787560500.848363:0:9933:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9caec2d03370) 00000020:00000080:0.0:1787560500.848389:0:9933:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:0.0:1787560500.848395:0:9933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787560500.848520:0:9933:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787560500.848527:0:9933:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:0.0:1787560500.848536:0:9933:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4642c20bf2f33c56 00010000:00080000:0.0:1787560500.848578:0:9933:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9caec3385000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.129@tcp at head 00010000:00010000:0.0:1787560500.848826:0:9933:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:0.0:1787560500.848980:0:9933:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1787560500.848992:0:9933:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787560500.849170:0:9933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787560500.849291:0:9933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787560500.849413:0:9933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1787560500.849536:0:9933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1787560500.853611:0:9934:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787560500.853619:0:9934:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787560500.854194:0:9933:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787560500.854207:0:9933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787560500.854246:0:9933:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787560500.854276:0:9933:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4642c20bf2f33c5d 00000100:00080000:2.0:1787560500.854287:0:9933:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787560500.854293:0:9933:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9caec3385000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560500.854329:0:9933:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caec2ccca80 x1874392862735744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787560500.854349:0:9933:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787560500.854404:0:9933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560500.854407:0:9933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560500.854409:0:9933:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787560500.854419:0:9933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787560500.854422:0:9933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560500.854424:0:9933:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787560500.854427:0:9933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787560500.854454:0:9933:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787560500.854486:0:9933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9933:1874392862735872:0@lo:502: 00000100:00100000:2.0:1787560500.854567:0:9933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560500.854598:0:9933:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffba5e840 going to sleep for 11 seconds 00000100:00100000:2.0:1787560500.854620:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862735744:0@lo:8: 00000100:00100000:2.0:1787560500.854650:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560500.855040:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862735872 00000100:00100000:0.0:1787560500.855049:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862735872 00000100:00100000:0.0:1787560500.855100:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787560500.855110:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd8408050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:9933:x1874392862735872:12345-0@lo:502: 00000100:00100000:0.0:1787560500.855256:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd8408050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:9933:x1874392862735872:12345-0@lo:502: Request processed in 147us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560500.855271:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787560500.855329:0:9933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:9933:1874392862735872:0@lo:502: 00000020:01000000:0.0:1787560500.855359:0:9933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560500.855366:0:9933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560500.855367:0:9933:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787560500.855372:0:9933:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1787560500.858090:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1787560500.858133:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787560500.858147:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc0030800/0x4642c20bf2f33c41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33c48 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560500.858160:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cafc0030800/0x4642c20bf2f33c41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33c48 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560500.858171:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787560500.858173:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9cafe06b3370 from 1 10000000:01000000:2.0:1787560500.858176:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787560500.858214:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49800/0x4642c20bf2f33c64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560500.858222:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffca49800/0x4642c20bf2f33c64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560500.858233:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffca49800/0x4642c20bf2f33c64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560500.858255:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2cced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862736000:0@lo:101: 00000100:00100000:2.0:1787560500.858328:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560500.858358:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffba5ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787560500.858381:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862736000 00000100:00100000:2.0:1787560500.858386:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862736000 00000100:00100000:2.0:1787560500.858426:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787560500.858453:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd087b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:6497:x1874392862736000:12345-0@lo:101: 00010000:00010000:2.0:1787560500.858466:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560500.858479:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f33c6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33c64 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560500.858502:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f33c6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33c64 expref: 24 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560500.858511:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f33c6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33c64 expref: 24 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560500.858518:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca49c00, rc 0) 00000100:00100000:2.0:1787560500.858554:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd087b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:6497:x1874392862736000:12345-0@lo:101: Request processed in 103us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560500.858560:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787560500.858603:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2cced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862736000:0@lo:101: 00010000:00010000:2.0:1787560500.858616:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffca49800/0x4642c20bf2f33c64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33c6b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560500.858625:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffca49800/0x4642c20bf2f33c64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33c6b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560500.858680:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2cced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862736128:0@lo:501: 00000100:00100000:2.0:1787560500.858714:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560500.858727:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffba5ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787560500.858740:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862736128 00000100:00100000:2.0:1787560500.858743:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862736128 00000100:00100000:2.0:1787560500.858765:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787560500.858773:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd0878450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:6497:x1874392862736128:12345-0@lo:501: 00000100:00100000:2.0:1787560500.858841:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd0878450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:6497:x1874392862736128:12345-0@lo:501: Request processed in 68us (126us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787560500.858848:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787560500.858891:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2cced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862736128:0@lo:501: 10000000:01000000:2.0:1787560500.858912:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787560500.858917:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49800/0x4642c20bf2f33c64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33c6b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560500.858925:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffca49800/0x4642c20bf2f33c64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33c6b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560500.865987:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862735744 00000100:00100000:3.0:1787560500.865998:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862735744 00000100:00100000:3.0:1787560500.866043:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787560500.866053:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3622:x1874392862735744:12345-0@lo:8: 00010000:00080000:3.0:1787560500.866090:0:8415:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:3.0:1787560500.866133:0:8415:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4642c20bf2f33c72 00002000:00100000:3.0:1787560500.866149:0:8415:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9caec2fc4000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787560500.866154:0:8415:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787560500.866157:0:8415:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787560500.866239:0:8415:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787560500.866268:0:8415:0:(import.c:65:import_set_state_nolock()) ffff9caec2fc0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787560500.866377:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3622:x1874392862735744:12345-0@lo:8: Request processed in 323us (11723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560500.866385:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1787560500.866488:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2ccca80 x1874392862735744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787560510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560500.866500:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787560500.866508:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787560500.866517:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787560500.866521:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787560500.866524:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec3385000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787560500.866535:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787560500.866542:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862735744:0@lo:8: 00000004:00080000:1.0:1787560500.866938:0:9934:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787560500.866995:0:9934:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 220206563276ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787560500.867002:0:9934:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1787560500.876574:0:6478:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1787560500.876982:0:9935:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787560500.877010:0:9935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1fae300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9935:1874392862736384:0@lo:7: 00000100:00100000:2.0:1787560500.877027:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1fadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862736256:0@lo:13: 00000100:00100000:2.0:1787560500.877086:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560500.877088:0:9935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560500.877189:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862736256 00000100:00100000:2.0:1787560500.877197:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862736256 00000100:00100000:2.0:1787560500.877260:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787560500.877269:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1874392862736256:12345-0@lo:13: 00002000:00000024:2.0:1787560500.877295:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00080000:3.0:1787560500.877342:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787560500.877392:0:9935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbda600 going to sleep for 11 seconds 00000100:00100000:3.0:1787560500.882513:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862736384 00000100:00100000:3.0:1787560500.882528:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862736384 00000100:00100000:3.0:1787560500.882600:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787560500.882610:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1faf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:9935:x1874392862736384:12345-0@lo:7: 00000001:00100000:1.0:1787560500.887073:0:9491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787560500.887085:0:9491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1787560500.887677:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1874392862736256:12345-0@lo:13: Request processed in 10401us (10585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560500.887690:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787560500.887749:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec1fadf80 x1874392862736256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560516 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560500.887773:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1fadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862736256:0@lo:13: 00000100:00100000:2.0:1787560500.890377:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9931:x1874392862734080:12345-0@lo:700: Request processed in 66304us (66385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560500.890391:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00002000:00080000:3.0:1787560500.890914:0:8412:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1787560500.890919:0:8412:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787560500.890971:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1faf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9935:x1874392862736384:12345-0@lo:7: Request processed in 8362us (13885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560500.890979:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1787560500.891945:0:9935:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec1fae300 x1874392862736384/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787560516 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560500.891960:0:9935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1fae300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9935:1874392862736384:0@lo:7: 00000004:00080000:1.0:1787560500.891974:0:9935:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787560500.892012:0:9935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1fae300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9935:1874392862736512:0@lo:5: 00000100:00100000:1.0:1787560500.892053:0:9935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560500.892091:0:9935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbda600 going to sleep for 11 seconds 00010000:00080000:0.0:1787560500.892250:0:9931:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcaa8380 x1874392862734080/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787560516 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560500.892261:0:9931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9931:1874392862734080:0@lo:700: 00000100:00100000:3.0:1787560500.896957:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862736512 00000100:00100000:3.0:1787560500.896992:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862736512 00000100:00100000:3.0:1787560500.897081:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787560500.897093:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1fae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9935:x1874392862736512:12345-0@lo:5: 00002000:00080000:3.0:1787560500.897130:0:8414:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787560500.897134:0:8414:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787560500.897595:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1fae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9935:x1874392862736512:12345-0@lo:5: Request processed in 502us (5539us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787560500.897603:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787560500.897707:0:9935:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec1fae300 x1874392862736512/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787560516 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560500.897726:0:9935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1fae300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9935:1874392862736512:0@lo:5: 00000004:00080000:0.0:1787560500.897740:0:9935:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787560500.897781:0:9935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f44380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9935:1874392862736640:0@lo:700: 00000100:00100000:0.0:1787560500.897818:0:9935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560500.897857:0:9935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe0a65180 going to sleep for 11 seconds 00000100:00100000:3.0:1787560500.898012:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862736640 00000100:00100000:3.0:1787560500.898018:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862736640 00000100:00100000:3.0:1787560500.898056:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787560500.898065:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9935:x1874392862736640:12345-0@lo:700: 00000004:00080000:0.0:1787560500.900495:0:9931:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787560500.900529:0:9931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f45880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9931:1874392862736896:0@lo:7: 00000100:00100000:0.0:1787560500.900594:0:9931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560500.900631:0:9931:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe0a65240 going to sleep for 11 seconds 00000100:00100000:3.0:1787560500.900681:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862736768:0@lo:13: 00000100:00100000:3.0:1787560500.900717:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560500.900766:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862736896 00000100:00100000:3.0:1787560500.900772:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862736896 00000100:00100000:0.0:1787560500.900782:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862736768 00000100:00100000:0.0:1787560500.900786:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862736768 00000100:00100000:0.0:1787560500.900812:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787560500.900820:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3624:x1874392862736768:12345-0@lo:13: 00000100:00100000:3.0:1787560500.900824:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787560500.900830:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:9931:x1874392862736896:12345-0@lo:7: 00002000:00000024:0.0:1787560500.900848:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1787560500.900901:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3624:x1874392862736768:12345-0@lo:13: Request processed in 82us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560500.900907:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1787560500.900973:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2f44000 x1874392862736768/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560516 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560500.900993:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862736768:0@lo:13: 00002000:00080000:3.0:1787560500.908853:0:8415:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1787560500.908861:0:8415:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000001:00080000:1.0:1787560500.909902:0:9491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:1.0:1787560500.910019:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9935:x1874392862736640:12345-0@lo:700: Request processed in 11950us (12194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560500.910037:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787560500.910606:0:9935:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2f44380 x1874392862736640/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787560516 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560500.910618:0:9935:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787560500.910646:0:9935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f44380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9935:1874392862736640:0@lo:700: 00000100:00100000:3.0:1787560500.918273:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9931:x1874392862736896:12345-0@lo:7: Request processed in 17431us (17667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560500.918289:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787560500.918414:0:9931:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2f45880 x1874392862736896/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787560516 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560500.918457:0:9931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f45880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9931:1874392862736896:0@lo:7: 00000004:00080000:0.0:1787560500.918472:0:9931:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787560500.918509:0:9931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f45880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9931:1874392862737024:0@lo:5: 00000100:00100000:0.0:1787560500.918598:0:9931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560500.918630:0:9931:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe0a65240 going to sleep for 11 seconds 00000004:02000040:1.0:1787560500.918701:0:9935:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:3.0:1787560500.921421:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862737024 00000100:00100000:3.0:1787560500.921466:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862737024 00000100:00100000:2.0:1787560500.922197:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787560500.922208:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9931:x1874392862737024:12345-0@lo:5: 00002000:00080000:2.0:1787560500.922241:0:8414:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1787560500.922318:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9931:x1874392862737024:12345-0@lo:5: Request processed in 112us (3719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560500.922325:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787560500.924084:0:9931:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2f45880 x1874392862737024/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787560516 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560500.924102:0:9931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f45880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9931:1874392862737024:0@lo:5: 00000004:00080000:0.0:1787560500.924116:0:9931:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787560500.924158:0:9931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f45880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9931:1874392862737152:0@lo:5: 00000100:00100000:0.0:1787560500.924207:0:9931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560500.924289:0:9931:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe0a65240 going to sleep for 11 seconds 00000100:00100000:1.0:1787560500.924946:0:9935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1fae300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9935:1874392862737280:0@lo:5: 00000100:00100000:1.0:1787560500.924986:0:9935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560500.925107:0:9935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbdaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787560500.925110:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862737152 00000100:00100000:2.0:1787560500.925117:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862737152 00000100:00100000:3.0:1787560500.925156:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862737280 00000100:00100000:3.0:1787560500.925161:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862737280 00000100:00100000:3.0:1787560500.925200:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787560500.925209:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1faea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9935:x1874392862737280:12345-0@lo:5: 00002000:00080000:2.0:1787560500.929649:0:8414:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1787560500.929668:0:8414:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1787560500.939754:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1faea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9935:x1874392862737280:12345-0@lo:5: Request processed in 14539us (14759us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787560500.939783:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787560500.939823:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787560500.939835:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9931:x1874392862737152:12345-0@lo:5: 00002000:00080000:2.0:1787560500.939874:0:8414:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:2.0:1787560500.941381:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9931:x1874392862737152:12345-0@lo:5: Request processed in 1546us (17170us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787560500.941392:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787560500.941501:0:9931:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2f45880 x1874392862737152/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787560516 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560500.941516:0:9931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f45880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9931:1874392862737152:0@lo:5: 00000004:00080000:2.0:1787560500.941530:0:9931:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1787560500.941572:0:9931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2cced80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9931:1874392862737408:0@lo:900: 00000100:00100000:2.0:1787560500.941617:0:9931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560500.941649:0:9931:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd32140c0 going to sleep for 11 seconds 00010000:00080000:1.0:1787560500.942110:0:9935:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec1fae300 x1874392862737280/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787560516 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560500.942122:0:9935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1fae300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9935:1874392862737280:0@lo:5: 00000004:00080000:1.0:1787560500.942131:0:9935:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000100:00100000:0.0:1787560500.942282:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862737408 00000100:00100000:0.0:1787560500.942289:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862737408 00000100:00100000:0.0:1787560500.942338:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787560500.942348:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9931:x1874392862737408:12345-0@lo:900: 00000100:00100000:0.0:1787560500.942548:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9931:x1874392862737408:12345-0@lo:900: Request processed in 201us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560500.942555:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787560500.944071:0:9931:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2cced80 x1874392862737408/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787560516 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560500.944088:0:9931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2cced80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9931:1874392862737408:0@lo:900: 00010000:00010000:1.0:1787560501.235655:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787560501.324163:0:9491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:1.0:1787560501.324182:0:9491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1787560502.260124:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560502.323679:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787560502.323708:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1faf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862737536:0@lo:41: 00000100:00100000:0.0:1787560502.323779:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560502.324028:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862737536 00000100:00100000:2.0:1787560502.324036:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862737536 00000100:00100000:2.0:1787560502.324102:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787560502.324112:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862737536:12345-0@lo:41: 00000004:00000024:2.0:1787560502.324155:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1787560502.324356:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862737536:12345-0@lo:41: Request processed in 245us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560502.324364:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787560502.324465:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1faf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862737536:0@lo:41: 00010000:00010000:3.0:1787560503.296126:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787560503.318283:0:10018:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787560503.318735:0:10018:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787560503.352358:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787560503.352388:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862737664:0@lo:41: 00000100:00100000:2.0:1787560503.352477:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560503.352555:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862737664 00000100:00100000:2.0:1787560503.352565:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862737664 00000100:00100000:2.0:1787560503.353549:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787560503.353560:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862737664:12345-0@lo:41: 00000004:00000024:2.0:1787560503.353805:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787560503.353878:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862737664:12345-0@lo:41: Request processed in 318us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560503.353886:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787560503.353932:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862737664:0@lo:41: 00000020:00000004:0.0:1787560504.134927:0:10066:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787560504.134936:0:10066:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1787560504.308958:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560504.692797:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560504.692907:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853250176 00000100:00100000:2.0:1787560504.692920:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853250176 00000100:00100000:2.0:1787560504.692985:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 181 00000100:00100000:2.0:1787560504.692996:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd3219c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2401:x1874392853250176:12345-192.168.203.29@tcp:250: 00010000:00080000:2.0:1787560504.693035:0:6492:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a608f87b-4315-497d-a70e-0ed75a6814da@192.168.203.29@tcp t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:2.0:1787560504.693065:0:6492:0:(genops.c:1385:class_connect()) connect: client a608f87b-4315-497d-a70e-0ed75a6814da, cookie 0x4642c20bf2f33c79 00000100:00080000:2.0:1787560504.693251:0:6492:0:(import.c:65:import_set_state_nolock()) ffff9caec3210800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787560504.693342:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd3219c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+5:2401:x1874392853250176:12345-192.168.203.29@tcp:250: Request processed in 346us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560504.693351:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 181 00000100:00100000:1.0:1787560504.707252:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560504.707424:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853250304 00000100:00100000:0.0:1787560504.707463:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853250304 00000100:00100000:0.0:1787560504.707545:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 182 00000100:00100000:0.0:1787560504.707559:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+5:6165:x1874392853250304:12345-192.168.203.29@tcp:101: 00010000:00010000:0.0:1787560504.707582:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560504.707604:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafc0031600/0x4642c20bf2f33c80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fad1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560504.707639:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafc0031600/0x4642c20bf2f33c80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fad1 expref: 6 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560504.707651:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafc0031600/0x4642c20bf2f33c80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fad1 expref: 6 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560504.707663:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafc0031600, rc 0) 00000100:00100000:0.0:1787560504.707737:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+6:6165:x1874392853250304:12345-192.168.203.29@tcp:101: Request processed in 182us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560504.707745:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 182 00000100:00100000:1.0:1787560504.726397:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560504.726604:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853250432 00000100:00100000:0.0:1787560504.726617:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853250432 00000100:00100000:0.0:1787560504.726728:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 183 00000100:00100000:0.0:1787560504.726757:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+6:6165:x1874392853250432:12345-192.168.203.29@tcp:501: 00000100:00100000:0.0:1787560504.726946:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+6:6165:x1874392853250432:12345-192.168.203.29@tcp:501: Request processed in 189us (564us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787560504.726956:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 183 00000100:00100000:1.0:1787560504.730518:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560504.730757:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853250560 00000100:00100000:2.0:1787560504.730772:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853250560 00000100:00100000:2.0:1787560504.731689:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 184 00000100:00100000:2.0:1787560504.731707:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+6:6165:x1874392853250560:12345-192.168.203.29@tcp:101: 00010000:00010000:2.0:1787560504.731730:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560504.731753:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca48600/0x4642c20bf2f33c87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fad8 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560504.731808:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca48600/0x4642c20bf2f33c87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fad8 expref: 7 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560504.732458:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca48600/0x4642c20bf2f33c87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fad8 expref: 7 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560504.732471:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca48600, rc 0) 00000100:00100000:2.0:1787560504.732726:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+7:6165:x1874392853250560:12345-192.168.203.29@tcp:101: Request processed in 1024us (2222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560504.732735:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 184 00000100:00100000:1.0:1787560504.736357:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560504.740538:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853250688 00000100:00100000:3.0:1787560504.740617:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853250688 00000100:00100000:3.0:1787560504.740724:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 185 00000100:00100000:3.0:1787560504.740738:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+7:6165:x1874392853250688:12345-192.168.203.29@tcp:501: 00000100:00100000:3.0:1787560504.741356:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+8:6165:x1874392853250688:12345-192.168.203.29@tcp:501: Request processed in 616us (5009us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560504.741367:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 185 00000100:00100000:1.0:1787560504.751414:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560504.751638:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853250816 00000100:00100000:0.0:1787560504.751651:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853250816 00000100:00100000:2.0:1787560504.753969:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 186 00000100:00100000:2.0:1787560504.754002:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+8:6165:x1874392853250816:12345-192.168.203.29@tcp:503: 00000100:00100000:2.0:1787560504.754247:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+8:6165:x1874392853250816:12345-192.168.203.29@tcp:503: Request processed in 262us (2848us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560504.754257:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 186 00000100:00100000:1.0:1787560504.757845:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560504.757956:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853250944 00000100:00100000:3.0:1787560504.757968:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853250944 00000100:00100000:3.0:1787560504.758039:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 187 00000100:00100000:3.0:1787560504.758051:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+8:6184:x1874392853250944:12345-192.168.203.29@tcp:502: 00000100:00100000:3.0:1787560504.758343:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+8:6184:x1874392853250944:12345-192.168.203.29@tcp:502: Request processed in 293us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560504.758352:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 187 00000100:00100000:1.0:1787560504.817892:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560504.818148:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853251072 00000100:00100000:0.0:1787560504.818163:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853251072 00000100:00100000:0.0:1787560504.818241:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 188 00000100:00100000:0.0:1787560504.818254:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+8:6184:x1874392853251072:12345-192.168.203.29@tcp:502: 00000100:00100000:0.0:1787560504.818497:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+8:6184:x1874392853251072:12345-192.168.203.29@tcp:502: Request processed in 246us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560504.818506:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 188 00000100:00100000:1.0:1787560504.826176:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560504.826695:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853251200 00000100:00100000:3.0:1787560504.826709:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853251200 00000100:00100000:3.0:1787560504.826790:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 189 00000100:00100000:3.0:1787560504.826821:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+8:6165:x1874392853251200:12345-192.168.203.29@tcp:101: 00010000:00010000:3.0:1787560504.826844:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560504.826878:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafda2f6600/0x4642c20bf2f33c8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fb09 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560504.826914:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafda2f6600/0x4642c20bf2f33c8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb09 expref: 9 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560504.826936:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafda2f6600/0x4642c20bf2f33c8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb09 expref: 9 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560504.826948:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f6600, rc 0) 00000100:00100000:3.0:1787560504.827030:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+9:6165:x1874392853251200:12345-192.168.203.29@tcp:101: Request processed in 212us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560504.827037:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 189 00000100:00100000:1.0:1787560504.833561:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560504.833918:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853251328 00000100:00100000:0.0:1787560504.833931:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853251328 00000100:00100000:0.0:1787560504.834002:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 190 00000100:00100000:0.0:1787560504.834014:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+9:6165:x1874392853251328:12345-192.168.203.29@tcp:256: 20000000:01000000:0.0:1787560504.834050:0:6494:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787560504.834082:0:6494:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787560504.834087:0:6494:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787560504.834090:0:6494:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787560504.834094:0:6494:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787560504.834096:0:6494:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1787560504.837809:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+9:6165:x1874392853251328:12345-192.168.203.29@tcp:256: Request processed in 3781us (4247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560504.837826:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 190 00000100:00100000:1.0:1787560504.847547:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560504.848644:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853251456 00000100:00100000:2.0:1787560504.848662:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853251456 00000100:00100000:2.0:1787560504.848750:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 191 00000100:00100000:2.0:1787560504.848763:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+9:6165:x1874392853251456:12345-192.168.203.29@tcp:101: 00010000:00010000:2.0:1787560504.848785:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560504.848810:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca48000/0x4642c20bf2f33c95 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fb10 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560504.848858:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca48000/0x4642c20bf2f33c95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb10 expref: 10 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560504.848895:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca48000/0x4642c20bf2f33c95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb10 expref: 10 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560504.848908:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca48000, rc 0) 00000100:00100000:2.0:1787560504.848997:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+10:6165:x1874392853251456:12345-192.168.203.29@tcp:101: Request processed in 237us (1469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560504.849005:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 191 00000100:00100000:1.0:1787560504.854041:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560504.854167:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853251584 00000100:00100000:0.0:1787560504.854198:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853251584 00000100:00100000:0.0:1787560504.854281:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 192 00000100:00100000:0.0:1787560504.854295:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5802450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+10:6165:x1874392853251584:12345-192.168.203.29@tcp:501: 00000100:00100000:0.0:1787560504.854646:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5802450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+10:6165:x1874392853251584:12345-192.168.203.29@tcp:501: Request processed in 353us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560504.854655:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 192 00000100:00100000:1.0:1787560504.860870:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560504.861115:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853251712 00000100:00100000:2.0:1787560504.861130:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853251712 00000100:00100000:2.0:1787560504.861206:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 193 00000100:00100000:2.0:1787560504.861219:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5801450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+10:6165:x1874392853251712:12345-192.168.203.29@tcp:503: 00000100:00100000:2.0:1787560504.861476:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5801450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+10:6165:x1874392853251712:12345-192.168.203.29@tcp:503: Request processed in 259us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560504.861486:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 193 00000100:00100000:1.0:1787560504.869570:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560504.869804:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853251840 00000100:00100000:3.0:1787560504.869820:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853251840 00000100:00100000:3.0:1787560504.869905:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 194 00000100:00100000:3.0:1787560504.869919:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5801850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+10:6188:x1874392853251840:12345-192.168.203.29@tcp:502: 00000100:00100000:3.0:1787560504.870136:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5801850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+10:6188:x1874392853251840:12345-192.168.203.29@tcp:502: Request processed in 211us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560504.870145:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 194 00000100:00100000:1.0:1787560504.873384:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560504.876637:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853251968 00000100:00100000:0.0:1787560504.876659:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853251968 00000100:00100000:0.0:1787560504.876761:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 195 00000100:00100000:0.0:1787560504.876775:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5803450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+10:6188:x1874392853251968:12345-192.168.203.29@tcp:502: 00000100:00100000:0.0:1787560504.879998:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5803450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+10:6188:x1874392853251968:12345-192.168.203.29@tcp:502: Request processed in 3207us (6607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560504.880018:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 195 00000100:00100000:0.0:1787560504.884410:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787560504.884477:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862737792:0@lo:13: 00000100:00100000:0.0:1787560504.884572:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560504.885241:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862737792 00000100:00100000:2.0:1787560504.885254:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862737792 00000100:00100000:2.0:1787560504.885345:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787560504.885360:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862737792:12345-0@lo:13: 00002000:00000024:2.0:1787560504.885400:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560504.885505:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862737792:12345-0@lo:13: Request processed in 149us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560504.885514:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1787560504.885569:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2ccd500 x1874392862737792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560520 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560504.885603:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862737792:0@lo:13: 00000100:00100000:2.0:1787560504.886744:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1faf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862737920:0@lo:13: 00000100:00080000:0.0:1787560504.887025:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787560504.887037:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560504.887210:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862737920 00000100:00100000:1.0:1787560504.887219:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862737920 00000100:00100000:1.0:1787560504.887282:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787560504.887293:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862737920:12345-0@lo:13: 00002000:00000024:1.0:1787560504.887319:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787560504.887373:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862737920:12345-0@lo:13: Request processed in 80us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560504.887379:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787560504.887489:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec1faf800 x1874392862737920/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560520 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560504.887516:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1faf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862737920:0@lo:13: 00000100:00080000:0.0:1787560504.887693:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787560504.889062:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560504.889095:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560504.889226:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853252096 00000100:00100000:3.0:1787560504.889237:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853252096 00000100:00100000:3.0:1787560504.889281:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853252352 00000100:00100000:3.0:1787560504.889284:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853252352 00000100:00100000:3.0:1787560504.889298:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:3.0:1787560504.889308:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1fadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1874392853252096:12345-192.168.203.29@tcp:38: 00010000:00080000:3.0:1787560504.889358:0:6498:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 9331bacf-6cfc-4379-8649-925e79b19df1@192.168.203.29@tcp t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:3.0:1787560504.889416:0:6498:0:(genops.c:1385:class_connect()) connect: client 9331bacf-6cfc-4379-8649-925e79b19df1, cookie 0x4642c20bf2f33c9c 00000004:00100000:3.0:1787560504.889485:0:6498:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:3.0:1787560504.889762:0:6498:0:(import.c:65:import_set_state_nolock()) ffff9caec2f9a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787560504.889862:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1fadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:2401:x1874392853252096:12345-192.168.203.29@tcp:38: Request processed in 545us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560504.889870:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:3.0:1787560504.889893:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:3.0:1787560504.889899:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1faed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1874392853252352:12345-192.168.203.29@tcp:38: 00010000:00080000:3.0:1787560504.889918:0:6498:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 9331bacf-6cfc-4379-8649-925e79b19df1@192.168.203.29@tcp t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:3.0:1787560504.889952:0:6498:0:(genops.c:1385:class_connect()) connect: client 9331bacf-6cfc-4379-8649-925e79b19df1, cookie 0x4642c20bf2f33ca3 00000004:00100000:3.0:1787560504.889966:0:6498:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000100:00080000:3.0:1787560504.890139:0:6498:0:(import.c:65:import_set_state_nolock()) ffff9caec2f99800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787560504.890166:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1faed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:2401:x1874392853252352:12345-192.168.203.29@tcp:38: Request processed in 266us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560504.890173:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 8 00010000:00010000:1.0:1787560505.332201:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560505.404357:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560505.404576:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853252224 00000100:00100000:3.0:1787560505.404605:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853252224 00000100:00100000:3.0:1787560505.404710:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:3.0:1787560505.404724:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1fad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:0:x1874392853252224:12345-192.168.203.29@tcp:41: 00000004:00000024:3.0:1787560505.404773:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787560505.404919:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1fad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:0:x1874392853252224:12345-192.168.203.29@tcp:41: Request processed in 197us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560505.404927:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00080000:0.0:1787560505.405279:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560505.410135:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560505.410186:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560505.410281:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853252608 00000100:00100000:3.0:1787560505.410309:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853252608 00000100:00100000:3.0:1787560505.410374:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853252480 00000100:00100000:3.0:1787560505.410377:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853252480 00000100:00100000:3.0:1787560505.410411:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:3.0:1787560505.410423:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:6165:x1874392853252608:12345-192.168.203.29@tcp:41: 00000004:00000024:3.0:1787560505.410488:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787560505.410581:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:6165:x1874392853252608:12345-192.168.203.29@tcp:41: Request processed in 159us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560505.410589:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:3.0:1787560505.410609:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:3.0:1787560505.410614:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:0:x1874392853252480:12345-192.168.203.29@tcp:41: 00000004:00000024:3.0:1787560505.410636:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787560505.410661:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:0:x1874392853252480:12345-192.168.203.29@tcp:41: Request processed in 48us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560505.410667:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00080000:2.0:1787560505.410895:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787560505.427066:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560505.427502:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853252736 00000100:00100000:1.0:1787560505.427521:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853252736 00000100:00100000:1.0:1787560505.427632:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:1.0:1787560505.427646:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+6:6165:x1874392853252736:12345-192.168.203.29@tcp:40: 00000100:00100000:1.0:1787560505.427785:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+6:6165:x1874392853252736:12345-192.168.203.29@tcp:40: Request processed in 141us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560505.427795:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:1.0:1787560505.434571:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560505.434678:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853253120 00000100:00100000:2.0:1787560505.434692:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853253120 00000100:00100000:2.0:1787560505.434777:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:2.0:1787560505.434792:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1face00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9331bacf-6cfc-4379-8649-925e79b19df1+6:6165:x1874392853253120:12345-192.168.203.29@tcp:900: 00000100:00100000:2.0:1787560505.435788:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1face00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9331bacf-6cfc-4379-8649-925e79b19df1+6:6165:x1874392853253120:12345-192.168.203.29@tcp:900: Request processed in 982us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560505.435800:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:2.0:1787560505.438363:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560505.438417:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560505.438570:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853252864 00000100:00100000:1.0:1787560505.438582:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853252864 00000100:00100000:1.0:1787560505.438628:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853252992 00000100:00100000:1.0:1787560505.438632:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853252992 00000100:00100000:1.0:1787560505.438647:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:1.0:1787560505.438658:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1874392853252864:12345-192.168.203.29@tcp:8: 00010000:00080000:1.0:1787560505.438720:0:8412:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 9331bacf-6cfc-4379-8649-925e79b19df1@192.168.203.29@tcp t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:1.0:1787560505.438755:0:8412:0:(genops.c:1385:class_connect()) connect: client 9331bacf-6cfc-4379-8649-925e79b19df1, cookie 0x4642c20bf2f33caa 00002000:00100000:1.0:1787560505.438783:0:8412:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9331bacf-6cfc-4379-8649-925e79b19df1/ffff9caec32fa000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787560505.438797:0:8412:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:1.0:1787560505.439349:0:8412:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787560505.439392:0:8412:0:(import.c:65:import_set_state_nolock()) ffff9caec32ff800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787560505.439579:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:2401:x1874392853252864:12345-192.168.203.29@tcp:8: Request processed in 919us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560505.439589:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:1.0:1787560505.439620:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:1.0:1787560505.439627:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2007b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1874392853252992:12345-192.168.203.29@tcp:8: 00010000:00080000:1.0:1787560505.439653:0:8412:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 9331bacf-6cfc-4379-8649-925e79b19df1@192.168.203.29@tcp t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:1.0:1787560505.439675:0:8412:0:(genops.c:1385:class_connect()) connect: client 9331bacf-6cfc-4379-8649-925e79b19df1, cookie 0x4642c20bf2f33cb1 00002000:00100000:1.0:1787560505.439683:0:8412:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9331bacf-6cfc-4379-8649-925e79b19df1/ffff9caec32fd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787560505.439699:0:8412:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:1.0:1787560505.440106:0:8412:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787560505.440207:0:8412:0:(import.c:65:import_set_state_nolock()) ffff9caec32fb000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787560505.440244:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2007b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:2401:x1874392853252992:12345-192.168.203.29@tcp:8: Request processed in 615us (1826us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560505.440252:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:3.0:1787560505.451349:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560505.452005:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853253248 00000100:00100000:2.0:1787560505.452020:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853253248 00000100:00100000:2.0:1787560505.452098:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:2.0:1787560505.452111:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:6165:x1874392853253248:12345-192.168.203.29@tcp:33: 00000004:00080000:1.0:1787560505.494346:0:6501:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 42103us 00000004:00200000:1.0:1787560505.539565:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787560505.539702:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:6165:x1874392853253248:12345-192.168.203.29@tcp:33: Request processed in 87587us (88363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560505.539730:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:3.0:1787560505.782954:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560505.783296:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853253376 00000100:00100000:0.0:1787560505.783310:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853253376 00000100:00100000:0.0:1787560505.783387:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:0.0:1787560505.783399:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+6:6206:x1874392853253376:12345-192.168.203.29@tcp:101: 00010000:00010000:0.0:1787560505.783426:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560505.783526:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0031000/0x4642c20bf2f33cb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fb41 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560505.783643:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f33cbf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560505.783660:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f33cbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560505.783677:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f33cbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560505.783741:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787560505.783745:0:6499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787560505.784069:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f33cbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560505.784109:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0031000/0x4642c20bf2f33cb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb41 expref: 8 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560505.784133:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f33cbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb41 expref: 7 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560505.784144:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec1e6b800) 00010000:00010000:0.0:1787560505.784147:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787560505.784152:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafc0030400, rc 0) 00000100:00100000:0.0:1787560505.784345:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+7:6206:x1874392853253376:12345-192.168.203.29@tcp:101: Request processed in 945us (1403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560505.784354:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:2.0:1787560505.907909:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862738304:0@lo:400: 00000100:00100000:2.0:1787560505.908010:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560505.908049:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862738048:0@lo:400: 00000100:00100000:3.0:1787560505.908095:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560505.908124:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862738560:0@lo:400: 00000100:00100000:3.0:1787560505.908149:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560505.908166:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862739072:0@lo:400: 00000100:00100000:0.0:1787560505.908174:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862738176:0@lo:400: 00000100:00100000:3.0:1787560505.908191:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560505.908209:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862739584:0@lo:400: 00000100:00100000:0.0:1787560505.908218:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560505.908233:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560505.908249:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862738688:0@lo:400: 00000100:00100000:0.0:1787560505.908272:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560505.908288:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862739200:0@lo:400: 00000100:00100000:0.0:1787560505.908307:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560505.908310:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862738304 00000100:00100000:3.0:1787560505.908318:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862738304 00000100:00100000:0.0:1787560505.908325:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862739712:0@lo:13: 00000100:00100000:0.0:1787560505.908348:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560505.908368:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862738560 00000100:00100000:3.0:1787560505.908371:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862738560 00000100:00100000:0.0:1787560505.908375:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862739072 00000100:00100000:0.0:1787560505.908377:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862739072 00000100:00100000:3.0:1787560505.908388:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787560505.908398:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862738304:12345-0@lo:400: 00000100:00100000:0.0:1787560505.908417:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862739584 00000100:00100000:0.0:1787560505.908420:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862739584 00000100:00100000:0.0:1787560505.908463:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787560505.908470:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862739072:12345-0@lo:400: 00000100:00100000:0.0:1787560505.908513:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862739072:12345-0@lo:400: Request processed in 43us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560505.908521:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787560505.908539:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787560505.908544:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862739584:12345-0@lo:400: 00000100:00100000:0.0:1787560505.908571:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862739584:12345-0@lo:400: Request processed in 27us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560505.908577:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787560505.908594:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862738176 00000100:00100000:0.0:1787560505.908598:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862738176 00000100:00100000:0.0:1787560505.908612:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862738688 00000100:00100000:0.0:1787560505.908614:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862738688 00000100:00100000:0.0:1787560505.908625:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862739200 00000100:00100000:0.0:1787560505.908626:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862739200 00000100:00100000:0.0:1787560505.908638:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787560505.908643:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862738176:12345-0@lo:400: 00000100:00100000:0.0:1787560505.908681:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862738176:12345-0@lo:400: Request processed in 38us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560505.908687:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787560505.908698:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787560505.908703:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862738688:12345-0@lo:400: 00000100:00100000:0.0:1787560505.908724:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862738688:12345-0@lo:400: Request processed in 22us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560505.908730:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787560505.908741:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787560505.908746:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862739200:12345-0@lo:400: 00000100:00100000:0.0:1787560505.908772:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862739200:12345-0@lo:400: Request processed in 26us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560505.908777:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787560505.908819:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862738176:0@lo:400: 00000100:00100000:0.0:1787560505.908831:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862738688:0@lo:400: 00000100:00100000:0.0:1787560505.908841:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862739200:0@lo:400: 00000100:00100000:0.0:1787560505.908921:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787560505.908930:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862738560:12345-0@lo:400: 00000100:00100000:0.0:1787560505.908979:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862738560:12345-0@lo:400: Request processed in 50us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560505.908986:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787560505.909017:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862738432:0@lo:400: 00000100:00100000:0.0:1787560505.909043:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560505.909063:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862738944:0@lo:400: 00000100:00100000:0.0:1787560505.909106:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560505.909123:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862739456:0@lo:400: 00000100:00100000:0.0:1787560505.909141:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560505.909166:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862738944 00000100:00100000:0.0:1787560505.909171:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862738944 00000100:00100000:0.0:1787560505.909186:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862739456 00000100:00100000:0.0:1787560505.909189:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862739456 00000100:00100000:0.0:1787560505.909203:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787560505.909209:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862738944:12345-0@lo:400: 00000100:00100000:0.0:1787560505.909241:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862738944:12345-0@lo:400: Request processed in 32us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560505.909247:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787560505.909257:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787560505.909263:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862739456:12345-0@lo:400: 00000100:00100000:0.0:1787560505.909289:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862739456:12345-0@lo:400: Request processed in 27us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560505.909294:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787560505.909312:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862738048 00000100:00100000:0.0:1787560505.909317:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862738048 00000100:00100000:0.0:1787560505.909346:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787560505.909353:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5802850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3625:x1874392862738048:12345-0@lo:400: 00000100:00100000:0.0:1787560505.909383:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5802850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3625:x1874392862738048:12345-0@lo:400: Request processed in 31us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560505.909389:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00010000:00080000:0.0:1787560505.909453:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cafeab10380 x1874392862738944/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560505.909466:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862738944:0@lo:400: 00010000:00080000:0.0:1787560505.909488:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cafeab11500 x1874392862739456/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560505.909496:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1787560505.909507:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862739456:0@lo:400: 00000100:00100000:0.0:1787560505.909526:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862738432 00000100:00100000:0.0:1787560505.909530:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862738432 00000100:00100000:0.0:1787560505.909551:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787560505.909557:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862738432:12345-0@lo:400: 00000100:00100000:0.0:1787560505.909591:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862738432:12345-0@lo:400: Request processed in 34us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560505.909597:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787560505.909622:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862738432:0@lo:400: 00000100:00100000:1.0:1787560505.909723:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862739712 00000100:00100000:1.0:1787560505.909727:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862739712 00000100:00100000:1.0:1787560505.909758:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787560505.909764:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862739712:12345-0@lo:13: 00002000:00000024:1.0:1787560505.909781:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787560505.909824:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862739712:12345-0@lo:13: Request processed in 61us (1474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560505.909829:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1787560505.909870:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caff4b84380 x1874392862739712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560521 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560505.909885:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862739712:0@lo:13: 00000100:00100000:1.0:1787560505.909946:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862738048:0@lo:400: 00000100:00100000:1.0:1787560505.909956:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862738560:0@lo:400: 00010000:00080000:1.0:1787560505.909968:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cafeab12300 x1874392862739072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560505.909977:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862739072:0@lo:400: 00010000:00080000:1.0:1787560505.909986:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cafffe19f80 x1874392862739584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560505.909993:0:3625:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787560505.910000:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862739584:0@lo:400: 00000100:00080000:1.0:1787560505.910030:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787560505.910036:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787560505.910510:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862738816:0@lo:400: 00000100:00100000:2.0:1787560505.910566:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560505.910592:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862739328:0@lo:400: 00000100:00100000:2.0:1787560505.910619:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560505.910645:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1faca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862739840:0@lo:13: 00000100:00100000:2.0:1787560505.910667:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560505.910727:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862738816 00000100:00100000:1.0:1787560505.910732:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862738816 00000100:00100000:1.0:1787560505.910767:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862739328 00000100:00100000:1.0:1787560505.910770:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862739328 00000100:00100000:1.0:1787560505.910787:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787560505.910794:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862738816:12345-0@lo:400: 00000100:00100000:1.0:1787560505.910834:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862738816:12345-0@lo:400: Request processed in 40us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560505.910840:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787560505.910866:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787560505.910873:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874392862739328:12345-0@lo:400: 00000100:00100000:1.0:1787560505.910917:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874392862739328:12345-0@lo:400: Request processed in 45us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560505.910923:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1787560505.910942:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787560505.910968:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862739840 00000100:00100000:1.0:1787560505.910972:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862739840 00000100:00100000:1.0:1787560505.910993:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787560505.910999:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862739840:12345-0@lo:13: 00002000:00000024:1.0:1787560505.911010:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787560505.911038:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862739840:12345-0@lo:13: Request processed in 39us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560505.911044:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787560505.911745:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862738304:12345-0@lo:400: Request processed in 3341us (3729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560505.911757:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787560505.917569:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862738304:0@lo:400: 00010000:00080000:2.0:1787560505.917601:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cafeab12680 x1874392862738816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560505.917613:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862738816:0@lo:400: 00010000:00080000:2.0:1787560505.917628:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cafeab10700 x1874392862739328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560505.917638:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862739328:0@lo:400: 00010000:00080000:2.0:1787560505.917691:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec1faca80 x1874392862739840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560521 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560505.917714:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1faca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862739840:0@lo:13: 00010000:00010000:1.0:1787560506.356638:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560507.379846:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560507.444273:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1fae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862739968:0@lo:41: 00000100:00100000:0.0:1787560507.444378:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560507.444567:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862739968 00000100:00100000:1.0:1787560507.444579:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862739968 00000100:00100000:1.0:1787560507.444644:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787560507.444656:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862739968:12345-0@lo:41: 00000004:00000024:1.0:1787560507.444724:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1787560507.444798:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862739968:12345-0@lo:41: Request processed in 132us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560507.444807:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787560507.445082:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1fae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862739968:0@lo:41: 00000100:00100000:3.0:1787560508.075739:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560508.076680:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853253504 00000100:00100000:1.0:1787560508.076697:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853253504 00000100:00100000:1.0:1787560508.076813:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:1.0:1787560508.076827:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+7:6258:x1874392853253504:12345-192.168.203.29@tcp:41: 00000004:00000024:1.0:1787560508.076888:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1787560508.076988:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+7:6258:x1874392853253504:12345-192.168.203.29@tcp:41: Request processed in 165us (1263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560508.076995:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00080000:2.0:1787560508.077152:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560508.082859:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560508.082973:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853253632 00000100:00100000:2.0:1787560508.082987:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853253632 00000100:00100000:2.0:1787560508.083081:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00100000:2.0:1787560508.083094:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1fac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+6:6258:x1874392853253632:12345-192.168.203.29@tcp:41: 00000004:00000024:2.0:1787560508.083141:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787560508.083233:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1fac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+6:6258:x1874392853253632:12345-192.168.203.29@tcp:41: Request processed in 142us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560508.083241:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00080000:1.0:1787560508.083540:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787560508.089600:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560508.090666:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853253760 00000100:00100000:1.0:1787560508.090685:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853253760 00000100:00100000:1.0:1787560508.090798:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:1.0:1787560508.090811:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9331bacf-6cfc-4379-8649-925e79b19df1+6:6258:x1874392853253760:12345-192.168.203.29@tcp:13: 00002000:00000024:1.0:1787560508.090883:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787560508.090974:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9331bacf-6cfc-4379-8649-925e79b19df1+6:6258:x1874392853253760:12345-192.168.203.29@tcp:13: Request processed in 165us (1390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560508.090983:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00080000:2.0:1787560508.091060:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787560508.096851:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560508.097009:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853253888 00000100:00100000:3.0:1787560508.097024:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853253888 00000100:00100000:3.0:1787560508.097131:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:3.0:1787560508.097145:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9331bacf-6cfc-4379-8649-925e79b19df1+6:6258:x1874392853253888:12345-192.168.203.29@tcp:13: 00002000:00000024:3.0:1787560508.097190:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787560508.097279:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9331bacf-6cfc-4379-8649-925e79b19df1+6:6258:x1874392853253888:12345-192.168.203.29@tcp:13: Request processed in 136us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560508.097287:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00080000:2.0:1787560508.097404:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787560508.403926:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560508.472317:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862740096:0@lo:41: 00000100:00100000:1.0:1787560508.472473:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560508.472788:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862740096 00000100:00100000:3.0:1787560508.472799:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862740096 00000100:00100000:3.0:1787560508.472873:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787560508.472884:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1faf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862740096:12345-0@lo:41: 00000004:00000024:3.0:1787560508.472925:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787560508.472990:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1faf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862740096:12345-0@lo:41: Request processed in 107us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560508.473017:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787560508.473086:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862740096:0@lo:41: 00010000:00010000:1.0:1787560509.430731:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787560509.502556:0:9491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9331bacf-6cfc-4379-8649-925e79b19df1 00000100:00100000:3.0:1787560510.003797:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787560510.003843:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862740224:0@lo:13: 00000100:00100000:1.0:1787560510.003868:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787560510.003899:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1fadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862740352:0@lo:13: 00000100:00100000:3.0:1787560510.003937:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560510.004372:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862740224 00000100:00100000:2.0:1787560510.004385:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862740224 00000100:00100000:2.0:1787560510.004497:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787560510.004515:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862740224:12345-0@lo:13: 00002000:00000024:2.0:1787560510.004554:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1787560510.004622:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787560510.011882:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560510.012049:0:8416:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1787560510.012065:0:8416:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1787560510.012289:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862740352 00000100:00100000:0.0:1787560510.012303:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862740352 00000100:00080000:0.0:1787560510.012374:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560510.012502:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787560510.012515:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1fae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862740352:12345-0@lo:13: 00002000:00000024:0.0:1787560510.012551:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560510.018292:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1fae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862740352:12345-0@lo:13: Request processed in 5763us (6405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560510.018342:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1787560510.019266:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec1fadc00 x1874392862740352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560526 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560510.019297:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1fadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862740352:0@lo:13: 00000100:00100000:2.0:1787560510.019797:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862740224:12345-0@lo:13: Request processed in 15281us (15853us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560510.019835:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1787560510.023798:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cafffe1bb80 x1874392862740224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560526 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560510.023841:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862740224:0@lo:13: 00010000:00010000:3.0:1787560510.452691:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560510.466519:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560510.466576:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560510.466614:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560510.466641:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560510.466669:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560510.466705:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853254016 00000100:00100000:0.0:1787560510.466717:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853254016 00000100:00100000:1.0:1787560510.467300:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853254144 00000100:00100000:1.0:1787560510.467307:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853254144 00000100:00100000:1.0:1787560510.467374:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853254272 00000100:00100000:1.0:1787560510.467378:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853254272 00000100:00100000:1.0:1787560510.467402:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 52 00000100:00100000:1.0:1787560510.467414:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+7:2402:x1874392853254144:12345-192.168.203.29@tcp:400: 00000100:00100000:0.0:1787560510.467522:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 197 00000100:00100000:0.0:1787560510.467530:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5800c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+10:2402:x1874392853254016:12345-192.168.203.29@tcp:400: 00000100:00100000:1.0:1787560510.467540:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+7:2402:x1874392853254144:12345-192.168.203.29@tcp:400: Request processed in 129us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560510.467548:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 52 00000100:00100000:0.0:1787560510.467557:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5800c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+10:2402:x1874392853254016:12345-192.168.203.29@tcp:400: Request processed in 30us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560510.467563:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 197 00000100:00100000:1.0:1787560510.467568:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 53 00000100:00100000:1.0:1787560510.467575:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:2402:x1874392853254272:12345-192.168.203.29@tcp:400: 00000100:00100000:1.0:1787560510.467598:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:2402:x1874392853254272:12345-192.168.203.29@tcp:400: Request processed in 25us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560510.467599:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853254400 00000100:00100000:0.0:1787560510.467603:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853254400 00000100:00100000:1.0:1787560510.467604:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 53 00000100:00080000:1.0:1787560510.467621:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787560510.467626:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787560510.467629:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853254528 00000100:00100000:0.0:1787560510.467632:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853254528 00000100:00080000:1.0:1787560510.467644:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787560510.467646:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560510.467648:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:0.0:1787560510.467654:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+6:2402:x1874392853254400:12345-192.168.203.29@tcp:400: 00000100:00100000:0.0:1787560510.467681:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+6:2402:x1874392853254400:12345-192.168.203.29@tcp:400: Request processed in 26us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560510.467687:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:0.0:1787560510.467698:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00100000:0.0:1787560510.467704:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+5:2402:x1874392853254528:12345-192.168.203.29@tcp:400: 00000100:00100000:0.0:1787560510.468669:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+5:2402:x1874392853254528:12345-192.168.203.29@tcp:400: Request processed in 957us (1992us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560510.468693:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 15 00000001:00100000:2.0:1787560510.522219:0:7430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 9331bacf-6cfc-4379-8649-925e79b19df1 00000001:00100000:3.0:1787560510.529916:0:6478:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9331bacf-6cfc-4379-8649-925e79b19df1 00000001:02000400:3.0:1787560510.897903:0:10165:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1787560511.027817:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862740480:0@lo:13: 00000100:00100000:2.0:1787560511.027924:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560511.028037:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862740480 00000100:00100000:2.0:1787560511.028048:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862740480 00000100:00100000:2.0:1787560511.028120:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787560511.028133:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862740480:12345-0@lo:13: 00002000:00000024:2.0:1787560511.028171:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560511.028224:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862740480:12345-0@lo:13: Request processed in 94us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560511.028232:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1787560511.028256:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787560511.028292:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cafffe19c00 x1874392862740480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560527 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560511.028316:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862740480:0@lo:13: 00000100:00100000:0.0:1787560511.028660:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862740736:0@lo:400: 00000100:00100000:0.0:1787560511.028704:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560511.028727:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862741248:0@lo:400: 00000100:00100000:0.0:1787560511.028882:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560511.028902:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862741760:0@lo:400: 00000100:00100000:0.0:1787560511.028924:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560511.028944:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787560511.028950:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862740608:0@lo:400: 00000100:00100000:0.0:1787560511.028979:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560511.029011:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862741120:0@lo:400: 00000100:00100000:0.0:1787560511.029036:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560511.029053:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862741632:0@lo:400: 00000100:00100000:0.0:1787560511.029091:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560511.029124:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862740736 00000100:00100000:0.0:1787560511.029129:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862740736 00000100:00100000:0.0:1787560511.029163:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862741248 00000100:00100000:0.0:1787560511.029166:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862741248 00000100:00100000:0.0:1787560511.029182:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862741760 00000100:00100000:0.0:1787560511.029185:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862741760 00000100:00100000:0.0:1787560511.029200:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787560511.029207:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862740736:12345-0@lo:400: 00000100:00100000:0.0:1787560511.029255:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862740736:12345-0@lo:400: Request processed in 48us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560511.029262:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787560511.029278:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787560511.029293:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862741248:12345-0@lo:400: 00000100:00100000:0.0:1787560511.029324:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862741248:12345-0@lo:400: Request processed in 32us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560511.029330:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787560511.029341:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787560511.029347:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862741760:12345-0@lo:400: 00000100:00100000:0.0:1787560511.029372:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862741760:12345-0@lo:400: Request processed in 26us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560511.029378:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787560511.029401:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862740608 00000100:00100000:0.0:1787560511.029405:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862740608 00000100:00100000:2.0:1787560511.029790:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862740864:0@lo:400: 00000100:00100000:2.0:1787560511.029852:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560511.029880:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862741376:0@lo:400: 00000100:00100000:2.0:1787560511.029905:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560511.029923:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862741888:0@lo:400: 00000100:00100000:2.0:1787560511.029944:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560511.029965:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787560511.029972:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862740992:0@lo:400: 00000100:00100000:2.0:1787560511.029994:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560511.030012:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862741504:0@lo:400: 00000100:00100000:2.0:1787560511.030036:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560511.030055:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862742016:0@lo:400: 00000100:00100000:2.0:1787560511.030076:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560511.030106:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862741120 00000100:00100000:2.0:1787560511.030111:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862741120 00000100:00100000:2.0:1787560511.030146:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862740864 00000100:00100000:2.0:1787560511.030149:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862740864 00000100:00100000:2.0:1787560511.030163:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787560511.030171:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862741120:12345-0@lo:400: 00000100:00100000:2.0:1787560511.030214:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862741120:12345-0@lo:400: Request processed in 44us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560511.030221:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787560511.030235:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787560511.030241:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862740864:12345-0@lo:400: 00000100:00100000:2.0:1787560511.030272:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862740864:12345-0@lo:400: Request processed in 31us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560511.030278:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787560511.030306:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862741632 00000100:00100000:2.0:1787560511.030310:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862741632 00000100:00100000:2.0:1787560511.030328:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862741504 00000100:00100000:2.0:1787560511.030330:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862741504 00000100:00100000:2.0:1787560511.030339:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862742016 00000100:00100000:2.0:1787560511.030341:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862742016 00000100:00100000:2.0:1787560511.030359:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787560511.030365:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862741632:12345-0@lo:400: 00000100:00100000:2.0:1787560511.030399:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862741632:12345-0@lo:400: Request processed in 34us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560511.030405:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787560511.030415:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787560511.030420:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862741504:12345-0@lo:400: 00000100:00100000:0.0:1787560511.030664:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787560511.030674:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5803850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3626:x1874392862740608:12345-0@lo:400: 00000100:00100000:1.0:1787560511.031267:0:8415:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787560511.031279:0:8415:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787560511.032960:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862741120:0@lo:400: 00010000:00080000:1.0:1787560511.032988:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3885180 x1874392862741632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560511.033001:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862741632:0@lo:400: 00000100:00100000:1.0:1787560511.033017:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862740736:0@lo:400: 00000100:00100000:1.0:1787560511.033031:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862741248:0@lo:400: 00000100:00100000:1.0:1787560511.033053:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862741760:0@lo:400: 00000100:00100000:1.0:1787560511.033553:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787560511.033578:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1fadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862742144:0@lo:13: 00000100:00100000:3.0:1787560511.035725:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862741376 00000100:00100000:3.0:1787560511.035831:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862741376 00000100:00100000:3.0:1787560511.035898:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862741888 00000100:00100000:3.0:1787560511.035903:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862741888 00000100:00100000:3.0:1787560511.035924:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862740992 00000100:00100000:3.0:1787560511.035928:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862740992 00000100:00100000:3.0:1787560511.035950:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787560511.035962:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862741376:12345-0@lo:400: 00000100:00100000:0.0:1787560511.036161:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5803850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3626:x1874392862740608:12345-0@lo:400: Request processed in 5485us (7177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560511.036173:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787560511.037112:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862741504:12345-0@lo:400: Request processed in 6682us (7065us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560511.037125:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787560511.037166:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787560511.037180:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862742016:12345-0@lo:400: 00000100:00100000:2.0:1787560511.037244:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862742016:12345-0@lo:400: Request processed in 70us (7167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560511.037250:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1787560511.037316:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3885c00 x1874392862741504/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560511.037334:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862741504:0@lo:400: 00010000:00080000:2.0:1787560511.037347:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3884a80 x1874392862742016/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560511.037356:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862742016:0@lo:400: 00000100:00100000:2.0:1787560511.037394:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862740864:0@lo:400: 00000100:00100000:1.0:1787560511.038614:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560511.038693:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862740608:0@lo:400: 00000100:00100000:0.0:1787560511.040610:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862742144 00000100:00100000:0.0:1787560511.040624:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862742144 00000100:00100000:0.0:1787560511.040687:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787560511.040697:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1faca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862742144:12345-0@lo:13: 00002000:00000024:0.0:1787560511.040728:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560511.040839:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1faca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862742144:12345-0@lo:13: Request processed in 143us (2232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560511.040846:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787560511.041158:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787560511.041169:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787560511.041273:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787560511.041283:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787560511.041295:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874392862741888:12345-0@lo:400: 00000100:00100000:2.0:1787560511.041351:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874392862741888:12345-0@lo:400: Request processed in 59us (11405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560511.041357:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787560511.041373:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787560511.041379:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787560511.041386:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862740992:12345-0@lo:400: 00000100:00100000:2.0:1787560511.041417:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862740992:12345-0@lo:400: Request processed in 32us (11423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560511.041423:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787560511.041574:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862740992:0@lo:400: 00010000:00080000:2.0:1787560511.041593:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3884700 x1874392862741888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560511.041605:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862741888:0@lo:400: 00010000:00080000:0.0:1787560511.042668:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec1fadc00 x1874392862742144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560527 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560511.042696:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1fadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862742144:0@lo:13: 00000100:00100000:3.0:1787560511.043776:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862741376:12345-0@lo:400: Request processed in 7807us (13859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560511.043790:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1787560511.043843:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787560511.043851:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787560511.043854:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787560511.046714:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3887b80 x1874392862741376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560511.046849:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862741376:0@lo:400: 00010000:00010000:3.0:1787560511.483105:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787560511.545607:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9331bacf-6cfc-4379-8649-925e79b19df1 00010000:00010000:3.0:1787560512.505559:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560512.563613:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787560512.563649:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1faf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862742272:0@lo:41: 00000100:00100000:1.0:1787560512.563743:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560512.563836:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862742272 00000100:00100000:1.0:1787560512.563845:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862742272 00000100:00100000:1.0:1787560512.563908:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787560512.563919:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1fadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862742272:12345-0@lo:41: 00000004:00000024:1.0:1787560512.563966:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1787560512.564020:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1fadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862742272:12345-0@lo:41: Request processed in 102us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560512.564041:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787560512.564113:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1faf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862742272:0@lo:41: 00010000:00010000:1.0:1787560513.525056:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560513.587835:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787560513.587870:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862742400:0@lo:41: 00000100:00100000:3.0:1787560513.587979:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560513.588102:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862742400 00000100:00100000:2.0:1787560513.588114:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862742400 00000100:00100000:2.0:1787560513.588174:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787560513.588194:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862742400:12345-0@lo:41: 00000004:00000024:2.0:1787560513.588240:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787560513.588307:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862742400:12345-0@lo:41: Request processed in 115us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560513.588316:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787560513.588487:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862742400:0@lo:41: 00010000:00010000:1.0:1787560514.547653:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787560514.559040:0:10314:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec5344d50 20000000:00000080:3.0:1787560514.559064:0:10314:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9caffcb9c800 uarg=0000000000000000 20000000:01000000:3.0:1787560514.559117:0:10314:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1787560514.559120:0:10314:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1787560514.559123:0:10314:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787560514.559129:0:10314:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787560514.559135:0:10314:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1787560514.559210:0:10314:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1787560514.559213:0:10314:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787560514.560095:0:10315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1787560514.560377:0:10314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1787560514.560422:0:10314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1787560514.560617:0:10314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:3.0:1787560514.560634:0:10314:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787560514.560636:0:10314:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787560514.562051:0:10316:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:3.0:1787560514.562335:0:10314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:3.0:1787560514.562373:0:10314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:3.0:1787560514.562392:0:10314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:3.0:1787560514.562405:0:10314:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787560514.562408:0:10314:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787560514.563062:0:10317:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:3.0:1787560514.563251:0:10314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:3.0:1787560514.563279:0:10314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:3.0:1787560514.563314:0:10314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:3.0:1787560514.563329:0:10314:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787560514.563330:0:10314:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787560514.563923:0:10318:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1787560514.564246:0:10314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1787560514.564271:0:10314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1787560514.564285:0:10314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:2.0:1787560514.564297:0:10314:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787560514.564299:0:10314:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787560514.564870:0:10319:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1787560514.565405:0:10314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1787560514.565694:0:10314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1787560514.565735:0:10314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 10000000:01000000:2.0:1787560514.565756:0:10314:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787560514.565794:0:10314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9caffca49000/0x4642c20bf2f33cc6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.566065:0:10314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caffcbfee00/0x4642c20bf2f33b61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33b5a expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.566077:0:10314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caffcbff600/0x4642c20bf2f33b8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33b84 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.566085:0:10314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caffcbff000/0x4642c20bf2f33bca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33bc3 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.566093:0:10314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caffcbffa00/0x4642c20bf2f33bd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33bd1 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.566100:0:10314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caffca49400/0x4642c20bf2f33be6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33bdf expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.566118:0:10314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caffcbff800/0x4642c20bf2f33c02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33bfb expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.566124:0:10314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caffcbff400/0x4642c20bf2f33c2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33c25 expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.566130:0:10314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33c48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33c41 expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.566136:0:10314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f33c6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33c64 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.566146:0:10314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cafc0031600/0x4642c20bf2f33c80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fad1 expref: 9 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.566154:0:10314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caffca48600/0x4642c20bf2f33c87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fad8 expref: 9 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.566161:0:10314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9caffca49000/0x4642c20bf2f33cc6 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.566214:0:10314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caffca48600/0x4642c20bf2f33c87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fad8 expref: 9 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.566233:0:10314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9caffca48600/0x4642c20bf2f33c87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fad8 expref: 9 pid: 6492 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560514.566250:0:10314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe19880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10314:1874392862742528:192.168.203.29@tcp:104: 00010000:00010000:2.0:1787560514.567119:0:10314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cafc0031600/0x4642c20bf2f33c80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fad1 expref: 9 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.567145:0:10314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cafc0031600/0x4642c20bf2f33c80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fad1 expref: 9 pid: 6493 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560514.567157:0:10314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10314:1874392862742656:192.168.203.29@tcp:104: 00010000:00010000:2.0:1787560514.567211:0:10314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f33c6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f33c64 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.567220:0:10314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f33c6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f33c64 expref: 23 pid: 6494 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560514.567230:0:10314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe18000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10314:1874392862742784:0@lo:104: 00000100:00100000:2.0:1787560514.567280:0:10314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787560514.567367:0:10314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33c48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f33c41 expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.567375:0:10314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33c48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f33c41 expref: 23 pid: 6493 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560514.567383:0:10314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe19500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10314:1874392862742912:0@lo:104: 00000100:00100000:2.0:1787560514.567405:0:10314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787560514.568000:0:10314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caffcbff400/0x4642c20bf2f33c2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f33c25 expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.568010:0:10314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9caffcbff400/0x4642c20bf2f33c2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f33c25 expref: 23 pid: 6493 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560514.568019:0:10314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10314:1874392862743040:0@lo:104: 00000100:00100000:2.0:1787560514.568046:0:10314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560514.568103:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862742784 00000100:00100000:1.0:1787560514.568113:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862742784 00000100:00100000:1.0:1787560514.568166:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862742912 00000100:00100000:1.0:1787560514.568170:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862742912 00000100:00100000:1.0:1787560514.568188:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787560514.568199:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+4:10314:x1874392862742784:12345-0@lo:104: 00010000:00010000:1.0:1787560514.568216:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9caffca49800/0x4642c20bf2f33c64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33c6b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.568278:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787560514.568285:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+4:10314:x1874392862742784:12345-0@lo:104: Request processed in 88us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560514.568293:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787560514.568316:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787560514.568323:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:10314:x1874392862742912:12345-0@lo:104: 00010000:00010000:1.0:1787560514.568331:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cafc0030800/0x4642c20bf2f33c41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33c48 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.568375:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787560514.568381:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:10314:x1874392862742912:12345-0@lo:104: Request processed in 59us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560514.568387:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1787560514.568416:0:9501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787560514.568423:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caffca49800/0x4642c20bf2f33c64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33c6b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.568450:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49800 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:1.0:1787560514.568455:0:9501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caffca49800/0x4642c20bf2f33c64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33c6b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.568464:0:9501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caffca49800/0x4642c20bf2f33c64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33c6b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560514.568471:0:9501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caffca49800/0x4642c20bf2f33c64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33c6b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560514.568476:0:9501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787560514.568511:0:9501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caffca49800/0x4642c20bf2f33c64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33c6b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.568523:0:9501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560514.568545:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caffca49800/0x4642c20bf2f33c64 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33c6b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.568551:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caffca49800/0x4642c20bf2f33c64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33c6b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.568567:0:9501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560514.568569:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cafc0030800/0x4642c20bf2f33c41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33c48 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.568574:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafc0030800 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:1.0:1787560514.568577:0:9501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cafc0030800/0x4642c20bf2f33c41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33c48 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.568590:0:9501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cafc0030800/0x4642c20bf2f33c41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33c48 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560514.568595:0:9501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cafc0030800/0x4642c20bf2f33c41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33c48 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560514.568600:0:9501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787560514.568616:0:9501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cafc0030800/0x4642c20bf2f33c41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33c48 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.568621:0:9501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560514.568636:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cafc0030800/0x4642c20bf2f33c41 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33c48 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.568642:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cafc0030800/0x4642c20bf2f33c41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33c48 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.568652:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560514.568653:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560514.568655:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560514.568683:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1faf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862743168:0@lo:103: 00000100:00100000:1.0:1787560514.568719:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560514.568760:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862743296:0@lo:103: 00000100:00100000:1.0:1787560514.568798:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560514.568834:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862743168 00000100:00100000:1.0:1787560514.568838:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862743168 00010000:00010000:1.0:1787560514.568858:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f33c6b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33c64 expref: 24 pid: 6494 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560514.568893:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862743296 00000100:00100000:1.0:1787560514.568896:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862743296 00010000:00010000:1.0:1787560514.568908:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33c48 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33c41 expref: 25 pid: 6493 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560514.568924:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787560514.568944:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd7cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+25:3624:x1874392862743168:12345-0@lo:103: 00010000:00010000:1.0:1787560514.568956:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560514.568963:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f33c6b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33c64 expref: 25 pid: 6494 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.568972:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f33c6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f33c64 expref: 25 pid: 6494 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.568993:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560514.569022:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd7cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+25:3624:x1874392862743168:12345-0@lo:103: Request processed in 81us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560514.569028:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787560514.569067:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787560514.569074:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2006a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3625:x1874392862743296:12345-0@lo:103: 00010000:00010000:1.0:1787560514.569081:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560514.569085:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33c48 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33c41 expref: 24 pid: 6493 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.569092:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33c48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f33c41 expref: 24 pid: 6493 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.569102:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560514.569135:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2006a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3625:x1874392862743296:12345-0@lo:103: Request processed in 62us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560514.569142:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787560514.569184:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862743296:0@lo:103: 00000100:00100000:1.0:1787560514.569207:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1faf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862743168:0@lo:103: 00010000:00010000:3.0:1787560514.571695:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560514.572015:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862743040 00000100:00100000:3.0:1787560514.572027:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862743040 00010000:00010000:2.0:1787560514.572039:0:10314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caffcbff800/0x4642c20bf2f33c02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f33bfb expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.572059:0:10314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9caffcbff800/0x4642c20bf2f33c02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f33bfb expref: 23 pid: 6494 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560514.572075:0:10314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10314:1874392862743424:0@lo:104: 00000100:00100000:3.0:1787560514.572081:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787560514.572094:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec32c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:10314:x1874392862743040:12345-0@lo:104: 00010000:00010000:3.0:1787560514.572110:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe000/0x4642c20bf2f33c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33c2c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560514.572205:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787560514.572213:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec32c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:10314:x1874392862743040:12345-0@lo:104: Request processed in 122us (4166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560514.572220:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1787560514.572472:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560514.572481:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe000/0x4642c20bf2f33c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33c2c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.572489:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbfe000 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:1.0:1787560514.572495:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe000/0x4642c20bf2f33c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33c2c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.572506:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe000/0x4642c20bf2f33c25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33c2c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560514.572515:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe000/0x4642c20bf2f33c25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33c2c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560514.572521:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787560514.572544:0:10314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787560514.572581:0:10314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caffca49400/0x4642c20bf2f33be6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f33bdf expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.572592:0:10314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9caffca49400/0x4642c20bf2f33be6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f33bdf expref: 23 pid: 6493 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560514.572602:0:10314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10314:1874392862743552:0@lo:104: 00010000:00010000:1.0:1787560514.572624:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe000/0x4642c20bf2f33c25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33c2c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.572632:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787560514.572637:0:10314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caffcbffa00/0x4642c20bf2f33bd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f33bd1 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.572648:0:10314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9caffcbffa00/0x4642c20bf2f33bd8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f33bd1 expref: 23 pid: 6492 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.572655:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe000/0x4642c20bf2f33c25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33c2c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560514.572659:0:10314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10314:1874392862743808:0@lo:104: 00010000:00010000:1.0:1787560514.572671:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe000/0x4642c20bf2f33c25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33c2c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.572702:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560514.572704:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560514.572707:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560514.572711:0:10314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caffcbff000/0x4642c20bf2f33bca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f33bc3 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560514.572725:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862743680:0@lo:103: 00010000:00010000:2.0:1787560514.572730:0:10314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9caffcbff000/0x4642c20bf2f33bca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f33bc3 expref: 23 pid: 6492 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560514.572742:0:10314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10314:1874392862743936:0@lo:104: 00000100:00100000:1.0:1787560514.572774:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787560514.572792:0:10314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caffcbff600/0x4642c20bf2f33b8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f33b84 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.572810:0:10314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9caffcbff600/0x4642c20bf2f33b8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f33b84 expref: 23 pid: 6492 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560514.572820:0:10314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10314:1874392862744064:0@lo:104: 00000100:00100000:1.0:1787560514.572835:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862743680 00000100:00100000:1.0:1787560514.572841:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862743680 00010000:00010000:2.0:1787560514.572861:0:10314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caffcbfee00/0x4642c20bf2f33b61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f33b5a expref: 24 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.572870:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caffcbff400/0x4642c20bf2f33c2c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33c25 expref: 24 pid: 6493 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.572874:0:10314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9caffcbfee00/0x4642c20bf2f33b61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f33b5a expref: 24 pid: 6494 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560514.572895:0:10314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10314:1874392862744192:0@lo:104: 00000100:00100000:1.0:1787560514.572913:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787560514.572917:0:10314:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd7c29cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560514.572926:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2007100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3626:x1874392862743680:12345-0@lo:103: 00010000:00010000:2.0:1787560514.572944:0:10314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f33c6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f33c64 expref: 24 pid: 6494 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.572955:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787560514.572959:0:10314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe18000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10314:1874392862742784:0@lo:104: 00010000:00010000:1.0:1787560514.572965:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caffcbff400/0x4642c20bf2f33c2c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33c25 expref: 23 pid: 6493 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.572976:0:10314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f33c48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f33c41 expref: 23 pid: 6493 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.572980:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caffcbff400/0x4642c20bf2f33c2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f33c25 expref: 23 pid: 6493 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560514.572990:0:10314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe19500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10314:1874392862742912:0@lo:104: 00010000:00010000:2.0:1787560514.573002:0:10314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffcbff400/0x4642c20bf2f33c2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f33c25 expref: 22 pid: 6493 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.573006:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560514.573013:0:10314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10314:1874392862743040:0@lo:104: 00000100:00100000:1.0:1787560514.573052:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2007100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:3626:x1874392862743680:12345-0@lo:103: Request processed in 129us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560514.573060:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787560514.573064:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862743680:0@lo:103: 00000100:00100000:0.0:1787560514.573230:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862743424 00000100:00100000:0.0:1787560514.573236:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862743424 00000100:00100000:0.0:1787560514.573273:0:6482:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787560514.573293:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560514.573305:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560514.573313:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560514.573321:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560514.573328:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560514.573334:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862743552 00000100:00100000:0.0:1787560514.573337:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862743552 00000100:00100000:0.0:1787560514.573350:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862743808 00000100:00100000:0.0:1787560514.573353:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862743808 00000100:00100000:0.0:1787560514.573361:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862743936 00000100:00100000:0.0:1787560514.573363:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862743936 00000100:00100000:0.0:1787560514.573370:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862744064 00000100:00100000:0.0:1787560514.573372:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862744064 00000100:00100000:0.0:1787560514.573380:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862744192 00000100:00100000:0.0:1787560514.573382:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862744192 00000100:00100000:0.0:1787560514.573394:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787560514.573401:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b88450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+8:10314:x1874392862743424:12345-0@lo:104: 00010000:00010000:0.0:1787560514.573410:0:6482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f33bfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33c02 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560514.573480:0:6482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787560514.573485:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b88450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+8:10314:x1874392862743424:12345-0@lo:104: Request processed in 86us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560514.573492:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787560514.573538:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787560514.573543:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3885f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+7:10314:x1874392862743552:12345-0@lo:104: 00010000:00010000:0.0:1787560514.573551:0:6482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9caffcbfec00/0x4642c20bf2f33bdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33be6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560514.573581:0:6482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787560514.573586:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3885f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+7:10314:x1874392862743552:12345-0@lo:104: Request processed in 43us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560514.573592:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787560514.573604:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787560514.573610:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3886300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+6:10314:x1874392862743808:12345-0@lo:104: 00010000:00010000:0.0:1787560514.573617:0:6482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33bd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33bd8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560514.573651:0:6482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787560514.573657:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3886300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+6:10314:x1874392862743808:12345-0@lo:104: Request processed in 48us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560514.573663:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787560514.573674:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787560514.573681:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3887480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+5:10314:x1874392862743936:12345-0@lo:104: 00010000:00010000:0.0:1787560514.573689:0:6482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f33bc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33bca expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560514.573719:0:6482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787560514.573724:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3887480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+5:10314:x1874392862743936:12345-0@lo:104: Request processed in 45us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560514.573729:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787560514.573751:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787560514.573757:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3886680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+4:10314:x1874392862744064:12345-0@lo:104: 00010000:00010000:0.0:1787560514.573765:0:6482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6400/0x4642c20bf2f33b84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33b8b expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560514.573809:0:6482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1787560514.573814:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3886680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+4:10314:x1874392862744064:12345-0@lo:104: Request processed in 58us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560514.573819:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787560514.573830:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787560514.573835:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3886a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:10314:x1874392862744192:12345-0@lo:104: 00010000:00010000:0.0:1787560514.573842:0:6482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f33b5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33b61 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560514.573867:0:6482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1787560514.573872:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3886a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:10314:x1874392862744192:12345-0@lo:104: Request processed in 38us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560514.573878:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1787560514.574013:0:9500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1787560514.574019:0:9500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f33bfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33c02 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.574027:0:9500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbffc00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:1.0:1787560514.574039:0:9500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f33bfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33c02 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.574046:0:9500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f33bfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33c02 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560514.574052:0:9500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f33bfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33c02 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560514.574057:0:9500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787560514.574112:0:6487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787560514.574118:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caffcbfec00/0x4642c20bf2f33bdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33be6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560514.574126:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbfec00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560514.574129:0:6487:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caffcbfec00/0x4642c20bf2f33bdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33be6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560514.574136:0:6487:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caffcbfec00/0x4642c20bf2f33bdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33be6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560514.574143:0:6487:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caffcbfec00/0x4642c20bf2f33bdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33be6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560514.574148:0:6487:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787560514.574186:0:6487:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caffcbfec00/0x4642c20bf2f33bdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33be6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560514.574192:0:6487:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560514.574209:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caffcbfec00/0x4642c20bf2f33bdf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33be6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560514.574216:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caffcbfec00/0x4642c20bf2f33bdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33be6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560514.574239:0:6487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787560514.574243:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33bd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33bd8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560514.574249:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6200 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560514.574252:0:6487:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33bd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33bd8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560514.574258:0:6487:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33bd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33bd8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560514.574264:0:6487:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33bd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33bd8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560514.574268:0:6487:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787560514.574283:0:6487:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33bd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33bd8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560514.574289:0:6487:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560514.574294:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33bd1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33bd8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560514.574300:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33bd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33bd8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560514.574309:0:6487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787560514.574312:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f33bc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33bca expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560514.574328:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7e00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560514.574331:0:6487:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f33bc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33bca expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560514.574337:0:6487:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f33bc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33bca expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560514.574343:0:6487:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f33bc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33bca expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560514.574348:0:6487:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787560514.574363:0:6487:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f33bc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33bca expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560514.574369:0:6487:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560514.574384:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f33bc3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33bca expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560514.574391:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f33bc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33bca expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560514.574400:0:6487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787560514.574403:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6400/0x4642c20bf2f33b84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33b8b expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560514.574409:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6400 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560514.574411:0:6487:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6400/0x4642c20bf2f33b84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33b8b expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560514.574445:0:6487:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6400/0x4642c20bf2f33b84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33b8b expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560514.574453:0:6487:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6400/0x4642c20bf2f33b84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33b8b expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560514.574458:0:6487:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787560514.574473:0:6487:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6400/0x4642c20bf2f33b84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33b8b expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560514.574478:0:6487:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560514.574484:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6400/0x4642c20bf2f33b84 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33b8b expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560514.574489:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6400/0x4642c20bf2f33b84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33b8b expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560514.574498:0:6487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560514.574501:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f33b5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33b61 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560514.574506:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7200 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560514.574508:0:6487:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f33b5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33b61 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560514.574515:0:6487:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f33b5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33b61 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560514.574522:0:6487:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f33b5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33b61 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560514.574533:0:6487:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787560514.574547:0:6487:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f33b5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33b61 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560514.574553:0:6487:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560514.574557:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f33b5a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33b61 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560514.574563:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f33b5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33b61 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560514.574573:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560514.574574:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560514.574576:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560514.574591:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862744704:0@lo:103: 00000100:00100000:2.0:1787560514.574642:0:10314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10314:1874392862743424:0@lo:104: 00000100:00100000:2.0:1787560514.575311:0:10314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10314:1874392862743552:0@lo:104: 00000100:00100000:2.0:1787560514.575324:0:10314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10314:1874392862743808:0@lo:104: 00000100:00100000:3.0:1787560514.575332:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560514.575339:0:10314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10314:1874392862743936:0@lo:104: 00000100:00100000:2.0:1787560514.575350:0:10314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10314:1874392862744064:0@lo:104: 00000100:00100000:2.0:1787560514.575362:0:10314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10314:1874392862744192:0@lo:104: 00000100:00100000:3.0:1787560514.575396:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787560514.575404:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862744576:0@lo:103: 00000100:00100000:3.0:1787560514.575451:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787560514.575544:0:9500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f33bfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33c02 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.575554:0:9500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560514.575561:0:9500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f33bfb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33c02 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.575567:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f33bfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33c02 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560514.575577:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862744704 00000100:00100000:2.0:1787560514.575586:0:9502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862744704 00010000:00010000:1.0:1787560514.575587:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560514.575590:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560514.575592:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560514.575605:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862744576 00000100:00100000:1.0:1787560514.575610:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862744576 00010000:00010000:2.0:1787560514.575622:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caffcbff600/0x4642c20bf2f33b8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33b84 expref: 22 pid: 6492 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.575634:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caffcbff000/0x4642c20bf2f33bca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33bc3 expref: 22 pid: 6492 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560514.575670:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787560514.575680:0:9502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:3626:x1874392862744704:12345-0@lo:103: 00010000:00010000:2.0:1787560514.575694:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560514.575701:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caffcbff600/0x4642c20bf2f33b8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33b84 expref: 22 pid: 6492 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.575711:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caffcbff600/0x4642c20bf2f33b8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f33b84 expref: 22 pid: 6492 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.575736:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffcbff600/0x4642c20bf2f33b8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f33b84 expref: 22 pid: 6492 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.575752:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560514.575805:0:9502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:3626:x1874392862744704:12345-0@lo:103: Request processed in 126us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560514.575813:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787560514.575840:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787560514.575847:0:9502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:3626:x1874392862744576:12345-0@lo:103: 00010000:00010000:2.0:1787560514.575863:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560514.575868:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caffcbff000/0x4642c20bf2f33bca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33bc3 expref: 20 pid: 6492 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.575874:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caffcbff000/0x4642c20bf2f33bca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f33bc3 expref: 20 pid: 6492 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.575883:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffcbff000/0x4642c20bf2f33bca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f33bc3 expref: 20 pid: 6492 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.575891:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560514.575913:0:9502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f30da5a7-84ca-46bc-bf14-dc2a954107e6+19:3626:x1874392862744576:12345-0@lo:103: Request processed in 68us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560514.575920:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787560514.578405:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862744320:0@lo:103: 00000100:00100000:1.0:1787560514.578512:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560514.578567:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862744832:0@lo:103: 00000100:00100000:1.0:1787560514.578608:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560514.578628:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787560514.578634:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862744448:0@lo:103: 00000100:00100000:1.0:1787560514.578659:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560514.578670:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862744960:0@lo:103: 00000100:00100000:1.0:1787560514.578691:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560514.578714:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862744320 00000100:00100000:1.0:1787560514.578724:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862744320 00010000:00010000:1.0:1787560514.578765:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caffca49400/0x4642c20bf2f33be6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33bdf expref: 19 pid: 6493 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560514.578799:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862744832 00000100:00100000:1.0:1787560514.578802:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862744832 00010000:00010000:1.0:1787560514.578814:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caffcbfee00/0x4642c20bf2f33b61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33b5a expref: 20 pid: 6494 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560514.578824:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862744448 00000100:00100000:1.0:1787560514.578826:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862744448 00010000:00010000:1.0:1787560514.578835:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caffcbffa00/0x4642c20bf2f33bd8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33bd1 expref: 21 pid: 6492 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560514.578844:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862744960 00000100:00100000:1.0:1787560514.578847:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862744960 00010000:00010000:1.0:1787560514.578858:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caffcbff800/0x4642c20bf2f33c02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33bfb expref: 22 pid: 6494 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560514.578872:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787560514.578882:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2005180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:3623:x1874392862744320:12345-0@lo:103: 00010000:00010000:1.0:1787560514.578898:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560514.578904:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caffca49400/0x4642c20bf2f33be6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33bdf expref: 22 pid: 6493 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.578923:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caffca49400/0x4642c20bf2f33be6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f33bdf expref: 22 pid: 6493 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.578955:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca49400/0x4642c20bf2f33be6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f33bdf expref: 22 pid: 6493 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.578974:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560514.579012:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2005180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:3623:x1874392862744320:12345-0@lo:103: Request processed in 131us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560514.579018:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787560514.579037:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787560514.579043:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2004380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:3623:x1874392862744832:12345-0@lo:103: 00010000:00010000:1.0:1787560514.579051:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560514.579055:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caffcbfee00/0x4642c20bf2f33b61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33b5a expref: 20 pid: 6494 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.579063:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caffcbfee00/0x4642c20bf2f33b61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f33b5a expref: 20 pid: 6494 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.579072:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffcbfee00/0x4642c20bf2f33b61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f33b5a expref: 20 pid: 6494 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.579081:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560514.579102:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2004380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+19:3623:x1874392862744832:12345-0@lo:103: Request processed in 59us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560514.579108:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787560514.579120:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787560514.579126:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd7cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:3623:x1874392862744448:12345-0@lo:103: 00010000:00010000:1.0:1787560514.579139:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560514.579144:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caffcbffa00/0x4642c20bf2f33bd8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33bd1 expref: 18 pid: 6492 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.579152:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caffcbffa00/0x4642c20bf2f33bd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f33bd1 expref: 18 pid: 6492 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.579160:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffcbffa00/0x4642c20bf2f33bd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f33bd1 expref: 18 pid: 6492 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.579170:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560514.579191:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd7cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:3623:x1874392862744448:12345-0@lo:103: Request processed in 67us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560514.579197:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787560514.579233:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787560514.579240:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2004e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:3623:x1874392862744960:12345-0@lo:103: 00010000:00010000:1.0:1787560514.579248:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560514.579252:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caffcbff800/0x4642c20bf2f33c02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33bfb expref: 16 pid: 6494 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.579261:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caffcbff800/0x4642c20bf2f33c02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f33bfb expref: 16 pid: 6494 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.579271:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffcbff800/0x4642c20bf2f33c02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f33bfb expref: 16 pid: 6494 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560514.579280:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560514.579301:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2004e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:3623:x1874392862744960:12345-0@lo:103: Request processed in 62us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560514.579306:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1787560514.579345:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560514.579354:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560514.579383:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862744448:0@lo:103: 00000100:00100000:1.0:1787560514.579392:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862744960:0@lo:103: 00000100:00100000:1.0:1787560514.579399:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862744320:0@lo:103: 00000100:00100000:1.0:1787560514.579405:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862744832:0@lo:103: 00000100:00100000:3.0:1787560514.579887:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862744576:0@lo:103: 00000100:00100000:3.0:1787560514.579897:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862744704:0@lo:103: 00000100:00100000:1.0:1787560514.583583:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560514.583809:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853254656 00000100:00100000:3.0:1787560514.583832:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853254656 00010000:00010000:3.0:1787560514.583883:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cafc0031600/0x4642c20bf2f33c80 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fad1 expref: 10 pid: 6493 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560514.583933:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 33 00000100:00100000:3.0:1787560514.583966:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2006680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a608f87b-4315-497d-a70e-0ed75a6814da+10:2402:x1874392853254656:12345-192.168.203.29@tcp:103: 00010000:00010000:3.0:1787560514.583987:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560514.583995:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cafc0031600/0x4642c20bf2f33c80 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fad1 expref: 10 pid: 6493 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560514.584008:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cafc0031600/0x4642c20bf2f33c80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fad1 expref: 10 pid: 6493 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560514.584034:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560514.584108:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2006680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a608f87b-4315-497d-a70e-0ed75a6814da+10:2402:x1874392853254656:12345-192.168.203.29@tcp:103: Request processed in 144us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560514.584115:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 33 00000100:00100000:2.0:1787560514.586205:0:10314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe19880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10314:1874392862742528:192.168.203.29@tcp:104: 00010000:00010000:2.0:1787560514.586230:0:10314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafc0031600/0x4642c20bf2f33c80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fad1 expref: 9 pid: 6493 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560514.586251:0:10314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10314:1874392862742656:192.168.203.29@tcp:104: 00010000:00010000:2.0:1787560514.586306:0:10314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9caffca49000/0x4642c20bf2f33cc6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560514.587184:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560514.587264:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853254784 00000100:00100000:2.0:1787560514.587275:0:9502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853254784 00010000:00010000:2.0:1787560514.587319:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caffca48600/0x4642c20bf2f33c87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fad8 expref: 9 pid: 6492 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560514.587359:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 34 00000100:00100000:2.0:1787560514.587370:0:9502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2006a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a608f87b-4315-497d-a70e-0ed75a6814da+9:2405:x1874392853254784:12345-192.168.203.29@tcp:103: 00010000:00010000:2.0:1787560514.587403:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560514.587409:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caffca48600/0x4642c20bf2f33c87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fad8 expref: 9 pid: 6492 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.587422:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caffca48600/0x4642c20bf2f33c87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fad8 expref: 9 pid: 6492 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.587466:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca48600/0x4642c20bf2f33c87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fad8 expref: 9 pid: 6492 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.587484:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9caffca49000/0x4642c20bf2f33cc6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.587493:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca49000/0x4642c20bf2f33cc6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.587511:0:9502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9caffca49000/0x4642c20bf2f33cc6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.587518:0:9502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9caffca49000/0x4642c20bf2f33cc6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.587525:0:9502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9caffca49000/0x4642c20bf2f33cc6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.587531:0:9502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9caffca49000/0x4642c20bf2f33cc6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.587538:0:9502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49000 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:2.0:1787560514.587543:0:9502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9caffca49000/0x4642c20bf2f33cc6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.587562:0:9502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9caffca49000/0x4642c20bf2f33cc6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.587582:0:9502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9caffca49000/0x4642c20bf2f33cc6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.587592:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787560514.587713:0:10314:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9caffca49000/0x4642c20bf2f33cc6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560514.587731:0:10314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9caffca49000/0x4642c20bf2f33cc6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560514.587738:0:10314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca49000/0x4642c20bf2f33cc6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560514.587866:0:9502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2006a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a608f87b-4315-497d-a70e-0ed75a6814da+8:2405:x1874392853254784:12345-192.168.203.29@tcp:103: Request processed in 496us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560514.587875:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 34 00000100:00100000:0.0:1787560514.775958:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560514.777010:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853254912 00000100:00100000:2.0:1787560514.777029:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853254912 00000100:00100000:2.0:1787560514.777853:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 199 00000100:00100000:2.0:1787560514.777872:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5800450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+8:6179:x1874392853254912:12345-192.168.203.29@tcp:101: 00010000:00010000:2.0:1787560514.777895:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560514.777919:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca48600/0x4642c20bf2f33ccd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fb48 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.777954:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca48600/0x4642c20bf2f33ccd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb48 expref: 9 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.777967:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca48600/0x4642c20bf2f33ccd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb48 expref: 9 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560514.777978:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca48600, rc 0) 00000100:00100000:2.0:1787560514.778241:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5800450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+9:6179:x1874392853254912:12345-192.168.203.29@tcp:101: Request processed in 372us (2290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560514.778249:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 199 00000100:00100000:0.0:1787560514.786035:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560514.786152:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853255040 00000100:00100000:3.0:1787560514.786165:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853255040 00000100:00100000:3.0:1787560514.786297:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 200 00000100:00100000:3.0:1787560514.786310:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5800050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+9:6179:x1874392853255040:12345-192.168.203.29@tcp:501: 00000100:00100000:3.0:1787560514.790229:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5800050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+9:6179:x1874392853255040:12345-192.168.203.29@tcp:501: Request processed in 217us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560514.790252:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 200 00000100:00100000:2.0:1787560514.790549:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560514.790653:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853255168 00000100:00100000:3.0:1787560514.790664:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853255168 00000100:00100000:3.0:1787560514.790723:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 201 00000100:00100000:3.0:1787560514.790733:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5802c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+9:6179:x1874392853255168:12345-192.168.203.29@tcp:503: 00000100:00100000:3.0:1787560514.790939:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5802c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+9:6179:x1874392853255168:12345-192.168.203.29@tcp:503: Request processed in 207us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560514.790946:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 201 00000100:00100000:0.0:1787560514.798619:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560514.799055:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853255296 00000100:00100000:3.0:1787560514.799085:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853255296 00000100:00100000:3.0:1787560514.799156:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 202 00000100:00100000:3.0:1787560514.799168:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+9:6653:x1874392853255296:12345-192.168.203.29@tcp:502: 00000100:00100000:3.0:1787560514.799364:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+9:6653:x1874392853255296:12345-192.168.203.29@tcp:502: Request processed in 198us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560514.799373:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 202 00000100:00100000:0.0:1787560514.802847:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560514.802890:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853255424 00000100:00100000:0.0:1787560514.802902:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853255424 00000100:00100000:0.0:1787560514.802959:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 203 00000100:00100000:0.0:1787560514.802972:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+9:6653:x1874392853255424:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787560514.803163:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+9:6653:x1874392853255424:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 193us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560514.803172:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 203 00000100:00100000:2.0:1787560514.810765:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560514.810987:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853255552 00000100:00100000:0.0:1787560514.811001:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853255552 00000100:00100000:0.0:1787560514.811134:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 204 00000100:00100000:0.0:1787560514.811146:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+9:6179:x1874392853255552:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787560514.811168:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560514.811191:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafc0030800/0x4642c20bf2f33cd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fb4f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560514.811226:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafc0030800/0x4642c20bf2f33cd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb4f expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560514.811238:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafc0030800/0x4642c20bf2f33cd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb4f expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560514.811250:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafc0030800, rc 0) 00000100:00100000:0.0:1787560514.814398:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+10:6179:x1874392853255552:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 Request processed in 3236us (3685us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560514.814415:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 204 00000100:00100000:0.0:1787560514.816728:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560514.816890:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853255680 00000100:00100000:3.0:1787560514.816903:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853255680 00000100:00100000:3.0:1787560514.816961:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 205 00000100:00100000:3.0:1787560514.816973:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+10:6179:x1874392853255680:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560514.817184:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+10:6179:x1874392853255680:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 Request processed in 212us (469us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787560514.817194:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 205 00000100:00100000:0.0:1787560515.125243:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787560515.125278:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862745088:0@lo:13: 00000100:00100000:0.0:1787560515.125374:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560515.126223:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862745088 00000100:00100000:1.0:1787560515.126238:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862745088 00000100:00100000:1.0:1787560515.126323:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787560515.126339:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862745088:12345-0@lo:13: 00002000:00000024:1.0:1787560515.126376:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787560515.126477:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862745088:12345-0@lo:13: Request processed in 143us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560515.126485:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1787560515.126608:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2007100 x1874392862745088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560531 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560515.126634:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862745088:0@lo:13: 00000100:00080000:3.0:1787560515.126887:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787560515.127177:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787560515.127191:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862745216:0@lo:13: 00000100:00100000:3.0:1787560515.127242:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560515.128919:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862745216 00000100:00100000:2.0:1787560515.128937:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862745216 00000100:00100000:2.0:1787560515.129032:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787560515.129044:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862745216:12345-0@lo:13: 00002000:00000024:2.0:1787560515.129088:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560515.129189:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862745216:12345-0@lo:13: Request processed in 148us (1946us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560515.129197:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1787560515.129380:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec32c7480 x1874392862745216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560531 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560515.129405:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862745216:0@lo:13: 00000100:00080000:3.0:1787560515.129572:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787560515.573206:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560515.581376:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560515.581535:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560515.581654:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853255936 00000100:00100000:2.0:1787560515.581668:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853255936 00000100:00100000:2.0:1787560515.581771:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 60 00000100:00100000:2.0:1787560515.581797:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:2405:x1874392853255936:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560515.581894:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:2405:x1874392853255936:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 100us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560515.581903:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 60 00000100:00080000:0.0:1787560515.582379:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560515.583393:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560515.583451:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560515.583481:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560515.583550:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853256064 00000100:00100000:2.0:1787560515.583562:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853256064 00000100:00100000:2.0:1787560515.583646:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 61 00000100:00100000:2.0:1787560515.583658:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2007100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+5:2405:x1874392853256064:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560515.583749:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2007100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+5:2405:x1874392853256064:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 93us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560515.583758:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 61 00000100:00080000:0.0:1787560515.585220:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787560515.585248:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853255808 00000100:00100000:0.0:1787560515.585258:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853255808 00000100:00100000:0.0:1787560515.585337:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 206 00000100:00100000:0.0:1787560515.585348:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+10:2405:x1874392853255808:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560515.585418:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+10:2405:x1874392853255808:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 73us (2034us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560515.585425:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 206 00000100:00100000:3.0:1787560515.591403:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853256192 00000100:00100000:3.0:1787560515.591425:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853256192 00000100:00100000:3.0:1787560515.591580:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853256320 00000100:00080000:0.0:1787560515.591832:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787560515.593982:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853256320 00000100:00080000:0.0:1787560515.594726:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787560515.595834:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:2.0:1787560515.595868:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+5:2405:x1874392853256192:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560515.596019:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+5:2405:x1874392853256192:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 170us (14586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560515.596029:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:2.0:1787560515.596059:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:2.0:1787560515.596067:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+5:2405:x1874392853256320:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560515.596905:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+5:2405:x1874392853256320:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 831us (13415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560515.596915:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 20 10000000:01000000:0.0:1787560515.635580:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787560515.635600:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9caec1ef6000 from 48 10000000:01000000:0.0:1787560515.635608:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787560515.635674:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc0031000/0x4642c20bf2f33cdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560515.635688:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cafc0031000/0x4642c20bf2f33cdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560515.635731:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cafc0031000/0x4642c20bf2f33cdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560515.635788:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3885500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862745344:0@lo:101: 00000100:00100000:0.0:1787560515.635883:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560515.635943:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2600 going to sleep for 11 seconds 00000100:00100000:3.0:1787560515.637513:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862745344 00000100:00100000:3.0:1787560515.637528:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862745344 00000100:00100000:2.0:1787560515.637729:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787560515.637755:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+15:6497:x1874392862745344:12345-0@lo:101: 00010000:00010000:2.0:1787560515.637789:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560515.637814:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca48800/0x4642c20bf2f33ce2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33cdb expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560515.637846:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca48800/0x4642c20bf2f33ce2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33cdb expref: 16 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560515.637860:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca48800/0x4642c20bf2f33ce2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33cdb expref: 16 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560515.637871:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca48800, rc 0) 00000100:00100000:2.0:1787560515.637960:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:6497:x1874392862745344:12345-0@lo:101: Request processed in 219us (2076us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560515.637966:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787560515.638975:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3885500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862745344:0@lo:101: 00010000:00010000:0.0:1787560515.639004:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cafc0031000/0x4642c20bf2f33cdb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33ce2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560515.639017:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cafc0031000/0x4642c20bf2f33cdb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33ce2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560515.639219:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3885500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862745472:0@lo:501: 00000100:00100000:0.0:1787560515.639279:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560515.639377:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2600 going to sleep for 11 seconds 00000100:00100000:2.0:1787560515.645070:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862745472 00000100:00100000:2.0:1787560515.645090:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862745472 00000100:00100000:2.0:1787560515.645280:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787560515.645293:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:6497:x1874392862745472:12345-0@lo:501: 00000100:00100000:2.0:1787560515.645567:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:6497:x1874392862745472:12345-0@lo:501: Request processed in 275us (6287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560515.645576:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787560515.645698:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3885500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862745472:0@lo:501: 00000100:00100000:1.0:1787560515.645770:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862745600:0@lo:503: 00000100:00100000:1.0:1787560515.645841:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560515.652203:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862745600 00000100:00100000:3.0:1787560515.652225:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862745600 00000100:00100000:2.0:1787560515.652449:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787560515.652464:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:6497:x1874392862745600:12345-0@lo:503: 00000100:00100000:2.0:1787560515.652698:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:6497:x1874392862745600:12345-0@lo:503: Request processed in 237us (6856us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560515.652715:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787560515.654352:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec22aae40 going to sleep for 11 seconds 00000100:00100000:0.0:1787560515.654408:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862745600:0@lo:503: 00000100:00100000:3.0:1787560515.657128:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10332:1874392862745728:0@lo:502: 00000100:00100000:3.0:1787560515.657451:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560515.657504:0:10332:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c80d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787560515.657508:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862745728 00000100:00100000:2.0:1787560515.657519:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862745728 00000100:00100000:2.0:1787560515.657636:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1787560515.657663:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:10332:x1874392862745728:12345-0@lo:502: 00000100:00100000:2.0:1787560515.657850:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:10332:x1874392862745728:12345-0@lo:502: Request processed in 202us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560515.657859:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787560515.657892:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10332:1874392862745728:0@lo:502: 00000100:00100000:3.0:1787560515.657948:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10332:1874392862745856:0@lo:502: 00000100:00100000:3.0:1787560515.657987:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560515.662675:0:10332:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c80d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787560515.663582:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862745856 00000100:00100000:0.0:1787560515.663597:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862745856 00000100:00100000:0.0:1787560515.663670:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787560515.663682:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:10332:x1874392862745856:12345-0@lo:502: 00000100:00100000:0.0:1787560515.663930:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:10332:x1874392862745856:12345-0@lo:502: Request processed in 249us (5941us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560515.663940:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1787560515.664075:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10332:1874392862745856:0@lo:502: 00000040:00080000:3.0:1787560515.664128:0:10332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787560515.664577:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1787560515.664610:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787560515.664620:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc0031000/0x4642c20bf2f33cdb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33ce2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560515.664632:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cafc0031000/0x4642c20bf2f33cdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33ce2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560515.664643:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1787560515.664646:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1787560515.664649:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787560515.664687:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc0030600/0x4642c20bf2f33ce9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560515.664694:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cafc0030600/0x4642c20bf2f33ce9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560515.664705:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cafc0030600/0x4642c20bf2f33ce9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560515.664727:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3885500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862745984:0@lo:101: 00000100:00100000:0.0:1787560515.664785:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560515.664829:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2900 going to sleep for 11 seconds 00000100:00100000:1.0:1787560515.668548:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862745984 00000100:00100000:1.0:1787560515.668593:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862745984 00000100:00100000:1.0:1787560515.668679:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1787560515.668693:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+16:6497:x1874392862745984:12345-0@lo:101: 00010000:00010000:1.0:1787560515.668715:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560515.668739:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffcbfee00/0x4642c20bf2f33cf0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33ce9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560515.668786:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffcbfee00/0x4642c20bf2f33cf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33ce9 expref: 17 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560515.668798:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffcbfee00/0x4642c20bf2f33cf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33ce9 expref: 17 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560515.668810:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbfee00, rc 0) 00000100:00100000:1.0:1787560515.668907:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:6497:x1874392862745984:12345-0@lo:101: Request processed in 216us (4129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560515.668913:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1787560515.669195:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3885500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862745984:0@lo:101: 00010000:00010000:0.0:1787560515.669218:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cafc0030600/0x4642c20bf2f33ce9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33cf0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560515.669229:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cafc0030600/0x4642c20bf2f33ce9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33cf0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560515.669333:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3885500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862746112:0@lo:501: 00000100:00100000:0.0:1787560515.669389:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560515.669469:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2900 going to sleep for 11 seconds 00000100:00100000:1.0:1787560515.670673:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862746112 00000100:00100000:1.0:1787560515.670686:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862746112 00000100:00100000:1.0:1787560515.670755:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1787560515.670766:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:6497:x1874392862746112:12345-0@lo:501: 00000100:00100000:1.0:1787560515.670990:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:6497:x1874392862746112:12345-0@lo:501: Request processed in 225us (1600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560515.670997:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787560515.676965:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3885500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862746112:0@lo:501: 00000100:00100000:0.0:1787560515.677050:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3885500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862746240:0@lo:503: 00000100:00100000:0.0:1787560515.677167:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560515.677210:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2900 going to sleep for 11 seconds 00000100:00100000:1.0:1787560515.679298:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862746240 00000100:00100000:1.0:1787560515.679327:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862746240 00000100:00100000:1.0:1787560515.679423:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787560515.679483:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:6497:x1874392862746240:12345-0@lo:503: 00000100:00100000:1.0:1787560515.679703:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:6497:x1874392862746240:12345-0@lo:503: Request processed in 224us (2536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560515.679719:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1787560515.679866:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3885500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862746240:0@lo:503: 00000100:00100000:0.0:1787560515.680830:0:10333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3887b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10333:1874392862746368:0@lo:502: 00000100:00100000:0.0:1787560515.680903:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560515.680953:0:10333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2180 going to sleep for 11 seconds 00000100:00100000:1.0:1787560515.681012:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862746368 00000100:00100000:1.0:1787560515.681020:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862746368 00000100:00100000:1.0:1787560515.681065:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787560515.681075:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:10333:x1874392862746368:12345-0@lo:502: 00000100:00100000:1.0:1787560515.681215:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:10333:x1874392862746368:12345-0@lo:502: Request processed in 140us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560515.681223:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787560515.681418:0:10333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3887b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10333:1874392862746368:0@lo:502: 00000020:01000000:2.0:1787560515.681474:0:10333:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787560515.681486:0:10333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560515.681490:0:10333:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787560515.681496:0:10333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787560515.681522:0:10333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10333:1874392862746496:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787560515.681564:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560515.681581:0:10333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd7c29180 going to sleep for 11 seconds 00000100:00100000:1.0:1787560515.681703:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862746496 00000100:00100000:1.0:1787560515.681707:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862746496 00000100:00100000:1.0:1787560515.681726:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787560515.681732:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:10333:x1874392862746496:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560515.681821:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:10333:x1874392862746496:12345-0@lo:502:llog_process_th.0 Request processed in 88us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560515.681828:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1787560515.681910:0:10333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10333:1874392862746496:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787560515.681930:0:10333:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560515.681935:0:10333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560515.681936:0:10333:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787560515.681940:0:10333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1787560515.682188:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1787560515.682214:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787560515.682227:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc0030600/0x4642c20bf2f33ce9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33cf0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560515.682239:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cafc0030600/0x4642c20bf2f33ce9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33cf0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560515.682321:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787560515.682324:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cafeab05000 from 48 10000000:01000000:1.0:1787560515.682327:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787560515.682358:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f33cf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560515.682373:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f33cf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560515.682383:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f33cf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560515.682399:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862746624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787560515.689647:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560515.689767:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd32140c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560515.692940:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862746624 00000100:00100000:1.0:1787560515.692961:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862746624 00000100:00100000:1.0:1787560515.693047:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787560515.693059:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+17:6497:x1874392862746624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787560515.693082:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560515.693107:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffcbfe000/0x4642c20bf2f33cfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33cf7 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560515.693155:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffcbfe000/0x4642c20bf2f33cfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33cf7 expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560515.693168:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffcbfe000/0x4642c20bf2f33cfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33cf7 expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560515.693179:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbfe000, rc 0) 00000100:00100000:1.0:1787560515.693296:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:6497:x1874392862746624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 239us (3660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560515.693304:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787560515.693918:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862746624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560515.693945:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f33cf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33cfe expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560515.693957:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f33cf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33cfe expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560515.694049:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862746752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560515.694098:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560515.694154:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc5abc600 going to sleep for 11 seconds 00000100:00100000:3.0:1787560515.694266:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862746752 00000100:00100000:3.0:1787560515.694273:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862746752 00000100:00100000:3.0:1787560515.694319:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787560515.694328:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd8e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:6497:x1874392862746752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560515.694501:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd8e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:6497:x1874392862746752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 173us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560515.694508:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1787560515.695011:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862746752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560515.695048:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862746880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560515.695122:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560515.695154:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc5abc600 going to sleep for 11 seconds 00000100:00100000:2.0:1787560515.695170:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862746880 00000100:00100000:2.0:1787560515.695175:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862746880 00000100:00100000:2.0:1787560515.695215:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1787560515.695224:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd86eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:6497:x1874392862746880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560515.695333:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd86eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:6497:x1874392862746880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560515.695341:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1787560515.695390:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862746880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787560515.703880:0:10334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10334:1874392862747008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560515.704004:0:10334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560515.704061:0:10334:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c80240 going to sleep for 11 seconds 00000100:00100000:2.0:1787560515.704261:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862747008 00000100:00100000:2.0:1787560515.704272:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862747008 00000100:00100000:2.0:1787560515.704335:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1787560515.704347:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd86e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:10334:x1874392862747008:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787560515.704542:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd86e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:10334:x1874392862747008:12345-0@lo:502:llog_process_th.0 Request processed in 196us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560515.704551:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787560515.705137:0:10334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10334:1874392862747008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560515.705206:0:10334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10334:1874392862747136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560515.705273:0:10334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560515.705314:0:10334:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c80240 going to sleep for 11 seconds 00000100:00100000:0.0:1787560515.705674:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862747136 00000100:00100000:0.0:1787560515.705683:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862747136 00000100:00100000:0.0:1787560515.705730:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1787560515.705739:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd86e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:10334:x1874392862747136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787560515.705871:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd86e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:10334:x1874392862747136:12345-0@lo:502:llog_process_th.0 Request processed in 133us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560515.705878:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787560515.705961:0:10334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10334:1874392862747136:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787560515.705986:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787560515.706592:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1787560515.706619:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787560515.706632:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f33cf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33cfe expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560515.706644:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f33cf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33cfe expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560515.706655:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787560515.706666:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1787560515.706669:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787560515.706706:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc0031600/0x4642c20bf2f33d05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560515.706715:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cafc0031600/0x4642c20bf2f33d05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560515.706726:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cafc0031600/0x4642c20bf2f33d05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560515.706747:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3884700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862747264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787560515.706808:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560515.706855:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560515.706965:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862747264 00000100:00100000:2.0:1787560515.706971:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862747264 00000100:00100000:2.0:1787560515.707020:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787560515.707030:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+18:6497:x1874392862747264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560515.707044:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560515.707059:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca48200/0x4642c20bf2f33d0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33d05 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560515.707085:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca48200/0x4642c20bf2f33d0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33d05 expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560515.707096:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca48200/0x4642c20bf2f33d0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33d05 expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560515.707105:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca48200, rc 0) 00000100:00100000:2.0:1787560515.707177:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+19:6497:x1874392862747264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560515.707184:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1787560515.707659:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3884700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862747264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787560515.707675:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cafc0031600/0x4642c20bf2f33d05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d0c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560515.707686:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cafc0031600/0x4642c20bf2f33d05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33d0c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560515.707754:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3884700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862747392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560515.707795:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560515.707828:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560515.707876:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862747392 00000100:00100000:2.0:1787560515.707882:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862747392 00000100:00100000:2.0:1787560515.707931:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787560515.707940:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+19:6497:x1874392862747392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560515.708099:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+19:6497:x1874392862747392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560515.708116:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787560515.708182:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3884700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862747392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560515.708212:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862747520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787560515.708266:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560515.708289:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c80240 going to sleep for 11 seconds 00000100:00100000:0.0:1787560515.708389:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862747520 00000100:00100000:0.0:1787560515.708394:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862747520 00000100:00100000:0.0:1787560515.708467:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787560515.708476:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+19:6497:x1874392862747520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787560515.708565:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+19:6497:x1874392862747520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560515.708580:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787560515.708894:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862747520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787560515.709754:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10335:1874392862747648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560515.709829:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560515.709907:0:10335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c80540 going to sleep for 11 seconds 00000100:00100000:0.0:1787560515.709942:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862747648 00000100:00100000:0.0:1787560515.709949:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862747648 00000100:00100000:0.0:1787560515.710023:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787560515.710033:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+19:10335:x1874392862747648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787560515.710163:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+19:10335:x1874392862747648:12345-0@lo:502:llog_process_th.0 Request processed in 130us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560515.710170:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787560515.710254:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10335:1874392862747648:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787560515.710285:0:10335:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560515.710295:0:10335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560515.710298:0:10335:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787560515.710303:0:10335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787560515.710325:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10335:1874392862747776:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560515.710356:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560515.716127:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862747776 00000100:00100000:0.0:1787560515.716150:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862747776 00000100:00100000:0.0:1787560515.716221:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787560515.716234:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+19:10335:x1874392862747776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787560515.716502:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+19:10335:x1874392862747776:12345-0@lo:502:llog_process_th.0 Request processed in 270us (6143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560515.716512:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787560515.717030:0:10335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c80540 going to sleep for 11 seconds 00000100:00100000:3.0:1787560515.717064:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10335:1874392862747776:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787560515.717105:0:10335:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560515.717174:0:10335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560515.717177:0:10335:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787560515.717182:0:10335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:0.0:1787560515.717560:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1787560515.717590:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787560515.717603:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc0031600/0x4642c20bf2f33d05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d0c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560515.717616:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cafc0031600/0x4642c20bf2f33d05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d0c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560515.717628:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787560515.717631:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9caffba72800 from 48 10000000:01000000:0.0:1787560515.717634:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787560515.717679:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc1657c00/0x4642c20bf2f33d13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560515.717700:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cafc1657c00/0x4642c20bf2f33d13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560515.717711:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cafc1657c00/0x4642c20bf2f33d13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560515.717736:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3884a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862747904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787560515.717806:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560515.717882:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2180 going to sleep for 11 seconds 00000100:00100000:2.0:1787560515.717996:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862747904 00000100:00100000:2.0:1787560515.718004:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862747904 00000100:00100000:2.0:1787560515.724081:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787560515.724129:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+19:6497:x1874392862747904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560515.724159:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560515.724190:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca48a00/0x4642c20bf2f33d1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33d13 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560515.724231:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca48a00/0x4642c20bf2f33d1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33d13 expref: 20 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560515.724395:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca48a00/0x4642c20bf2f33d1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33d13 expref: 20 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560515.724410:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca48a00, rc 0) 00000100:00100000:2.0:1787560515.724606:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:6497:x1874392862747904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 507us (6798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560515.724613:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787560515.724769:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3884a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862747904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787560515.724804:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cafc1657c00/0x4642c20bf2f33d13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d1a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560515.724849:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cafc1657c00/0x4642c20bf2f33d13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33d1a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560515.724951:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862748032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560515.724995:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560515.728238:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862748032 00000100:00100000:0.0:1787560515.728267:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862748032 00000100:00100000:1.0:1787560515.731661:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787560515.731678:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:6497:x1874392862748032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787560515.731937:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:6497:x1874392862748032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 262us (6940us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560515.731945:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787560515.733276:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c80540 going to sleep for 11 seconds 00000100:00100000:0.0:1787560515.733324:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862748032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560515.733393:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3885c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862748160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787560515.733503:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560515.733539:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787560515.733740:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862748160 00000100:00100000:1.0:1787560515.733749:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862748160 00000100:00100000:1.0:1787560515.733820:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787560515.733830:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:6497:x1874392862748160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787560515.733964:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:6497:x1874392862748160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560515.733973:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787560515.734089:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3885c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862748160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787560515.734785:0:10336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3885c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10336:1874392862748288:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787560515.734840:0:10336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560515.734877:0:10336:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2900 going to sleep for 11 seconds 00000100:00100000:1.0:1787560515.734929:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862748288 00000100:00100000:1.0:1787560515.734935:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862748288 00000100:00100000:1.0:1787560515.734976:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787560515.734985:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:10336:x1874392862748288:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560515.735092:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:10336:x1874392862748288:12345-0@lo:502:llog_process_th.0 Request processed in 108us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560515.735099:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787560515.735332:0:10336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3885c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10336:1874392862748288:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787560515.735377:0:10336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3885c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10336:1874392862748416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787560515.735413:0:10336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560515.735509:0:10336:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2900 going to sleep for 11 seconds 00000100:00100000:2.0:1787560515.735573:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862748416 00000100:00100000:2.0:1787560515.735578:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862748416 00000100:00100000:2.0:1787560515.735608:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787560515.735617:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:10336:x1874392862748416:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787560515.735694:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:10336:x1874392862748416:12345-0@lo:502:llog_process_th.0 Request processed in 78us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560515.735707:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787560515.735817:0:10336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3885c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10336:1874392862748416:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787560515.735836:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787560515.737892:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1787560515.737940:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787560515.737955:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc1657c00/0x4642c20bf2f33d13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d1a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560515.737971:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cafc1657c00/0x4642c20bf2f33d13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d1a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560515.737983:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1787560515.737987:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1787560515.737990:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787560515.738039:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f33d21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560515.738047:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f33d21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560515.738061:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f33d21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560515.738089:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862748544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787560515.738305:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560515.738398:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc599d900 going to sleep for 11 seconds 00000100:00100000:0.0:1787560515.738782:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862748544 00000100:00100000:0.0:1787560515.738792:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862748544 00000100:00100000:0.0:1787560515.738857:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787560515.738869:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:6497:x1874392862748544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787560515.738885:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560515.738902:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafc1656a00/0x4642c20bf2f33d28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33d21 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560515.738933:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafc1656a00/0x4642c20bf2f33d28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33d21 expref: 21 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560515.738945:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafc1656a00/0x4642c20bf2f33d28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33d21 expref: 21 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560515.738955:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafc1656a00, rc 0) 00000100:00100000:0.0:1787560515.739059:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:6497:x1874392862748544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560515.739067:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787560515.739231:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862748544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560515.739314:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f33d21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d28 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560515.739345:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f33d21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33d28 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560515.739421:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862748672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560515.739617:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560515.739687:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc599d900 going to sleep for 11 seconds 00000100:00100000:1.0:1787560515.739862:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862748672 00000100:00100000:1.0:1787560515.739869:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862748672 00000100:00100000:1.0:1787560515.739936:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787560515.739946:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:6497:x1874392862748672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560515.740626:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862748672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560515.740676:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862748800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560515.740743:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560515.740803:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:6497:x1874392862748672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 164us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560515.740815:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787560515.740929:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc599d900 going to sleep for 11 seconds 00000100:00100000:1.0:1787560515.741012:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862748800 00000100:00100000:1.0:1787560515.741018:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862748800 00000100:00100000:1.0:1787560515.741054:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787560515.741061:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:6497:x1874392862748800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787560515.741177:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:6497:x1874392862748800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560515.741183:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787560515.741373:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862748800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560515.741910:0:10337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10337:1874392862748928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787560515.741959:0:10337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560515.741997:0:10337:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffb8afcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560515.742048:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862748928 00000100:00100000:1.0:1787560515.742053:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862748928 00000100:00100000:1.0:1787560515.742079:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787560515.742088:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:10337:x1874392862748928:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560515.742209:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:10337:x1874392862748928:12345-0@lo:502:llog_process_th.0 Request processed in 121us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560515.742217:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787560515.742844:0:10337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10337:1874392862748928:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787560515.742877:0:10337:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787560515.742888:0:10337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560515.742890:0:10337:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787560515.742897:0:10337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787560515.742923:0:10337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10337:1874392862749056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787560515.742968:0:10337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560515.743046:0:10337:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffb8afcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560515.743082:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862749056 00000100:00100000:1.0:1787560515.743088:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862749056 00000100:00100000:1.0:1787560515.743231:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787560515.743251:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:10337:x1874392862749056:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560515.743348:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:10337:x1874392862749056:12345-0@lo:502:llog_process_th.0 Request processed in 109us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560515.743355:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787560515.743421:0:10337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10337:1874392862749056:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787560515.743484:0:10337:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560515.743489:0:10337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560515.743491:0:10337:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787560515.743495:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:3.0:1787560515.743787:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:3.0:1787560515.743809:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787560515.743822:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f33d21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d28 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560515.743834:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f33d21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d28 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560515.743846:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787560515.743849:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cb000817800 from 48 10000000:01000000:3.0:1787560515.743853:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787560515.743882:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f33d2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560515.743891:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f33d2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560515.743900:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f33d2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560515.743917:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862749184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787560515.743955:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560515.753099:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862749184 00000100:00100000:0.0:1787560515.753126:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862749184 00000100:00100000:1.0:1787560515.753293:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787560515.753309:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:6497:x1874392862749184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787560515.753330:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560515.753351:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffcbfe400/0x4642c20bf2f33d36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33d2f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560515.753383:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffcbfe400/0x4642c20bf2f33d36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33d2f expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560515.753414:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffcbfe400/0x4642c20bf2f33d36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33d2f expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560515.753425:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbfe400, rc 0) 00000100:00100000:1.0:1787560515.753533:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:6497:x1874392862749184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 229us (9577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560515.753541:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787560515.759704:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c80240 going to sleep for 11 seconds 00000100:00100000:2.0:1787560515.759761:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862749184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560515.759805:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f33d2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d36 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560515.759823:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f33d2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33d36 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560515.759942:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862749312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560515.760014:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560515.760053:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862749312 00000100:00100000:2.0:1787560515.760060:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862749312 00000100:00100000:2.0:1787560515.760107:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787560515.760127:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc8c2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:6497:x1874392862749312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560515.760413:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc8c2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:6497:x1874392862749312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 286us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560515.760422:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787560515.760497:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffb8afcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560515.760511:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862749312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560515.760542:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862749440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560515.760599:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560515.760621:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862749440 00000100:00100000:2.0:1787560515.760631:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862749440 00000100:00100000:2.0:1787560515.760652:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787560515.760658:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc8c2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:6497:x1874392862749440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560515.760737:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc8c2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:6497:x1874392862749440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560515.760743:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787560515.760786:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffb8afcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560515.760798:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862749440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787560515.761972:0:10338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10338:1874392862749568:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560515.762056:0:10338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560515.762099:0:10338:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c80c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787560515.762218:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862749568 00000100:00100000:0.0:1787560515.762226:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862749568 00000100:00100000:0.0:1787560515.762274:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787560515.762283:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd840bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:10338:x1874392862749568:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787560515.762461:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd840bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:10338:x1874392862749568:12345-0@lo:502:llog_process_th.0 Request processed in 146us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560515.762481:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787560515.762871:0:10338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10338:1874392862749568:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560515.762921:0:10338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10338:1874392862749696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560515.762959:0:10338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560515.762990:0:10338:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c80c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787560515.763037:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862749696 00000100:00100000:0.0:1787560515.763043:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862749696 00000100:00100000:0.0:1787560515.763079:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787560515.763087:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd8409850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:10338:x1874392862749696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787560515.763341:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd8409850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:10338:x1874392862749696:12345-0@lo:502:llog_process_th.0 Request processed in 254us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560515.763350:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787560515.766745:0:10338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10338:1874392862749696:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787560515.766823:0:10338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787560515.767090:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1787560515.767126:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787560515.767141:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f33d2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d36 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560515.767154:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f33d2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d36 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560515.767167:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787560515.767170:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1787560515.767173:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787560515.767223:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc1656200/0x4642c20bf2f33d3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560515.767232:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cafc1656200/0x4642c20bf2f33d3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560515.767251:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cafc1656200/0x4642c20bf2f33d3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560515.767278:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3885c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862749824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787560515.767373:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560515.767424:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2600 going to sleep for 11 seconds 00000100:00100000:3.0:1787560515.767734:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862749824 00000100:00100000:3.0:1787560515.767742:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862749824 00000100:00100000:3.0:1787560515.767812:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787560515.767825:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd8408050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:6497:x1874392862749824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787560515.767840:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560515.767855:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafda2f6400/0x4642c20bf2f33d44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33d3d expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560515.767882:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafda2f6400/0x4642c20bf2f33d44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33d3d expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560515.767895:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafda2f6400/0x4642c20bf2f33d44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33d3d expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560515.767904:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f6400, rc 0) 00000100:00100000:3.0:1787560515.767948:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd8408050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:6497:x1874392862749824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560515.767955:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787560515.768121:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3885c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862749824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787560515.768138:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cafc1656200/0x4642c20bf2f33d3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d44 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560515.768148:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cafc1656200/0x4642c20bf2f33d3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33d44 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560515.768219:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3885c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862749952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560515.768262:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560515.768295:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2600 going to sleep for 11 seconds 00000100:00100000:1.0:1787560515.768411:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862749952 00000100:00100000:1.0:1787560515.768417:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862749952 00000100:00100000:1.0:1787560515.768473:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787560515.768481:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd087b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:6497:x1874392862749952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787560515.768633:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd087b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:6497:x1874392862749952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560515.768642:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787560515.768754:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3885c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862749952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560515.768799:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862750080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787560515.768846:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560515.768873:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c80180 going to sleep for 11 seconds 00000100:00100000:2.0:1787560515.768913:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862750080 00000100:00100000:2.0:1787560515.768918:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862750080 00000100:00100000:2.0:1787560515.768952:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787560515.768960:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd0878450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:6497:x1874392862750080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560515.769086:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd0878450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:6497:x1874392862750080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560515.769093:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787560515.769461:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862750080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787560515.769993:0:10339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b85880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10339:1874392862750208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560515.770050:0:10339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560515.770093:0:10339:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbdd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560515.770152:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862750208 00000100:00100000:0.0:1787560515.770159:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862750208 00000100:00100000:0.0:1787560515.770201:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787560515.770211:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd3219c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:10339:x1874392862750208:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787560515.770338:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd3219c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:10339:x1874392862750208:12345-0@lo:502:llog_process_th.0 Request processed in 128us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560515.770346:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787560515.770566:0:10339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b85880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10339:1874392862750208:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787560515.770593:0:10339:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560515.770604:0:10339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560515.770607:0:10339:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787560515.770614:0:10339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787560515.770635:0:10339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b85880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10339:1874392862750336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560515.770672:0:10339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560515.770807:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862750336 00000100:00100000:0.0:1787560515.770812:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862750336 00000100:00100000:0.0:1787560515.770999:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787560515.771007:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:10339:x1874392862750336:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787560515.771093:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:10339:x1874392862750336:12345-0@lo:502:llog_process_th.0 Request processed in 87us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560515.771101:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787560515.773922:0:10339:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbdd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560515.773983:0:10339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b85880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10339:1874392862750336:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787560515.774041:0:10339:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560515.774055:0:10339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560515.774058:0:10339:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787560515.774065:0:10339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1787560515.774428:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:3.0:1787560515.774498:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787560515.774512:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc1656200/0x4642c20bf2f33d3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d44 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560515.774526:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cafc1656200/0x4642c20bf2f33d3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d44 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560515.774538:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787560515.774541:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9cafe06b3370 from 1 10000000:01000000:3.0:1787560515.774544:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787560515.774589:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f33d4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560515.774598:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f33d4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560515.774611:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f33d4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560515.774637:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862750464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787560515.774723:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560515.774763:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c80180 going to sleep for 11 seconds 00000100:00100000:0.0:1787560515.775077:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862750464 00000100:00100000:0.0:1787560515.775087:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862750464 00000100:00100000:0.0:1787560515.775162:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787560515.775173:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:6497:x1874392862750464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787560515.775189:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560515.775206:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafc1657800/0x4642c20bf2f33d52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33d4b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560515.775236:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafc1657800/0x4642c20bf2f33d52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33d4b expref: 24 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560515.775248:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafc1657800/0x4642c20bf2f33d52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33d4b expref: 24 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560515.775260:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafc1657800, rc 0) 00000100:00100000:0.0:1787560515.775327:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:6497:x1874392862750464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560515.775334:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787560515.775580:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862750464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787560515.775600:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f33d4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d52 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560515.775612:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f33d4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33d52 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560515.775685:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862750592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787560515.775739:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560515.775808:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbdd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560515.776232:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862750592 00000100:00100000:0.0:1787560515.776240:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862750592 00000100:00100000:0.0:1787560515.776286:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787560515.776295:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:6497:x1874392862750592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560515.778652:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:6497:x1874392862750592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2343us (2900us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787560515.778670:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787560515.779208:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862750592:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787560515.779264:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787560515.779278:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f33d4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d52 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560515.779289:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f33d4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d52 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560516.147823:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862750720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787560516.147933:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560516.148099:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862750720 00000100:00100000:2.0:1787560516.148109:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862750720 00000100:00100000:2.0:1787560516.148188:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787560516.148202:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862750720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787560516.148241:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560516.148308:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862750720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560516.148316:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1787560516.148563:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787560516.148603:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec32c6300 x1874392862750720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560532 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560516.148625:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862750720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787560516.148965:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787560516.148975:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862750848:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787560516.149014:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560516.149264:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862750848 00000100:00100000:3.0:1787560516.149271:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862750848 00000100:00100000:3.0:1787560516.150480:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787560516.150496:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862750848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787560516.150538:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787560516.150628:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862750848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 137us (1613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560516.150636:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1787560516.150691:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec33c2a00 x1874392862750848/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560532 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560516.150714:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862750848:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787560516.153014:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862751104:0@lo:400:kworker.0 00000100:00100000:2.0:1787560516.153108:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560516.153150:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874392862751616:0@lo:400:kworker.0 00000100:00100000:2.0:1787560516.153212:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560516.153234:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862752128:0@lo:400:kworker.0 00000100:00100000:2.0:1787560516.153258:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560516.153286:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787560516.153292:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862750976:0@lo:400:kworker.0 00000100:00100000:2.0:1787560516.153313:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560516.153330:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862751488:0@lo:400:kworker.0 00000100:00100000:2.0:1787560516.153350:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560516.153366:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862752000:0@lo:400:kworker.0 00000100:00100000:2.0:1787560516.153386:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560516.153416:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862751104 00000100:00100000:2.0:1787560516.153427:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862751104 00000100:00100000:2.0:1787560516.153521:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787560516.153533:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec32c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862751104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560516.153599:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec32c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862751104:12345-0@lo:400:kworker.0 Request processed in 68us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560516.153608:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787560516.153634:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862751616 00000100:00100000:2.0:1787560516.153638:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862751616 00000100:00100000:3.0:1787560516.153905:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862751232:0@lo:400:kworker.0 00000100:00100000:3.0:1787560516.153941:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560516.153956:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862751744:0@lo:400:kworker.0 00000100:00100000:3.0:1787560516.153980:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560516.154011:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787560516.154018:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862751360:0@lo:400:kworker.0 00000100:00100000:3.0:1787560516.154055:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560516.154089:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862751872:0@lo:400:kworker.0 00000100:00100000:3.0:1787560516.154111:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560516.154142:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862751744 00000100:00100000:3.0:1787560516.154147:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862751744 00000100:00100000:3.0:1787560516.154180:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862751872 00000100:00100000:3.0:1787560516.154183:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862751872 00000100:00100000:3.0:1787560516.154205:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787560516.154211:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862751744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560516.154254:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862751744:12345-0@lo:400:kworker.0 Request processed in 43us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560516.154261:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787560516.154273:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787560516.154279:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862751872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560516.154308:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862751872:12345-0@lo:400:kworker.0 Request processed in 29us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560516.154315:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1787560516.154362:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec32c7800 x1874392862751872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560516.154383:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862751872:0@lo:400:kworker.0 00010000:00080000:3.0:1787560516.154397:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec32c6a00 x1874392862751744/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560516.154405:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862751744:0@lo:400:kworker.0 00000100:00100000:3.0:1787560516.154497:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862752128 00000100:00100000:3.0:1787560516.154502:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862752128 00000100:00080000:0.0:1787560516.160033:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787560516.160050:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787560516.160235:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862750976 00000100:00100000:2.0:1787560516.160248:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862750976 00000100:00100000:2.0:1787560516.160269:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862751488 00000100:00100000:2.0:1787560516.160272:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862751488 00000100:00100000:2.0:1787560516.160361:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862752000 00000100:00100000:2.0:1787560516.160365:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862752000 00000100:00100000:2.0:1787560516.160382:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862751232 00000100:00100000:2.0:1787560516.160385:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862751232 00000100:00100000:2.0:1787560516.160405:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787560516.160427:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec32c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874392862751616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560516.160573:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec32c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874392862751616:12345-0@lo:400:kworker.0 Request processed in 148us (7368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560516.160581:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787560516.160600:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787560516.160607:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec32c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862750976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560516.160637:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec32c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862750976:12345-0@lo:400:kworker.0 Request processed in 32us (7323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560516.160643:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787560516.160656:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787560516.160661:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec32c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862751488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560516.160690:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec32c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862751488:12345-0@lo:400:kworker.0 Request processed in 29us (7340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560516.160696:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1787560516.160825:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560516.161326:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787560516.161337:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec32c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862752000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560516.161387:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec32c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862752000:12345-0@lo:400:kworker.0 Request processed in 52us (7999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560516.161393:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787560516.161406:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787560516.161413:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862751232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560516.161413:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787560516.161419:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec32c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874392862752128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560516.161465:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec32c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874392862752128:12345-0@lo:400:kworker.0 Request processed in 45us (8206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560516.161472:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787560516.161473:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862751232:12345-0@lo:400:kworker.0 Request processed in 61us (7531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560516.161478:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787560516.161499:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862751360 00000100:00100000:2.0:1787560516.161506:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862751360 00000100:00100000:0.0:1787560516.161601:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862751232:0@lo:400:kworker.0 00000100:00100000:3.0:1787560516.165483:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787560516.165517:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862751360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560516.165659:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862751360:12345-0@lo:400:kworker.0 Request processed in 162us (11603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560516.165667:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787560516.165749:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862750976:0@lo:400:kworker.0 00000100:00100000:3.0:1787560516.165763:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862751488:0@lo:400:kworker.0 00000100:00100000:3.0:1787560516.165786:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862752000:0@lo:400:kworker.0 00000100:00100000:3.0:1787560516.165800:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862751104:0@lo:400:kworker.0 00010000:00080000:3.0:1787560516.165828:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec32c6680 x1874392862751616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560516.165840:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874392862751616:0@lo:400:kworker.0 00010000:00080000:3.0:1787560516.165854:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec32c7b80 x1874392862752128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560516.165881:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862752128:0@lo:400:kworker.0 00000100:00100000:3.0:1787560516.165944:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862751360:0@lo:400:kworker.0 00010000:00010000:1.0:1787560516.600716:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787560516.685290:0:10376:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeb77411b0 20000000:00000080:0.0:1787560516.685306:0:10376:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9caff4894800 uarg=0000000000000000 20000000:01000000:0.0:1787560516.685352:0:10376:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787560516.685359:0:10376:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787560516.685363:0:10376:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787560516.686688:0:10377:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1787560516.686840:0:10376:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1787560516.691015:0:10376:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1787560516.691051:0:10376:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1787560516.691066:0:10376:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1787560516.691083:0:10376:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787560516.691106:0:10376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cafc1656800/0x4642c20bf2f33d59 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560516.691126:0:10376:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cafda2f7800/0x4642c20bf2f339f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f339ee expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560516.691134:0:10376:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f33a03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f339fc expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560516.691141:0:10376:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cafc0030200/0x4642c20bf2f33a57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33a50 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560516.691148:0:10376:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caffca49a00/0x4642c20bf2f33b7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33b76 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560516.691158:0:10376:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caffca48000/0x4642c20bf2f33c95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb10 expref: 9 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560516.691166:0:10376:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cafc1656800/0x4642c20bf2f33d59 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560516.691221:0:10376:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caffca48000/0x4642c20bf2f33c95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb10 expref: 9 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560516.691238:0:10376:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9caffca48000/0x4642c20bf2f33c95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb10 expref: 9 pid: 6492 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560516.691254:0:10376:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3887100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10376:1874392862752256:192.168.203.29@tcp:104: 00010000:00010000:0.0:1787560516.691601:0:10376:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caffca49a00/0x4642c20bf2f33b7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f33b76 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560516.691611:0:10376:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9caffca49a00/0x4642c20bf2f33b7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f33b76 expref: 23 pid: 6494 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560516.691621:0:10376:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3885180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10376:1874392862752384:0@lo:104: 00000100:00100000:0.0:1787560516.691659:0:10376:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787560516.692169:0:10376:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cafc0030200/0x4642c20bf2f33a57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f33a50 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560516.692179:0:10376:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cafc0030200/0x4642c20bf2f33a57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f33a50 expref: 23 pid: 6494 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560516.692189:0:10376:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3884a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10376:1874392862752512:0@lo:104: 00000100:00100000:0.0:1787560516.692218:0:10376:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787560516.692271:0:10376:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f33a03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f339fc expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560516.692280:0:10376:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f33a03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f339fc expref: 23 pid: 6492 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560516.692298:0:10376:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3884700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10376:1874392862752640:0@lo:104: 00010000:00010000:0.0:1787560516.692325:0:10376:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cafda2f7800/0x4642c20bf2f339f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f339ee expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560516.692334:0:10376:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cafda2f7800/0x4642c20bf2f339f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f339ee expref: 23 pid: 6493 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560516.692342:0:10376:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3887b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10376:1874392862752768:0@lo:104: 00000100:00100000:0.0:1787560516.692358:0:10376:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec31d6180 going to sleep for 11 seconds 00000100:00100000:2.0:1787560516.692407:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862752384 00000100:00100000:3.0:1787560516.692410:0:6482:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787560516.692414:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862752384 00000100:00100000:3.0:1787560516.692428:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560516.692462:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560516.692469:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862752512 00000100:00100000:3.0:1787560516.692472:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862752512 00000100:00100000:2.0:1787560516.692473:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862752640 00000100:00100000:2.0:1787560516.692476:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862752640 00000100:00100000:2.0:1787560516.692484:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862752768 00000100:00100000:3.0:1787560516.692491:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787560516.692492:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862752768 00000100:00100000:3.0:1787560516.692499:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3885c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+6:10376:x1874392862752384:12345-0@lo:104: 00010000:00010000:3.0:1787560516.692511:0:6482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9caffca48c00/0x4642c20bf2f33b76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33b7d expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.692572:0:6482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787560516.692578:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3885c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+6:10376:x1874392862752384:12345-0@lo:104: Request processed in 80us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560516.692581:0:10376:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3885180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10376:1874392862752384:0@lo:104: 00000100:00100000:3.0:1787560516.692585:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787560516.692603:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787560516.692609:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+5:10376:x1874392862752640:12345-0@lo:104: 00010000:00010000:3.0:1787560516.692617:0:6482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff800/0x4642c20bf2f339fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33a03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.692666:0:6482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787560516.692672:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+5:10376:x1874392862752640:12345-0@lo:104: Request processed in 64us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560516.692679:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787560516.692691:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787560516.692704:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4895450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+4:10376:x1874392862752512:12345-0@lo:104: 00010000:00010000:3.0:1787560516.692711:0:6482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cb0021fec00/0x4642c20bf2f33a50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33a57 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.692717:0:9501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787560516.692724:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caffca48c00/0x4642c20bf2f33b76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33b7d expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.692741:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca48c00 already unused, calling callback (ffffffffc1413c20) 00010000:00010000:3.0:1787560516.692743:0:6482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:00010000:1.0:1787560516.692746:0:9501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caffca48c00/0x4642c20bf2f33b76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33b7d expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560516.692747:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4895450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+4:10376:x1874392862752512:12345-0@lo:104: Request processed in 45us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560516.692753:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:1.0:1787560516.692755:0:9501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caffca48c00/0x4642c20bf2f33b76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33b7d expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560516.692762:0:9501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caffca48c00/0x4642c20bf2f33b76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33b7d expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560516.692777:0:9501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1787560516.692801:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1787560516.692806:0:9501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caffca48c00/0x4642c20bf2f33b76 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33b7d expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560516.692808:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:10376:x1874392862752768:12345-0@lo:104: 00010000:00010000:1.0:1787560516.692813:0:9501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560516.692814:0:6482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9caffca49600/0x4642c20bf2f339ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f339f5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.692831:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caffca48c00/0x4642c20bf2f33b76 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33b7d expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.692839:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caffca48c00/0x4642c20bf2f33b76 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33b7d expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.692841:0:6482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787560516.692845:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:10376:x1874392862752768:12345-0@lo:104: Request processed in 38us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560516.692850:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1787560516.692853:0:9501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787560516.692856:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff800/0x4642c20bf2f339fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33a03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.692862:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ff800 already unused, calling callback (ffffffffc1413c20) 00010000:00010000:3.0:1787560516.692863:0:6487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:1.0:1787560516.692865:0:9501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff800/0x4642c20bf2f339fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33a03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.692867:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cb0021fec00/0x4642c20bf2f33a50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33a57 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.692873:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021fec00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560516.692876:0:6487:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cb0021fec00/0x4642c20bf2f33a50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33a57 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.692882:0:9501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff800/0x4642c20bf2f339fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33a03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.692883:0:6487:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cb0021fec00/0x4642c20bf2f33a50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33a57 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560516.692890:0:6487:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cb0021fec00/0x4642c20bf2f33a50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33a57 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560516.692890:0:9501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff800/0x4642c20bf2f339fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33a03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560516.692895:0:9501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787560516.692900:0:6487:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787560516.692908:0:9501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff800/0x4642c20bf2f339fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33a03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.692911:0:6487:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cb0021fec00/0x4642c20bf2f33a50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33a57 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.692914:0:9501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560516.692917:0:6487:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560516.692920:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff800/0x4642c20bf2f339fc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33a03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.692926:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff800/0x4642c20bf2f339fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33a03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.692928:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cb0021fec00/0x4642c20bf2f33a50 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33a57 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.692935:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cb0021fec00/0x4642c20bf2f33a50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33a57 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.692935:0:9501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560516.692938:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caffca49600/0x4642c20bf2f339ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f339f5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.692944:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560516.692944:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49600 already unused, calling callback (ffffffffc1413c20) 00010000:00010000:3.0:1787560516.692946:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:1.0:1787560516.692947:0:9501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caffca49600/0x4642c20bf2f339ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f339f5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.692948:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560516.692953:0:9501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caffca49600/0x4642c20bf2f339ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f339f5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560516.692958:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862752896:0@lo:103:ldlm_bl.0 10000000:00010000:1.0:1787560516.692959:0:9501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caffca49600/0x4642c20bf2f339ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f339f5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560516.692969:0:9501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787560516.692982:0:9501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caffca49600/0x4642c20bf2f339ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f339f5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560516.692984:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787560516.692988:0:9501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560516.692994:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caffca49600/0x4642c20bf2f339ee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f339f5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.693000:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caffca49600/0x4642c20bf2f339ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f339f5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560516.693008:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787560516.693014:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862753024:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560516.693014:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560516.693016:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560516.693018:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560516.693030:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560516.693033:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787560516.693084:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560516.693111:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862752896 00000100:00100000:1.0:1787560516.693115:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862752896 00010000:00010000:1.0:1787560516.693137:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caffca49a00/0x4642c20bf2f33b7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33b76 expref: 24 pid: 6494 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560516.693166:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862753024 00000100:00100000:1.0:1787560516.693169:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862753024 00010000:00010000:1.0:1787560516.693181:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f33a03 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f339fc expref: 25 pid: 6492 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560516.693200:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787560516.693206:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+25:3623:x1874392862752896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560516.693216:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560516.693221:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caffca49a00/0x4642c20bf2f33b7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33b76 expref: 25 pid: 6494 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.693236:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caffca49a00/0x4642c20bf2f33b7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f33b76 expref: 25 pid: 6494 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.693249:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca49a00/0x4642c20bf2f33b7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f33b76 expref: 25 pid: 6494 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.693260:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560516.693273:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862753152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560516.693290:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3623:x1874392862752896:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560516.693297:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787560516.693298:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560516.693308:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862753152 00000100:00100000:3.0:1787560516.693310:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787560516.693311:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862753152 00000100:00100000:3.0:1787560516.693314:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862753280:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560516.693322:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cafc0030200/0x4642c20bf2f33a57 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33a50 expref: 24 pid: 6494 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560516.693335:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560516.693335:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787560516.693340:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3623:x1874392862753024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560516.693347:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560516.693351:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f33a03 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f339fc expref: 24 pid: 6492 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560516.693355:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862753280 00010000:00010000:1.0:1787560516.693358:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f33a03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f339fc expref: 24 pid: 6492 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560516.693359:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862753280 00010000:00010000:1.0:1787560516.693368:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787560516.693371:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cafda2f7800/0x4642c20bf2f339f5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f339ee expref: 25 pid: 6493 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560516.693388:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+25:3623:x1874392862753024:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560516.693391:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787560516.693394:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787560516.693396:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+25:3625:x1874392862753152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787560516.693403:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560516.693407:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cafc0030200/0x4642c20bf2f33a57 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33a50 expref: 24 pid: 6494 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560516.693410:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787560516.693415:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd7cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3625:x1874392862753280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787560516.693416:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cafc0030200/0x4642c20bf2f33a57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f33a50 expref: 24 pid: 6494 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.693421:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560516.693424:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cafda2f7800/0x4642c20bf2f339f5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f339ee expref: 24 pid: 6493 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.693425:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787560516.693458:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cafda2f7800/0x4642c20bf2f339f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f339ee expref: 24 pid: 6493 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.693468:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560516.693473:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3625:x1874392862753152:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560516.693479:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787560516.693486:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd7cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3625:x1874392862753280:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560516.693491:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787560516.693504:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862753280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787560516.693511:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862753152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560516.693529:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862753024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560516.693537:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862752896:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787560516.693615:0:10376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafc0030200/0x4642c20bf2f33a57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f33a50 expref: 22 pid: 6494 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560516.693626:0:10376:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3884a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10376:1874392862752512:0@lo:104: 00010000:00010000:0.0:1787560516.693636:0:10376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f33a03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f339fc expref: 21 pid: 6492 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560516.693644:0:10376:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3884700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10376:1874392862752640:0@lo:104: 00010000:00010000:0.0:1787560516.693652:0:10376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafda2f7800/0x4642c20bf2f339f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f339ee expref: 20 pid: 6493 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560516.693659:0:10376:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3887b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10376:1874392862752768:0@lo:104: 00000100:00100000:1.0:1787560516.697519:0:10376:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3887100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10376:1874392862752256:192.168.203.29@tcp:104: 00010000:00010000:1.0:1787560516.697563:0:10376:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cafc1656800/0x4642c20bf2f33d59 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560516.699356:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560516.699454:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853256448 00000100:00100000:3.0:1787560516.699462:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853256448 00010000:00010000:3.0:1787560516.699499:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caffca48000/0x4642c20bf2f33c95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb10 expref: 10 pid: 6492 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560516.699539:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 39 00000100:00100000:3.0:1787560516.699590:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3885500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a608f87b-4315-497d-a70e-0ed75a6814da+10:2405:x1874392853256448:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560516.699605:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560516.699612:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caffca48000/0x4642c20bf2f33c95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb10 expref: 10 pid: 6492 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.699640:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caffca48000/0x4642c20bf2f33c95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb10 expref: 10 pid: 6492 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.699658:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca48000/0x4642c20bf2f33c95 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb10 expref: 10 pid: 6492 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.699674:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cafc1656800/0x4642c20bf2f33d59 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.699683:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafc1656800/0x4642c20bf2f33d59 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.699698:0:6486:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cafc1656800/0x4642c20bf2f33d59 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.699705:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cafc1656800/0x4642c20bf2f33d59 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.699712:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cafc1656800/0x4642c20bf2f33d59 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.699718:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cafc1656800/0x4642c20bf2f33d59 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.699724:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafc1656800 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560516.699728:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cafc1656800/0x4642c20bf2f33d59 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.699737:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cafc1656800/0x4642c20bf2f33d59 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.699775:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cafc1656800/0x4642c20bf2f33d59 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.699787:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787560516.699805:0:10376:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cafc1656800/0x4642c20bf2f33d59 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.699813:0:10376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cafc1656800/0x4642c20bf2f33d59 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.699819:0:10376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafc1656800/0x4642c20bf2f33d59 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560516.699835:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3885500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a608f87b-4315-497d-a70e-0ed75a6814da+9:2405:x1874392853256448:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 287us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560516.699842:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 39 10000000:01000000:1.0:1787560517.619543:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787560517.619562:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9caec1ef6000 from 4 10000000:01000000:1.0:1787560517.619641:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787560517.619698:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbff000/0x4642c20bf2f33d60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560517.619713:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffcbff000/0x4642c20bf2f33d60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560517.619727:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffcbff000/0x4642c20bf2f33d60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560517.619821:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862753408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787560517.619917:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787560517.619929:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560517.619983:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafef9dd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560517.620101:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862753408 00000100:00100000:0.0:1787560517.620112:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862753408 00000100:00100000:0.0:1787560517.620184:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787560517.620197:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:6497:x1874392862753408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787560517.620222:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560517.620240:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafc1657200/0x4642c20bf2f33d67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33d60 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560517.620269:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafc1657200/0x4642c20bf2f33d67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33d60 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560517.620281:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafc1657200/0x4642c20bf2f33d67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33d60 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560517.620293:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafc1657200, rc 0) 00000100:00100000:0.0:1787560517.620348:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:6497:x1874392862753408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560517.620356:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787560517.620387:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862753408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787560517.620405:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffcbff000/0x4642c20bf2f33d60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d67 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560517.620416:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffcbff000/0x4642c20bf2f33d60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33d67 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560517.620629:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862753536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787560517.620661:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560517.620866:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafef9dd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560517.621039:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862753536 00000100:00100000:2.0:1787560517.621046:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862753536 00000100:00100000:2.0:1787560517.621091:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787560517.621101:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:6497:x1874392862753536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560517.621412:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:6497:x1874392862753536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 312us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560517.621420:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787560517.621738:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862753536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787560517.621825:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862753664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787560517.621876:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560517.621913:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafef9dd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560517.622534:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862753664 00000100:00100000:0.0:1787560517.622543:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862753664 00000100:00100000:0.0:1787560517.622593:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1787560517.622603:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:6497:x1874392862753664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787560517.623080:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:6497:x1874392862753664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 476us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560517.623090:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787560517.624293:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862753664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787560517.629837:0:10404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10404:1874392862753792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560517.629948:0:10404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560517.630001:0:10404:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafef9dd300 going to sleep for 11 seconds 00000100:00100000:0.0:1787560517.630110:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862753792 00000100:00100000:0.0:1787560517.630120:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862753792 00000100:00100000:0.0:1787560517.630183:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1787560517.630195:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:10404:x1874392862753792:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787560517.630359:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:10404:x1874392862753792:12345-0@lo:502:llog_process_th.0 Request processed in 165us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560517.630380:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1787560517.630706:0:10404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10404:1874392862753792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787560517.630747:0:10404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560517.630774:0:10404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560517.630777:0:10404:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787560517.630787:0:10404:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9caec1ef6000 00000020:00000080:3.0:1787560517.630790:0:10404:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787560517.630887:0:10404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10404:1874392862753920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560517.630930:0:10404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560517.630965:0:10404:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c80240 going to sleep for 11 seconds 00000100:00100000:1.0:1787560517.631039:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862753920 00000100:00100000:1.0:1787560517.631046:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862753920 00000100:00100000:1.0:1787560517.631089:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787560517.631099:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:10404:x1874392862753920:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560517.631193:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:10404:x1874392862753920:12345-0@lo:502:llog_process_th.0 Request processed in 94us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560517.631200:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787560517.632042:0:10404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10404:1874392862753920:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787560517.632079:0:10404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560517.632087:0:10404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560517.632089:0:10404:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787560517.632095:0:10404:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787560517.632180:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787560517.632201:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787560517.632215:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbff000/0x4642c20bf2f33d60 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d67 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560517.632243:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffcbff000/0x4642c20bf2f33d60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d67 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560517.632255:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787560517.632259:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cafeab05000 from 4 10000000:01000000:3.0:1787560517.632262:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787560517.632296:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33d6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560517.632305:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33d6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560517.632314:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33d6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560517.632334:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862754048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787560517.632387:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560517.632421:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c80240 going to sleep for 11 seconds 00000100:00100000:1.0:1787560517.632638:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862754048 00000100:00100000:1.0:1787560517.632644:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862754048 00000100:00100000:1.0:1787560517.632687:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1787560517.632696:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:6497:x1874392862754048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787560517.632710:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560517.632725:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffcbff600/0x4642c20bf2f33d75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33d6e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560517.632752:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffcbff600/0x4642c20bf2f33d75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33d6e expref: 22 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560517.632777:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffcbff600/0x4642c20bf2f33d75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33d6e expref: 22 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560517.632787:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbff600, rc 0) 00000100:00100000:1.0:1787560517.632830:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:6497:x1874392862754048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560517.632837:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1787560517.632891:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862754048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787560517.632906:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33d6e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d75 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560517.632915:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33d6e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33d75 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560517.632974:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862754176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787560517.633004:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560517.633024:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd7c29780 going to sleep for 11 seconds 00000100:00100000:1.0:1787560517.633037:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862754176 00000100:00100000:1.0:1787560517.633041:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862754176 00000100:00100000:1.0:1787560517.633065:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787560517.633073:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:6497:x1874392862754176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787560517.633196:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:6497:x1874392862754176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560517.633204:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787560517.633235:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862754176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787560517.633263:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862754304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787560517.633300:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560517.633314:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd7c29780 going to sleep for 11 seconds 00000100:00100000:1.0:1787560517.633326:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862754304 00000100:00100000:1.0:1787560517.633330:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862754304 00000100:00100000:1.0:1787560517.633352:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787560517.633358:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5802450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:6497:x1874392862754304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787560517.633492:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5802450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:6497:x1874392862754304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560517.638302:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787560517.638490:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862754304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787560517.639785:0:10407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10407:1874392862754432:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560517.639885:0:10407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560517.639934:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862754432 00000100:00100000:1.0:1787560517.639942:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862754432 00000100:00100000:1.0:1787560517.639997:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787560517.640009:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5801450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:10407:x1874392862754432:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560517.640161:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5801450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:10407:x1874392862754432:12345-0@lo:502:llog_process_th.0 Request processed in 153us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560517.640170:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787560517.640232:0:10407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd7c29c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787560517.640255:0:10407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10407:1874392862754432:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787560517.640286:0:10407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560517.640298:0:10407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560517.640301:0:10407:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787560517.640310:0:10407:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cafeab05000 00000020:00000080:1.0:1787560517.640313:0:10407:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787560517.640398:0:10407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10407:1874392862754560:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560517.640461:0:10407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560517.640483:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862754560 00000100:00100000:1.0:1787560517.640487:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862754560 00000100:00100000:1.0:1787560517.641837:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787560517.641855:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5801850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:10407:x1874392862754560:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560517.642004:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5801850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:10407:x1874392862754560:12345-0@lo:502:llog_process_th.0 Request processed in 154us (1542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560517.642021:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787560517.642088:0:10407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafef9dd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560517.642111:0:10407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10407:1874392862754560:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787560517.642147:0:10407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560517.642156:0:10407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560517.642158:0:10407:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787560517.642164:0:10407:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787560517.642249:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787560517.642273:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787560517.642286:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33d6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d75 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560517.642300:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33d6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d75 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560517.642313:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787560517.642316:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9caffba72800 from 4 10000000:01000000:1.0:1787560517.642319:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787560517.642354:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbff400/0x4642c20bf2f33d7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560517.642364:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffcbff400/0x4642c20bf2f33d7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560517.642375:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffcbff400/0x4642c20bf2f33d7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560517.642395:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862754688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787560517.642456:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560517.642485:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafef9dd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560517.642501:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862754688 00000100:00100000:1.0:1787560517.644644:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862754688 00000100:00100000:1.0:1787560517.644795:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787560517.644809:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5803450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:6497:x1874392862754688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787560517.644842:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560517.644876:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffcbfec00/0x4642c20bf2f33d83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33d7c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560517.644941:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffcbfec00/0x4642c20bf2f33d83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33d7c expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560517.644956:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffcbfec00/0x4642c20bf2f33d83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33d7c expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560517.644968:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbfec00, rc 0) 00000100:00100000:1.0:1787560517.645105:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5803450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:6497:x1874392862754688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 283us (2631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560517.645112:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787560517.645182:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862754688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787560517.645203:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffcbff400/0x4642c20bf2f33d7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d83 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560517.645216:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffcbff400/0x4642c20bf2f33d7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33d83 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560517.645302:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862754816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787560517.645339:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560517.645413:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafef9dd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560517.645487:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862754816 00000100:00100000:1.0:1787560517.645493:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862754816 00000100:00100000:0.0:1787560517.646690:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787560517.646719:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5802850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:6497:x1874392862754816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560517.646941:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5802850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:6497:x1874392862754816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 229us (1601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560517.646950:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787560517.648747:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862754816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787560517.648836:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862754944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787560517.648920:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560517.648963:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafef9dd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560517.649802:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862754944 00000100:00100000:0.0:1787560517.649814:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862754944 00000100:00100000:0.0:1787560517.649881:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787560517.649893:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5800c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:6497:x1874392862754944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787560517.650077:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5800c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:6497:x1874392862754944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560517.650086:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787560517.650641:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862754944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787560517.653041:0:10409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10409:1874392862755072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560517.653143:0:10409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560517.653195:0:10409:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafef9dd240 going to sleep for 11 seconds 00000100:00100000:0.0:1787560517.653249:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862755072 00000100:00100000:0.0:1787560517.653259:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862755072 00000100:00100000:0.0:1787560517.653315:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787560517.653327:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5803850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:10409:x1874392862755072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787560517.653630:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5803850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:10409:x1874392862755072:12345-0@lo:502:llog_process_th.0 Request processed in 304us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560517.653638:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787560517.653749:0:10409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10409:1874392862755072:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787560517.653801:0:10409:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560517.653814:0:10409:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560517.653816:0:10409:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787560517.653825:0:10409:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9caffba72800 00000020:00000080:1.0:1787560517.653828:0:10409:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787560517.653923:0:10409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10409:1874392862755200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560517.653964:0:10409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560517.653990:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862755200 00000100:00100000:1.0:1787560517.653995:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862755200 00000100:00100000:1.0:1787560517.654023:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787560517.654030:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5800450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:10409:x1874392862755200:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560517.654125:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5800450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:10409:x1874392862755200:12345-0@lo:502:llog_process_th.0 Request processed in 94us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560517.654133:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787560517.654207:0:10409:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafef9dd240 going to sleep for 11 seconds 00000100:00100000:1.0:1787560517.654219:0:10409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10409:1874392862755200:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787560517.654238:0:10409:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560517.654243:0:10409:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560517.654244:0:10409:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787560517.654248:0:10409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787560517.658209:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787560517.658302:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787560517.658331:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbff400/0x4642c20bf2f33d7c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d83 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560517.658360:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffcbff400/0x4642c20bf2f33d7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d83 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560517.658396:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787560517.658399:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cb000817800 from 4 10000000:01000000:0.0:1787560517.658402:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787560517.658570:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc1656000/0x4642c20bf2f33d8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560517.658590:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cafc1656000/0x4642c20bf2f33d8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560517.658605:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cafc1656000/0x4642c20bf2f33d8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560517.658661:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3887100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862755328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787560517.658813:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560517.658880:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec31d6780 going to sleep for 11 seconds 00000100:00100000:0.0:1787560517.658912:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862755328 00000100:00100000:0.0:1787560517.658921:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862755328 00000100:00100000:0.0:1787560517.658976:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787560517.658987:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5800050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:6497:x1874392862755328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787560517.659006:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560517.659021:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafc1656800/0x4642c20bf2f33d91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33d8a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560517.659051:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafc1656800/0x4642c20bf2f33d91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33d8a expref: 24 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560517.659063:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafc1656800/0x4642c20bf2f33d91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33d8a expref: 24 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560517.659086:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafc1656800, rc 0) 00000100:00100000:0.0:1787560517.659133:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5800050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:6497:x1874392862755328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560517.659141:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787560517.659195:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3887100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862755328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787560517.659212:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cafc1656000/0x4642c20bf2f33d8a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d91 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560517.659222:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cafc1656000/0x4642c20bf2f33d8a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33d91 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560517.659286:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3887100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862755456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560517.659314:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560517.659327:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec31d6780 going to sleep for 11 seconds 00000100:00100000:0.0:1787560517.659340:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862755456 00000100:00100000:0.0:1787560517.659344:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862755456 00000100:00100000:0.0:1787560517.659363:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787560517.659369:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5802c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:6497:x1874392862755456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560517.659521:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5802c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:6497:x1874392862755456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 151us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560517.659529:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787560517.659557:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3887100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862755456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560517.659586:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3887100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862755584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787560517.659629:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560517.659650:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec31d6780 going to sleep for 11 seconds 00000100:00100000:0.0:1787560517.659662:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862755584 00000100:00100000:0.0:1787560517.659666:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862755584 00000100:00100000:0.0:1787560517.659685:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787560517.659691:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:6497:x1874392862755584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787560517.659777:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:6497:x1874392862755584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560517.659783:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787560517.659824:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3887100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862755584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787560517.661777:0:10410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10410:1874392862755712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560517.661862:0:10410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560517.661903:0:10410:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafef9dd300 going to sleep for 11 seconds 00000100:00100000:2.0:1787560517.661956:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862755712 00000100:00100000:2.0:1787560517.661967:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862755712 00000100:00100000:2.0:1787560517.662056:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787560517.662067:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:10410:x1874392862755712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787560517.662212:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:10410:x1874392862755712:12345-0@lo:502:llog_process_th.0 Request processed in 146us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560517.662219:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787560517.662906:0:10410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10410:1874392862755712:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787560517.662946:0:10410:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560517.662959:0:10410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560517.662962:0:10410:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787560517.662970:0:10410:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cb000817800 00000020:00000080:1.0:1787560517.662973:0:10410:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787560517.663081:0:10410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10410:1874392862755840:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560517.663135:0:10410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560517.663167:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862755840 00000100:00100000:1.0:1787560517.663173:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862755840 00000100:00100000:1.0:1787560517.663212:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787560517.663223:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:10410:x1874392862755840:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560517.663318:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:10410:x1874392862755840:12345-0@lo:502:llog_process_th.0 Request processed in 96us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560517.663326:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787560517.663365:0:10410:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafef9dd300 going to sleep for 11 seconds 00000100:00100000:1.0:1787560517.663379:0:10410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:10410:1874392862755840:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787560517.663398:0:10410:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560517.663407:0:10410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560517.663409:0:10410:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787560517.663413:0:10410:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787560517.670643:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787560517.670692:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787560517.670708:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc1656000/0x4642c20bf2f33d8a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d91 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560517.670724:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cafc1656000/0x4642c20bf2f33d8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d91 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560517.683962:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862755968:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787560517.684061:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560517.684174:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862755968 00000100:00100000:1.0:1787560517.684185:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862755968 00000100:00100000:1.0:1787560517.684251:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787560517.684263:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862755968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787560517.684307:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787560517.684362:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862755968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560517.684371:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787560517.684600:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862755968:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787560518.645855:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560518.723701:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862756096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787560518.723826:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560518.724094:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560518.726519:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862756096 00000100:00100000:1.0:1787560518.726536:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862756096 00000100:00100000:1.0:1787560518.727051:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787560518.727064:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862756096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787560518.727104:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787560518.727208:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862756096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 145us (3381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560518.727219:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787560518.727257:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853256576 00000100:00100000:1.0:1787560518.728002:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853256576 00000100:00100000:1.0:1787560518.728060:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 269 00000100:00100000:1.0:1787560518.728072:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+9:6179:x1874392853256576:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787560518.728086:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560518.728107:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffcbfe200/0x4642c20bf2f33d98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fb56 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560518.728152:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffcbfe200/0x4642c20bf2f33d98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb56 expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560518.728166:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffcbfe200/0x4642c20bf2f33d98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb56 expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560518.728176:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbfe200, rc 0) 00000100:00100000:1.0:1787560518.728240:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+10:6179:x1874392853256576:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 Request processed in 171us (4148us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560518.728247:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 269 00000100:00100000:1.0:1787560518.733453:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862756096:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787560518.735909:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560518.736003:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853256704 00000100:00100000:3.0:1787560518.736694:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853256704 00000100:00100000:2.0:1787560518.736982:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 270 00000100:00100000:2.0:1787560518.736995:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+10:6179:x1874392853256704:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560518.737209:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+10:6179:x1874392853256704:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 Request processed in 216us (1313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560518.737219:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 270 00000100:00100000:1.0:1787560518.739984:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560518.740064:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853256832 00000100:00100000:2.0:1787560518.740081:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853256832 00000100:00100000:2.0:1787560518.740157:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 271 00000100:00100000:2.0:1787560518.740170:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+10:6179:x1874392853256832:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560518.745099:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+10:6179:x1874392853256832:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 Request processed in 4915us (5111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560518.745118:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 271 00000100:00100000:3.0:1787560518.748917:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560518.749003:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853256960 00000100:00100000:1.0:1787560518.749019:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853256960 00000100:00100000:1.0:1787560518.749097:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 272 00000100:00100000:1.0:1787560518.749107:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+10:6717:x1874392853256960:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787560518.749270:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+10:6717:x1874392853256960:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 153us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560518.749280:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 272 00000100:00100000:3.0:1787560518.751396:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560518.752172:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853257088 00000100:00100000:2.0:1787560518.752188:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853257088 00000100:00100000:2.0:1787560518.752272:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 273 00000100:00100000:2.0:1787560518.752285:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+10:6717:x1874392853257088:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787560518.752497:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+10:6717:x1874392853257088:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 214us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560518.752804:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 273 00010000:00010000:1.0:1787560519.667880:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560520.244885:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787560520.244910:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862756224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560520.244993:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560520.245072:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862756224 00000100:00100000:2.0:1787560520.245084:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862756224 00000100:00100000:2.0:1787560520.245143:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787560520.245158:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec32c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862756224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787560520.245187:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560520.245260:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec32c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862756224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560520.245267:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1787560520.245297:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560520.245690:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787560520.245701:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862756352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787560520.245750:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560520.245796:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862756352 00000100:00100000:0.0:1787560520.245804:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862756352 00000100:00100000:0.0:1787560520.245849:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787560520.245857:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3887100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862756352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787560520.245869:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560520.245905:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3887100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862756352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560520.245910:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1787560520.245938:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787560520.245974:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caff4b84000 x1874392862756352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560536 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560520.245996:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862756352:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1787560520.246100:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec32c4e00 x1874392862756224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560536 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560520.246115:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862756224:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787560520.691638:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560520.714520:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560520.714568:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560520.714607:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560520.714631:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560520.714656:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560520.714686:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853257728 00000100:00100000:3.0:1787560520.714696:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853257728 00000100:00100000:3.0:1787560520.714759:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853257600 00000100:00100000:3.0:1787560520.714762:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853257600 00000100:00100000:3.0:1787560520.715099:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:3.0:1787560520.715109:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853257728:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560520.715165:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853257472 00000100:00100000:0.0:1787560520.715169:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853257472 00000100:00100000:0.0:1787560520.715210:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853257344 00000100:00100000:0.0:1787560520.715214:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853257344 00000100:00100000:0.0:1787560520.715237:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 68 00000100:00100000:0.0:1787560520.715245:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853257472:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560520.715312:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853257472:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 68us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560520.715320:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 68 00000100:00100000:0.0:1787560520.715337:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 69 00000100:00100000:0.0:1787560520.715344:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:2403:x1874392853257344:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560520.715345:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853257728:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 238us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560520.715352:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:3.0:1787560520.715365:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00100000:0.0:1787560520.715366:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:2403:x1874392853257344:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 22us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560520.715371:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853257600:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560520.715372:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 69 00000100:00080000:0.0:1787560520.715387:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787560520.715391:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787560520.715393:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853257600:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 21us (736us total) trans 0 rc 0/0 00000100:00080000:0.0:1787560520.715393:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787560520.715395:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787560520.715398:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00100000:2.0:1787560520.715916:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853257216 00000100:00100000:2.0:1787560520.715923:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853257216 00000100:00100000:2.0:1787560520.715978:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 274 00000100:00100000:2.0:1787560520.715985:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+10:2403:x1874392853257216:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560520.716035:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+10:2403:x1874392853257216:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 51us (1527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560520.716042:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 274 00000100:00100000:2.0:1787560521.268697:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862756480:0@lo:400:kworker.0 00000100:00100000:2.0:1787560521.268781:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560521.268828:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862756992:0@lo:400:kworker.0 00000100:00100000:2.0:1787560521.268855:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560521.268874:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862757504:0@lo:400:kworker.0 00000100:00100000:2.0:1787560521.268897:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560521.268914:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862758016:0@lo:400:kworker.0 00000100:00100000:2.0:1787560521.268933:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560521.268956:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787560521.268962:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862756608:0@lo:400:kworker.0 00000100:00100000:2.0:1787560521.268985:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560521.269002:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874392862757120:0@lo:400:kworker.0 00000100:00100000:2.0:1787560521.269021:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560521.269038:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874392862757632:0@lo:400:kworker.0 00000100:00100000:2.0:1787560521.269080:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560521.269112:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862756736:0@lo:400:kworker.0 00000100:00100000:2.0:1787560521.269135:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560521.269153:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862757248:0@lo:400:kworker.0 00000100:00100000:2.0:1787560521.269172:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560521.269188:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874392862757760:0@lo:400:kworker.0 00000100:00100000:2.0:1787560521.269206:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560521.269218:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787560521.269223:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862756864:0@lo:400:kworker.0 00000100:00100000:2.0:1787560521.269240:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560521.269248:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862757376:0@lo:400:kworker.0 00000100:00100000:2.0:1787560521.269279:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560521.269296:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862757888:0@lo:400:kworker.0 00000100:00100000:2.0:1787560521.269314:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560521.269347:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862756480 00000100:00100000:2.0:1787560521.269354:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862756480 00000100:00100000:2.0:1787560521.269396:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787560521.269406:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3623:x1874392862756480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560521.269474:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3623:x1874392862756480:12345-0@lo:400:kworker.0 Request processed in 69us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560521.269481:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787560521.269512:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862756992 00000100:00100000:2.0:1787560521.269516:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862756992 00000100:00100000:2.0:1787560521.269538:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862756736 00000100:00100000:2.0:1787560521.269541:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862756736 00000100:00100000:2.0:1787560521.269555:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787560521.269567:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862756992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560521.269598:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862756992:12345-0@lo:400:kworker.0 Request processed in 32us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560521.269604:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787560521.269618:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787560521.269624:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862756736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560521.269653:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862756736:12345-0@lo:400:kworker.0 Request processed in 29us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560521.269659:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787560521.269673:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862756736:0@lo:400:kworker.0 00000100:00100000:2.0:1787560521.269674:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862757504 00000100:00100000:2.0:1787560521.269677:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862757504 00000100:00100000:2.0:1787560521.269693:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862758016 00000100:00100000:2.0:1787560521.269696:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862758016 00000100:00100000:2.0:1787560521.269728:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862757376 00000100:00100000:2.0:1787560521.269731:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862757376 00000100:00100000:2.0:1787560521.269753:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862757888 00000100:00100000:2.0:1787560521.269756:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862757888 00000100:00100000:2.0:1787560521.269770:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787560521.269776:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862757504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560521.269806:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862757504:12345-0@lo:400:kworker.0 Request processed in 30us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560521.269813:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787560521.269825:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787560521.269830:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862758016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560521.269855:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862758016:12345-0@lo:400:kworker.0 Request processed in 25us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560521.269861:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787560521.269879:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787560521.269886:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862757376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560521.269922:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862757376:12345-0@lo:400:kworker.0 Request processed in 37us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560521.269927:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787560521.269937:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787560521.269943:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862757888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560521.269967:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862757888:12345-0@lo:400:kworker.0 Request processed in 25us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560521.269973:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787560521.269993:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862756608 00000100:00100000:2.0:1787560521.269997:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862756608 00000100:00100000:2.0:1787560521.270013:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862757120 00000100:00100000:2.0:1787560521.270015:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862757120 00000100:00100000:2.0:1787560521.270026:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862757632 00000100:00100000:2.0:1787560521.270029:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862757632 00000100:00100000:2.0:1787560521.270039:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862757248 00000100:00100000:2.0:1787560521.270042:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862757248 00000100:00100000:2.0:1787560521.270051:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862757760 00000100:00100000:2.0:1787560521.270054:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862757760 00000100:00100000:1.0:1787560521.270063:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862756864 00000100:00100000:2.0:1787560521.270066:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787560521.270066:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862756864 00000100:00100000:2.0:1787560521.270072:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862756608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560521.270084:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787560521.270090:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874392862757120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560521.270101:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862756608:12345-0@lo:400:kworker.0 Request processed in 30us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560521.270107:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787560521.270118:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787560521.270123:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874392862757632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560521.270149:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874392862757632:12345-0@lo:400:kworker.0 Request processed in 26us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560521.270162:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787560521.270174:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787560521.270180:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862757248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560521.270208:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862757248:12345-0@lo:400:kworker.0 Request processed in 29us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560521.270214:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787560521.270224:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787560521.270230:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874392862757760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560521.270254:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874392862757120:12345-0@lo:400:kworker.0 Request processed in 29us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560521.270257:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874392862757760:12345-0@lo:400:kworker.0 Request processed in 28us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560521.270261:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787560521.270264:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787560521.270274:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787560521.270279:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862756864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560521.270313:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862756864:12345-0@lo:400:kworker.0 Request processed in 34us (1071us total) trans 0 rc 0/0 00000100:00080000:0.0:1787560521.270346:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787560521.270350:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787560521.270352:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787560521.271239:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862758144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560521.271284:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560521.273952:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862758144 00000100:00100000:2.0:1787560521.273963:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862758144 00000100:00100000:2.0:1787560521.274011:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787560521.274022:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862758144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787560521.274050:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560521.274129:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862758144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (2844us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560521.274136:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787560521.274449:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787560521.274466:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862758272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787560521.274503:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560521.274538:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862758272 00000100:00100000:0.0:1787560521.274542:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862758272 00000100:00100000:0.0:1787560521.274581:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787560521.274588:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862758272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787560521.274599:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560521.274630:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862758272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560521.274637:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1787560521.274671:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3957b80 x1874392862758272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560537 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560521.274689:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862758272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787560521.276534:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1787560521.278514:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec33c0a80 x1874392862758144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560537 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560521.278543:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862758144:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787560521.278591:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862756864:0@lo:400:kworker.0 00010000:00080000:2.0:1787560521.278606:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec32c5880 x1874392862757376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560521.278626:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862757376:0@lo:400:kworker.0 00010000:00080000:2.0:1787560521.278638:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3954700 x1874392862757888/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560521.278646:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862757888:0@lo:400:kworker.0 00010000:00080000:2.0:1787560521.278659:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec32c5f80 x1874392862757248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560521.278667:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862757248:0@lo:400:kworker.0 00010000:00080000:2.0:1787560521.278680:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec32c4e00 x1874392862757760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560521.278688:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874392862757760:0@lo:400:kworker.0 00000100:00100000:2.0:1787560521.278731:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862756608:0@lo:400:kworker.0 00000100:00100000:2.0:1787560521.278756:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874392862757120:0@lo:400:kworker.0 00000100:00100000:2.0:1787560521.278769:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874392862757632:0@lo:400:kworker.0 00000100:00100000:2.0:1787560521.278779:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862756480:0@lo:400:kworker.0 00000100:00100000:2.0:1787560521.278789:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862756992:0@lo:400:kworker.0 00010000:00080000:2.0:1787560521.278800:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec32c6a00 x1874392862757504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560521.278808:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862757504:0@lo:400:kworker.0 00010000:00080000:2.0:1787560521.278820:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3954a80 x1874392862758016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560521.278836:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862758016:0@lo:400:kworker.0 00010000:00010000:3.0:1787560521.718281:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560522.744122:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560522.803857:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862758400:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787560522.803929:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560522.804132:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862758400 00000100:00100000:1.0:1787560522.804140:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862758400 00000100:00100000:1.0:1787560522.804188:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787560522.804198:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862758400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787560522.804236:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787560522.804330:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862758400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560522.804338:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787560522.809138:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862758400:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1787560522.810996:0:10675:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1787560523.763675:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560523.829187:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862758528:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787560523.829264:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560523.829338:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862758528 00000100:00100000:2.0:1787560523.829352:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862758528 00000100:00100000:2.0:1787560523.829522:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787560523.829537:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862758528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787560523.829584:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787560523.829685:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862758528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 152us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560523.829693:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787560523.829793:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862758528:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787560524.792908:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560525.363666:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787560525.363691:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862758656:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787560525.363792:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560525.363944:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862758656 00000100:00100000:0.0:1787560525.363953:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862758656 00000100:00100000:0.0:1787560525.364026:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787560525.364036:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862758656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787560525.364065:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560525.364113:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862758656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560525.364121:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1787560525.364164:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3885180 x1874392862758656/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560541 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560525.364182:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862758656:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787560525.364463:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787560525.373056:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862758784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787560525.373136:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560525.373252:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862758784 00000100:00100000:0.0:1787560525.373260:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862758784 00000100:00100000:0.0:1787560525.373323:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787560525.373332:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862758784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787560525.373354:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1787560525.373458:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787560525.374855:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3954700 x1874392862758784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560541 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560525.374880:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862758784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787560525.374940:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862758784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1432us (1627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560525.374950:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:3.0:1787560525.816568:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560525.822336:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560525.822376:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560525.822404:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560525.822425:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560525.822472:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560525.822502:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853257984 00000100:00100000:3.0:1787560525.822511:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853257984 00000100:00100000:3.0:1787560525.822569:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853258112 00000100:00100000:3.0:1787560525.822573:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853258112 00000100:00100000:3.0:1787560525.822599:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 76 00000100:00100000:3.0:1787560525.822610:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:2405:x1874392853257984:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560525.822687:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:2405:x1874392853257984:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 80us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560525.822695:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 76 00000100:00100000:3.0:1787560525.822724:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 77 00000100:00100000:3.0:1787560525.822731:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+5:2405:x1874392853258112:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560525.822757:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+5:2405:x1874392853258112:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 27us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560525.822770:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 77 00000100:00100000:3.0:1787560525.822790:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853258240 00000100:00100000:3.0:1787560525.822794:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853258240 00000100:00100000:3.0:1787560525.822820:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853258368 00000100:00100000:3.0:1787560525.822823:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853258368 00000100:00100000:3.0:1787560525.822844:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 29 00000100:00100000:3.0:1787560525.822851:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:2405:x1874392853258240:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560525.822880:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:2405:x1874392853258240:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 30us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560525.822887:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 29 00000100:00100000:3.0:1787560525.822899:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 30 00000100:00100000:3.0:1787560525.822905:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:2405:x1874392853258368:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560525.822930:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:2405:x1874392853258368:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 25us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560525.822935:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 30 00000100:00100000:3.0:1787560525.822953:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853257856 00000100:00100000:3.0:1787560525.822956:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853257856 00000100:00100000:3.0:1787560525.822980:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 276 00000100:00100000:3.0:1787560525.822986:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+10:2405:x1874392853257856:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560525.823009:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+10:2405:x1874392853257856:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 23us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560525.823015:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 276 00000100:00080000:3.0:1787560525.823046:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787560525.823050:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787560525.823052:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787560525.823062:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560526.391370:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787560526.391394:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec38e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862758912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787560526.391530:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560526.391876:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862758912 00000100:00100000:0.0:1787560526.391885:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862758912 00000100:00100000:0.0:1787560526.391944:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787560526.391954:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862758912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787560526.391984:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560526.392032:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862758912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560526.392039:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1787560526.392075:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787560526.392107:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec38e9f80 x1874392862758912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560542 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560526.392126:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec38e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862758912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787560526.392405:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787560526.392415:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec38eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862759040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787560526.392469:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560526.392536:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862759040 00000100:00100000:0.0:1787560526.392541:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862759040 00000100:00100000:0.0:1787560526.392579:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787560526.392586:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862759040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787560526.392596:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560526.392630:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862759040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560526.392648:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1787560526.392678:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec38eb480 x1874392862759040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560542 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560526.392690:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec38eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862759040:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787560526.392753:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787560526.394179:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862759424:0@lo:400:kworker.0 00000100:00100000:0.0:1787560526.394242:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560526.394274:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874392862759936:0@lo:400:kworker.0 00000100:00100000:0.0:1787560526.394300:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560526.394324:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862760448:0@lo:400:kworker.0 00000100:00100000:0.0:1787560526.394345:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560526.394378:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787560526.394384:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862759296:0@lo:400:kworker.0 00000100:00100000:0.0:1787560526.394406:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560526.394424:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862759808:0@lo:400:kworker.0 00000100:00100000:0.0:1787560526.394466:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560526.394483:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1fac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862760320:0@lo:400:kworker.0 00000100:00100000:0.0:1787560526.394502:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560526.394526:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862759936 00000100:00100000:0.0:1787560526.394533:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862759936 00000100:00100000:0.0:1787560526.394573:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862760448 00000100:00100000:0.0:1787560526.394577:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862760448 00000100:00100000:0.0:1787560526.394590:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862759296 00000100:00100000:0.0:1787560526.394593:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862759296 00000100:00100000:0.0:1787560526.394603:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862759808 00000100:00100000:0.0:1787560526.394605:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862759808 00000100:00100000:0.0:1787560526.394628:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862760320 00000100:00100000:0.0:1787560526.394631:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862760320 00000100:00100000:0.0:1787560526.394646:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787560526.394652:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874392862759936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560526.394699:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874392862759936:12345-0@lo:400:kworker.0 Request processed in 46us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560526.394716:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787560526.394733:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787560526.394739:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874392862760448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560526.394767:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874392862760448:12345-0@lo:400:kworker.0 Request processed in 28us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560526.394773:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787560526.394784:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787560526.394790:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862759296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560526.394817:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862759296:12345-0@lo:400:kworker.0 Request processed in 26us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560526.394823:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787560526.394834:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787560526.394841:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862759808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560526.394866:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862759808:12345-0@lo:400:kworker.0 Request processed in 27us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560526.394872:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787560526.394882:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787560526.394889:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862760320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560526.394914:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862760320:12345-0@lo:400:kworker.0 Request processed in 26us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560526.394929:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787560526.394956:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862759552:0@lo:400:kworker.0 00000100:00100000:0.0:1787560526.394982:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560526.395000:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862760064:0@lo:400:kworker.0 00000100:00100000:0.0:1787560526.395025:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560526.395047:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787560526.395052:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862759168:0@lo:400:kworker.0 00000100:00100000:0.0:1787560526.395077:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560526.395102:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862759680:0@lo:400:kworker.0 00000100:00100000:0.0:1787560526.395122:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560526.395139:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1faf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862760192:0@lo:400:kworker.0 00000100:00100000:0.0:1787560526.395158:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560526.395184:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862760064 00000100:00100000:0.0:1787560526.395188:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862760064 00000100:00100000:0.0:1787560526.395212:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862760192 00000100:00100000:0.0:1787560526.395215:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862760192 00000100:00100000:0.0:1787560526.395233:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787560526.395239:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec32c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862760064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560526.395274:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec32c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862760064:12345-0@lo:400:kworker.0 Request processed in 35us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560526.395281:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787560526.395292:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787560526.395298:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec32c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862760192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560526.395343:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec32c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862760192:12345-0@lo:400:kworker.0 Request processed in 45us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560526.395357:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787560526.395376:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862759168 00000100:00100000:0.0:1787560526.395380:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862759168 00000100:00100000:0.0:1787560526.395405:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1787560526.395412:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3623:x1874392862759168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560526.395473:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3623:x1874392862759168:12345-0@lo:400:kworker.0 Request processed in 62us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560526.395480:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1787560526.395506:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862759424 00000100:00100000:0.0:1787560526.395510:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862759424 00000100:00100000:0.0:1787560526.395533:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862759680 00000100:00100000:0.0:1787560526.395536:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862759680 00000100:00100000:0.0:1787560526.395547:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787560526.395553:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862759424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560526.395584:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862759424:12345-0@lo:400:kworker.0 Request processed in 32us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560526.395590:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787560526.395600:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787560526.395605:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec32c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862759680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560526.395629:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec32c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862759680:12345-0@lo:400:kworker.0 Request processed in 24us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560526.395634:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1787560526.395665:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787560526.395669:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787560526.395695:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862759168:0@lo:400:kworker.0 00000100:00100000:0.0:1787560526.395721:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862759680:0@lo:400:kworker.0 00010000:00080000:0.0:1787560526.395740:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec1faf800 x1874392862760192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560526.395752:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1faf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862760192:0@lo:400:kworker.0 00010000:00080000:0.0:1787560526.395761:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcaa8700 x1874392862760064/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560526.395769:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862760064:0@lo:400:kworker.0 00000100:00100000:0.0:1787560526.395809:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862759296:0@lo:400:kworker.0 00000100:00100000:0.0:1787560526.395819:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862759808:0@lo:400:kworker.0 00000100:00100000:0.0:1787560526.395829:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1fac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862760320:0@lo:400:kworker.0 00000100:00100000:0.0:1787560526.395838:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862759424:0@lo:400:kworker.0 00010000:00080000:0.0:1787560526.395849:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2006a00 x1874392862759936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560526.395858:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874392862759936:0@lo:400:kworker.0 00010000:00080000:0.0:1787560526.395868:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2ccf480 x1874392862760448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560526.395875:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862760448:0@lo:400:kworker.0 00000100:00100000:0.0:1787560526.395901:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862759552 00000100:00100000:0.0:1787560526.395904:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862759552 00000100:00100000:0.0:1787560526.395926:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787560526.395932:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862759552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560526.395967:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862759552:12345-0@lo:400:kworker.0 Request processed in 34us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560526.395980:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787560526.396009:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862759552:0@lo:400:kworker.0 00010000:00010000:1.0:1787560526.835613:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787560527.730090:0:10919:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing yml_node 00010000:00010000:1.0:1787560527.861606:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560527.924136:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862760576:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787560527.924207:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560527.925705:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862760576 00000100:00100000:3.0:1787560527.925716:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862760576 00000100:00100000:3.0:1787560527.925767:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787560527.925778:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec32c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862760576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787560527.925814:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787560527.925890:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec32c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862760576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (1683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560527.925897:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787560527.926048:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862760576:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787560528.885861:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560528.948634:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862760704:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787560528.948719:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560528.949113:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862760704 00000100:00100000:0.0:1787560528.949124:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862760704 00000100:00100000:0.0:1787560528.949180:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787560528.949192:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862760704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787560528.949225:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787560528.951415:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862760704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2217us (2687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560528.951441:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787560528.953728:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862760704:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787560529.910859:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560530.483764:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862760832:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787560530.483844:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560530.483939:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862760832 00000100:00100000:1.0:1787560530.483941:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787560530.483948:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862760832 00000100:00100000:1.0:1787560530.483950:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862760960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787560530.483978:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560530.484011:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862760960 00000100:00100000:0.0:1787560530.484016:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862760960 00000100:00100000:1.0:1787560530.484030:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1787560530.484082:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787560530.484341:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862760832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787560530.484372:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787560530.484427:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862760832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (584us total) trans 0 rc 0/0 00010000:00080000:3.0:1787560530.484511:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec32c7b80 x1874392862760832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560546 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560530.484529:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862760832:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787560530.490607:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787560530.490637:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2cce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862760960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787560530.490667:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560530.490796:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2cce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862760960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 174us (6817us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560530.490805:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1787560530.490931:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec32c4e00 x1874392862760960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560546 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560530.490964:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862760960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787560530.497699:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1787560530.931761:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560530.944940:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560530.944977:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560530.945023:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560530.945159:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853258496 00000100:00100000:3.0:1787560530.945177:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853258496 00000100:00100000:3.0:1787560530.945227:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 278 00000100:00100000:3.0:1787560530.945237:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+10:2405:x1874392853258496:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560530.945299:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+10:2405:x1874392853258496:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 64us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560530.945306:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 278 00000100:00100000:2.0:1787560530.946745:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853258752 00000100:00100000:2.0:1787560530.946753:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853258752 00000100:00100000:2.0:1787560530.946853:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853258624 00000100:00100000:2.0:1787560530.946864:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853258624 00000100:00100000:1.0:1787560530.946917:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 84 00000100:00100000:1.0:1787560530.946935:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec32c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+5:2405:x1874392853258752:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560530.946990:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec32c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+5:2405:x1874392853258752:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 65us (2012us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560530.946997:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 84 00000100:00080000:0.0:1787560530.947705:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787560530.947724:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787560530.951897:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 85 00000100:00100000:2.0:1787560530.951916:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec32c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+6:2405:x1874392853258624:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560530.952017:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec32c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+6:2405:x1874392853258624:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 108us (6992us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560530.952026:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 85 00000100:00100000:1.0:1787560530.955260:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560530.955514:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853258880 00000100:00100000:3.0:1787560530.955524:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853258880 00000100:00100000:3.0:1787560530.955635:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:3.0:1787560530.955648:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:2401:x1874392853258880:12345-192.168.203.29@tcp:9:kworker.0 00000020:00000080:3.0:1787560530.955693:0:8414:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33caa 00000100:00080000:3.0:1787560530.955702:0:8414:0:(import.c:65:import_set_state_nolock()) ffff9caec32ff800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787560530.955749:0:8414:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1787560530.955913:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+2:2401:x1874392853258880:12345-192.168.203.29@tcp:9:kworker.0 Request processed in 267us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560530.955921:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 18 00010000:00010000:3.0:1787560530.956740:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560530.956870:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560530.957072:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853259008 00000100:00100000:0.0:1787560530.957079:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853259008 00000100:00080000:1.0:1787560530.957208:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787560530.957212:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560530.959856:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:0.0:1787560530.959873:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4aa5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+5:2401:x1874392853259008:12345-192.168.203.29@tcp:9:kworker.0 00000020:00000080:0.0:1787560530.959914:0:10171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33cb1 00000100:00080000:0.0:1787560530.959936:0:10171:0:(import.c:65:import_set_state_nolock()) ffff9caec32fb000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787560530.959987:0:10171:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1787560530.960148:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4aa5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+2:2401:x1874392853259008:12345-192.168.203.29@tcp:9:kworker.0 Request processed in 280us (3279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560530.960156:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 19 00010000:00010000:2.0:1787560530.962361:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560531.508170:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862761088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787560531.508277:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560531.508340:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862761600:0@lo:400:kworker.0 00000100:00100000:1.0:1787560531.508372:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560531.508390:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862762112:0@lo:400:kworker.0 00000100:00100000:1.0:1787560531.508423:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560531.508465:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862762624:0@lo:400:kworker.0 00000100:00100000:1.0:1787560531.508487:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560531.508522:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1787560531.508529:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862761216:0@lo:400:kworker.0 00000100:00100000:1.0:1787560531.508559:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560531.508583:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862761728:0@lo:400:kworker.0 00000100:00100000:1.0:1787560531.508607:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560531.508625:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862762240:0@lo:400:kworker.0 00000100:00100000:1.0:1787560531.508646:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560531.508664:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862762752:0@lo:400:kworker.0 00000100:00100000:1.0:1787560531.508708:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560531.508743:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862761344:0@lo:400:kworker.0 00000100:00100000:1.0:1787560531.508769:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560531.508965:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862761856:0@lo:400:kworker.0 00000100:00100000:1.0:1787560531.508988:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560531.509005:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874392862762368:0@lo:400:kworker.0 00000100:00100000:1.0:1787560531.509045:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560531.509073:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787560531.509080:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862761472:0@lo:400:kworker.0 00000100:00100000:1.0:1787560531.509105:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560531.509121:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862761984:0@lo:400:kworker.0 00000100:00100000:1.0:1787560531.509142:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560531.509151:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874392862762496:0@lo:400:kworker.0 00000100:00100000:1.0:1787560531.509175:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560531.509210:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862761088 00000100:00100000:1.0:1787560531.509220:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862761088 00000100:00100000:2.0:1787560531.509620:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec38eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862762880:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787560531.509659:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560531.509979:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862762880 00000100:00100000:2.0:1787560531.509985:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862762880 00000100:00100000:2.0:1787560531.510072:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787560531.510083:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862762880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787560531.510139:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560531.510197:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862762880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 115us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560531.510206:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787560531.510395:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787560531.510406:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862761088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787560531.510419:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787560531.510491:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862761088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (2226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560531.510498:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1787560531.510549:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2ccfb80 x1874392862761088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560547 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560531.510587:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862761088:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787560531.510908:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec38eb800 x1874392862762880/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560547 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560531.510925:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862761600 00000100:00100000:2.0:1787560531.510926:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec38eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862762880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787560531.510934:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862761600 00000100:00100000:1.0:1787560531.510967:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862761344 00000100:00100000:1.0:1787560531.510970:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862761344 00000100:00100000:1.0:1787560531.510984:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862761856 00000100:00100000:1.0:1787560531.510987:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862761856 00000100:00100000:1.0:1787560531.511002:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862762368 00000100:00100000:1.0:1787560531.511005:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862762368 00000100:00100000:1.0:1787560531.511017:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862761984 00000100:00100000:1.0:1787560531.511019:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862761984 00000100:00100000:1.0:1787560531.511031:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862762496 00000100:00100000:1.0:1787560531.511033:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862762496 00000100:00100000:1.0:1787560531.511047:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787560531.511056:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862761600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560531.511115:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862761600:12345-0@lo:400:kworker.0 Request processed in 61us (2743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560531.511122:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787560531.511135:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787560531.511140:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862761344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560531.511179:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862761344:12345-0@lo:400:kworker.0 Request processed in 39us (2409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560531.511186:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787560531.511203:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787560531.511211:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862761856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560531.511215:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862761344:0@lo:400:kworker.0 00000100:00100000:1.0:1787560531.511255:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862761856:12345-0@lo:400:kworker.0 Request processed in 44us (2265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560531.511267:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862761856:0@lo:400:kworker.0 00000100:00100000:3.0:1787560531.511323:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862761600:0@lo:400:kworker.0 00000100:00100000:1.0:1787560531.512393:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787560531.512424:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787560531.512449:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874392862762368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560531.512526:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874392862762368:12345-0@lo:400:kworker.0 Request processed in 94us (3480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560531.512531:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787560531.512542:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787560531.512549:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2353800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862761984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560531.512577:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2353800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862761984:12345-0@lo:400:kworker.0 Request processed in 29us (3433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560531.512583:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787560531.512596:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787560531.512606:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874392862762496:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787560531.512607:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3851f80 x1874392862761984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560531.512633:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874392862762496:12345-0@lo:400:kworker.0 Request processed in 31us (3455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560531.512634:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862761984:0@lo:400:kworker.0 00000100:00100000:1.0:1787560531.512646:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:3.0:1787560531.512660:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3852a00 x1874392862762496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560531.512679:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862762112 00000100:00100000:3.0:1787560531.512683:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874392862762496:0@lo:400:kworker.0 00000100:00100000:1.0:1787560531.512687:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862762112 00000100:00100000:3.0:1787560531.512700:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874392862762368:0@lo:400:kworker.0 00000100:00100000:1.0:1787560531.512720:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862762624 00000100:00100000:1.0:1787560531.512725:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862762624 00000100:00100000:1.0:1787560531.512736:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862762240 00000100:00100000:1.0:1787560531.512738:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862762240 00000100:00100000:1.0:1787560531.512746:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862762752 00000100:00100000:1.0:1787560531.512748:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862762752 00000100:00100000:1.0:1787560531.512757:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787560531.512763:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862762112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560531.513968:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862762112:12345-0@lo:400:kworker.0 Request processed in 1197us (5536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560531.513980:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787560531.514007:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787560531.514017:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862762624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560531.514042:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862762624:12345-0@lo:400:kworker.0 Request processed in 29us (5556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560531.514048:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787560531.514057:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787560531.514062:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862762240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560531.514084:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862762240:12345-0@lo:400:kworker.0 Request processed in 22us (5438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560531.514089:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787560531.514097:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787560531.514102:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862762752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560531.514123:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862762752:12345-0@lo:400:kworker.0 Request processed in 21us (5414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560531.514127:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787560531.514159:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862761216 00000100:00100000:1.0:1787560531.514166:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862761216 00000100:00100000:1.0:1787560531.514209:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1787560531.514215:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3623:x1874392862761216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560531.514244:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3623:x1874392862761216:12345-0@lo:400:kworker.0 Request processed in 30us (5684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560531.514249:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1787560531.514350:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862761216:0@lo:400:kworker.0 00010000:00080000:3.0:1787560531.514373:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3853480 x1874392862762240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560531.514385:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862762240:0@lo:400:kworker.0 00010000:00080000:3.0:1787560531.514407:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3851500 x1874392862762752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560531.514416:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862762752:0@lo:400:kworker.0 00010000:00080000:3.0:1787560531.514450:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3852300 x1874392862762112/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560531.514461:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862762112:0@lo:400:kworker.0 00010000:00080000:3.0:1787560531.514580:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3853800 x1874392862762624/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560531.514598:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862762624:0@lo:400:kworker.0 00000100:00100000:1.0:1787560531.515517:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862761728 00000100:00100000:1.0:1787560531.515529:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862761728 00000100:00100000:1.0:1787560531.515576:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862761472 00000100:00100000:1.0:1787560531.515579:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862761472 00000100:00100000:1.0:1787560531.515595:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787560531.515604:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862761728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560531.515938:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787560531.515950:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862761472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560531.524747:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862761472:12345-0@lo:400:kworker.0 Request processed in 8785us (15626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560531.524767:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787560531.524887:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862761472:0@lo:400:kworker.0 00000100:00100000:1.0:1787560531.525576:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862761728:12345-0@lo:400:kworker.0 Request processed in 9968us (16962us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560531.525589:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1787560531.525657:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787560531.525849:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862761728:0@lo:400:kworker.0 00000100:00080000:1.0:1787560531.526053:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787560531.526059:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:3.0:1787560531.659410:0:11103:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.82 00010000:00010000:0.0:1787560531.955624:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560532.979804:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560533.044834:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862763008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787560533.044931:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560533.045077:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862763008 00000100:00100000:0.0:1787560533.045087:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862763008 00000100:00100000:0.0:1787560533.045160:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787560533.045171:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862763008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787560533.045216:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787560533.046033:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862763008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 799us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560533.046043:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787560533.046130:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862763008:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787560534.005975:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560534.069340:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862763136:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787560534.069472:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560534.069632:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862763136 00000100:00100000:2.0:1787560534.069643:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862763136 00000100:00100000:2.0:1787560534.069714:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787560534.069726:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862763136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787560534.069771:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787560534.069852:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862763136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560534.069859:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787560534.069961:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862763136:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1787560534.262923:0:11200:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.82 00010000:00010000:3.0:1787560535.045333:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560535.603843:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787560535.603870:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec38ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862763264:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787560535.603944:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560535.604161:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862763264 00000100:00100000:3.0:1787560535.604170:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862763264 00000100:00100000:3.0:1787560535.604239:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787560535.604250:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862763264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787560535.604277:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787560535.604322:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862763264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560535.604329:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1787560535.604388:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787560535.604489:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec38ebb80 x1874392862763264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560535.604508:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec38ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862763264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787560535.604807:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862763392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787560535.604842:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560535.604925:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862763392 00000100:00100000:2.0:1787560535.604930:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862763392 00000100:00100000:2.0:1787560535.604984:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787560535.604993:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2351c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862763392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787560535.605005:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560535.605038:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2351c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862763392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560535.605044:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1787560535.605191:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787560535.605209:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec32c6a00 x1874392862763392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560535.605223:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862763392:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787560536.062802:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560536.067108:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560536.067155:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560536.067196:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560536.067229:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853259264 00000100:00100000:0.0:1787560536.067237:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853259264 00000100:00100000:0.0:1787560536.067299:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853259392 00000100:00100000:0.0:1787560536.067303:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853259392 00000100:00100000:0.0:1787560536.067344:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 92 00000100:00100000:0.0:1787560536.067355:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec32c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+6:2405:x1874392853259264:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560536.067453:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec32c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+6:2405:x1874392853259264:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 76us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560536.067462:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 92 00000100:00100000:0.0:1787560536.067479:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 93 00000100:00100000:0.0:1787560536.067486:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec32c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:2404:x1874392853259392:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560536.067513:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec32c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:2404:x1874392853259392:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 28us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560536.067520:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 93 00000100:00080000:0.0:1787560536.067536:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787560536.067540:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560536.067841:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853259136 00000100:00100000:2.0:1787560536.067847:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853259136 00000100:00100000:2.0:1787560536.067887:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 280 00000100:00100000:2.0:1787560536.067895:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+10:2404:x1874392853259136:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560536.067930:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+10:2404:x1874392853259136:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 36us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560536.067937:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 280 00000001:02000400:3.0:1787560536.616588:0:11297:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.82 00000100:00100000:3.0:1787560536.627664:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862763520:0@lo:400:kworker.0 00000100:00100000:3.0:1787560536.627765:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560536.628293:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862763904:0@lo:400:kworker.0 00000100:00100000:2.0:1787560536.628354:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560536.628389:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787560536.628397:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862764032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787560536.628424:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560536.628482:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862763904 00000100:00100000:2.0:1787560536.628492:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862763904 00000100:00100000:2.0:1787560536.628548:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787560536.628558:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862763904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560536.628615:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862763904:12345-0@lo:400:kworker.0 Request processed in 58us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560536.628638:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787560536.628662:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862764032 00000100:00100000:2.0:1787560536.628666:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862764032 00000100:00100000:2.0:1787560536.628700:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787560536.628706:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862764032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787560536.628735:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560536.628765:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862764032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560536.628771:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1787560536.628791:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787560536.628823:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec32c6680 x1874392862764032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560552 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560536.628843:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862764032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787560536.628855:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862763904:0@lo:400:kworker.0 00000100:00100000:1.0:1787560536.632195:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862763520 00000100:00100000:1.0:1787560536.632206:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862763520 00000100:00100000:1.0:1787560536.632264:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1787560536.632276:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3626:x1874392862763520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560536.632379:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3626:x1874392862763520:12345-0@lo:400:kworker.0 Request processed in 106us (4615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560536.632385:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1787560536.632762:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862763648:0@lo:400:kworker.0 00000100:00100000:3.0:1787560536.632795:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874392862764544:0@lo:400:kworker.0 00000100:00100000:1.0:1787560536.632823:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560536.632870:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862764160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560536.632882:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862763648 00000100:00100000:2.0:1787560536.632888:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862763648 00000100:00100000:1.0:1787560536.632920:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560536.632938:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787560536.632947:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862763648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560536.632950:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862764672:0@lo:400:kworker.0 00000100:00100000:1.0:1787560536.632986:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560536.633006:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862763648:12345-0@lo:400:kworker.0 Request processed in 60us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560536.633015:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787560536.633023:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862765184:0@lo:400:kworker.0 00000100:00100000:1.0:1787560536.633047:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560536.633092:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862763648:0@lo:400:kworker.0 00000100:00100000:1.0:1787560536.633109:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787560536.633117:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2350700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862763776:0@lo:400:kworker.0 00000100:00100000:1.0:1787560536.633143:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560536.633171:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862764288:0@lo:400:kworker.0 00000100:00100000:1.0:1787560536.633191:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560536.633204:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862764800:0@lo:400:kworker.0 00000100:00100000:1.0:1787560536.633218:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560536.633221:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862763776 00000100:00100000:2.0:1787560536.633228:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862763776 00000100:00100000:1.0:1787560536.633253:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862764160 00000100:00100000:1.0:1787560536.633259:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862764160 00000100:00100000:2.0:1787560536.633260:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862764288 00000100:00100000:2.0:1787560536.633265:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862764288 00000100:00100000:2.0:1787560536.633284:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787560536.633293:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862763776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560536.633310:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787560536.633319:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862764160:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560536.633341:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862763776:12345-0@lo:400:kworker.0 Request processed in 49us (196us total) trans 0 rc 0/0 00002000:00000024:1.0:1787560536.633341:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560536.633350:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787560536.633365:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787560536.633372:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862764288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560536.633394:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862764160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560536.633403:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787560536.633410:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862764288:12345-0@lo:400:kworker.0 Request processed in 38us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560536.633418:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787560536.633427:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862764672 00000100:00100000:1.0:1787560536.633451:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862764672 00000100:00100000:2.0:1787560536.633474:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2350700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862763776:0@lo:400:kworker.0 00000100:00100000:1.0:1787560536.633481:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862765184 00000100:00100000:1.0:1787560536.633486:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862765184 00000100:00100000:2.0:1787560536.633490:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862764288:0@lo:400:kworker.0 00000100:00100000:1.0:1787560536.633503:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862764800 00000100:00100000:1.0:1787560536.633507:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862764800 00010000:00080000:2.0:1787560536.633511:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3954000 x1874392862764160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560552 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560536.633524:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787560536.633533:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862764160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787560536.633535:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862764672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560536.633591:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862764672:12345-0@lo:400:kworker.0 Request processed in 60us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560536.633599:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1787560536.633615:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2351880 x1874392862764672/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560536.633616:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787560536.633644:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862764672:0@lo:400:kworker.0 00000100:00100000:1.0:1787560536.633700:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862765184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560536.633748:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862765184:12345-0@lo:400:kworker.0 Request processed in 124us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560536.633754:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787560536.633766:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787560536.633773:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862764800:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787560536.633810:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2353480 x1874392862765184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560536.633810:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862764800:12345-0@lo:400:kworker.0 Request processed in 35us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560536.633826:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787560536.633832:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862765184:0@lo:400:kworker.0 00010000:00080000:2.0:1787560536.633850:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2352d80 x1874392862764800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560536.633859:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862764800:0@lo:400:kworker.0 00000100:00080000:1.0:1787560536.633864:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787560536.633888:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2350e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862764416:0@lo:400:kworker.0 00000100:00100000:1.0:1787560536.633919:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560536.633956:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2351f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874392862764928:0@lo:400:kworker.0 00000100:00100000:1.0:1787560536.633982:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560536.634018:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862764416 00000100:00100000:1.0:1787560536.634021:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862764928 00000100:00100000:2.0:1787560536.634024:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862764416 00000100:00100000:1.0:1787560536.634027:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862764928 00000100:00100000:2.0:1787560536.634069:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787560536.634077:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862764416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560536.634115:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862764416:12345-0@lo:400:kworker.0 Request processed in 40us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560536.634121:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000001:00100000:3.0:1787560536.635295:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9331bacf-6cfc-4379-8649-925e79b19df1 00000020:00000080:3.0:1787560536.635303:0:8407:0:(genops.c:885:class_export_put()) final put ffff9caec32fa000/9331bacf-6cfc-4379-8649-925e79b19df1 00000100:00100000:3.0:1787560536.635341:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560536.635355:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787560536.635370:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874392862764928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560536.635399:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862765056:0@lo:400:kworker.0 00000100:00100000:3.0:1787560536.635464:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560536.635501:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862763520:0@lo:400:kworker.0 00000100:00100000:3.0:1787560536.635532:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862764544 00000100:00100000:3.0:1787560536.635538:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862764544 00000100:00100000:3.0:1787560536.635562:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862765056 00000100:00100000:3.0:1787560536.636307:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862765056 00000100:00100000:3.0:1787560536.636344:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787560536.636352:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874392862764544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560536.636681:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874392862764544:12345-0@lo:400:kworker.0 Request processed in 328us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560536.636690:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787560536.636706:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787560536.636713:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874392862765056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560536.636742:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874392862765056:12345-0@lo:400:kworker.0 Request processed in 30us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560536.636747:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787560536.636856:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874392862764928:12345-0@lo:400:kworker.0 Request processed in 1488us (2871us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560536.636866:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:1.0:1787560536.636895:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787560536.637074:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560536.637787:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2350e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862764416:0@lo:400:kworker.0 00000100:00100000:1.0:1787560536.637806:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2351f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874392862764928:0@lo:400:kworker.0 00000001:00100000:1.0:1787560536.641860:0:9491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9331bacf-6cfc-4379-8649-925e79b19df1 00000020:00000080:1.0:1787560536.641873:0:9491:0:(genops.c:885:class_export_put()) final put ffff9caec32fd000/9331bacf-6cfc-4379-8649-925e79b19df1 00010000:00080000:2.0:1787560536.642567:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2350000 x1874392862764544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560536.642588:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874392862764544:0@lo:400:kworker.0 00010000:00080000:2.0:1787560536.642606:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2352300 x1874392862765056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560536.642615:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862765056:0@lo:400:kworker.0 00000020:00000080:3.0:1787560536.643841:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec32fa000/9331bacf-6cfc-4379-8649-925e79b19df1 for lustre-OST0000 00000020:00000080:3.0:1787560536.643921:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec32fd000/9331bacf-6cfc-4379-8649-925e79b19df1 for lustre-OST0001 00000020:00000080:3.0:1787560536.643944:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec32ff800 for lustre-OST0000 00000020:00000080:3.0:1787560536.643949:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec32fb000 for lustre-OST0001 00010000:00010000:1.0:1787560537.076786:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560538.106058:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560538.163675:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787560538.163708:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec38eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862765312:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787560538.163804:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560538.163906:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862765312 00000100:00100000:3.0:1787560538.163932:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862765312 00000100:00100000:3.0:1787560538.163996:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787560538.164007:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862765312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787560538.164050:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787560538.164101:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862765312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560538.164109:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787560538.164165:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec38eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862765312:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1787560538.277104:0:11346:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Aug 24 04:35:36 EDT 2026 00010000:00010000:1.0:1787560539.127902:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560539.188668:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862765440:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787560539.188746:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560539.189049:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862765440 00000100:00100000:3.0:1787560539.189058:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862765440 00000100:00100000:3.0:1787560539.189117:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787560539.189126:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862765440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787560539.189157:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787560539.196185:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862765440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 7049us (7427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560539.196201:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787560539.197135:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862765440:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787560540.149843:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560540.723697:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787560540.723723:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec38eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862765568:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787560540.723810:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560540.723881:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862765568 00000100:00100000:3.0:1787560540.723990:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862765568 00000100:00100000:3.0:1787560540.724049:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787560540.724060:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862765568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787560540.724089:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787560540.724135:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862765568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560540.724142:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1787560540.724171:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787560540.724203:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec38eb100 x1874392862765568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560556 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560540.724222:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec38eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862765568:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787560540.730287:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862765696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787560540.730359:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560540.730463:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862765696 00000100:00100000:0.0:1787560540.730472:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862765696 00000100:00100000:0.0:1787560540.730524:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787560540.732653:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec32c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862765696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787560540.732684:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560540.732764:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec32c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862765696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (2404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560540.732772:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1787560540.732808:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787560540.732840:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec32c6680 x1874392862765696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560556 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560540.732872:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862765696:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787560541.172220:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560541.182774:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560541.182820:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560541.182856:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560541.182931:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853259648 00000100:00100000:2.0:1787560541.182941:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853259648 00000100:00100000:3.0:1787560541.183354:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853259520 00000100:00100000:3.0:1787560541.183360:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853259520 00000100:00100000:3.0:1787560541.183488:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 282 00000100:00100000:3.0:1787560541.183501:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd8e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+10:2402:x1874392853259520:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560541.183613:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd8e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+10:2402:x1874392853259520:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 115us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560541.183621:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 282 00000100:00080000:0.0:1787560541.184296:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560541.184300:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853259776 00000100:00100000:2.0:1787560541.184306:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853259776 00000100:00080000:0.0:1787560541.184320:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787560541.184333:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 100 00000100:00100000:2.0:1787560541.184342:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec32c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:2403:x1874392853259648:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560541.184398:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec32c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:2403:x1874392853259648:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 58us (1578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560541.184405:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 100 00000100:00100000:3.0:1787560541.184410:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 101 00000100:00100000:3.0:1787560541.184419:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec32c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:2402:x1874392853259776:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560541.184461:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec32c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:2402:x1874392853259776:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 44us (1604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560541.184468:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 101 00000100:00100000:0.0:1787560541.748188:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffb884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862766208:0@lo:400:kworker.0 00000100:00100000:0.0:1787560541.748286:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560541.748463:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862765824:0@lo:400:kworker.0 00000100:00100000:3.0:1787560541.748501:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560541.748528:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeaba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862766336:0@lo:400:kworker.0 00000100:00100000:3.0:1787560541.748570:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560541.748588:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862766848:0@lo:400:kworker.0 00000100:00100000:3.0:1787560541.748622:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560541.748651:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862767360:0@lo:400:kworker.0 00000100:00100000:3.0:1787560541.748672:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560541.748921:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862765952:0@lo:400:kworker.0 00000100:00100000:3.0:1787560541.749170:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560541.749197:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeabaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862766464:0@lo:400:kworker.0 00000100:00100000:3.0:1787560541.749223:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560541.749241:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874392862766976:0@lo:400:kworker.0 00000100:00100000:3.0:1787560541.749266:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560541.749292:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787560541.749298:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc87ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862766080:0@lo:400:kworker.0 00000100:00100000:3.0:1787560541.749326:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560541.749327:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862765824 00000100:00100000:1.0:1787560541.749338:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862765824 00000100:00100000:1.0:1787560541.749390:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787560541.749399:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd86eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3624:x1874392862765824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560541.749537:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862766208 00000100:00100000:2.0:1787560541.749542:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862766208 00000100:00100000:2.0:1787560541.749567:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862765952 00000100:00100000:2.0:1787560541.749570:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862765952 00000100:00100000:2.0:1787560541.749592:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862766464 00000100:00100000:2.0:1787560541.749604:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862766464 00000100:00100000:2.0:1787560541.749629:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862766976 00000100:00100000:2.0:1787560541.749641:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862766976 00000100:00100000:2.0:1787560541.749660:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787560541.749667:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862766208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560541.749924:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862766720:0@lo:400:kworker.0 00000100:00100000:3.0:1787560541.750479:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeaba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862766592:0@lo:400:kworker.0 00000100:00100000:2.0:1787560541.759647:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862766208:12345-0@lo:400:kworker.0 Request processed in 9961us (11341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560541.759662:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787560541.759697:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787560541.759920:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560541.759946:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874392862767104:0@lo:400:kworker.0 00000100:00100000:3.0:1787560541.759974:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560541.760009:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862766336 00000100:00100000:3.0:1787560541.760017:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862766336 00000100:00100000:3.0:1787560541.760055:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862766080 00000100:00100000:3.0:1787560541.760058:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862766080 00000100:00100000:3.0:1787560541.760071:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787560541.760077:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862766336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560541.760129:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862766336:12345-0@lo:400:kworker.0 Request processed in 52us (11558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560541.760135:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787560541.760147:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787560541.760153:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862766080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560541.760186:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862766080:12345-0@lo:400:kworker.0 Request processed in 33us (10860us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560541.760206:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787560541.760226:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862766848 00000100:00100000:3.0:1787560541.760230:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862766848 00000100:00100000:3.0:1787560541.760253:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862767360 00000100:00100000:3.0:1787560541.760257:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862767360 00000100:00100000:3.0:1787560541.760278:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787560541.760284:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862766848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560541.760453:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862766848:12345-0@lo:400:kworker.0 Request processed in 168us (11829us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560541.760461:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787560541.760472:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd86eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3624:x1874392862765824:12345-0@lo:400:kworker.0 Request processed in 11071us (11967us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560541.760477:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787560541.760490:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862767360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560541.760491:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1787560541.760533:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862767360:12345-0@lo:400:kworker.0 Request processed in 46us (11859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560541.760539:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787560541.760562:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862766592 00000100:00100000:3.0:1787560541.760566:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862766592 00000100:00100000:3.0:1787560541.760583:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862767104 00000100:00100000:3.0:1787560541.760586:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862767104 00000100:00100000:3.0:1787560541.760610:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787560541.760617:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862766464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560541.760655:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862766464:12345-0@lo:400:kworker.0 Request processed in 39us (11432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560541.760662:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787560541.760674:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787560541.760680:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874392862766976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560541.760721:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874392862766976:12345-0@lo:400:kworker.0 Request processed in 41us (11454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560541.760727:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787560541.760739:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787560541.760744:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862766592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560541.760773:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862766592:12345-0@lo:400:kworker.0 Request processed in 29us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560541.760779:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787560541.760789:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787560541.760795:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874392862767104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560541.760819:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874392862767104:12345-0@lo:400:kworker.0 Request processed in 25us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560541.760825:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787560541.760879:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862765824:0@lo:400:kworker.0 00000100:00100000:3.0:1787560541.760893:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeaba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862766336:0@lo:400:kworker.0 00010000:00080000:3.0:1787560541.760906:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cafeab10000 x1874392862766848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560541.760917:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862766848:0@lo:400:kworker.0 00010000:00080000:3.0:1787560541.760926:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2f44700 x1874392862767360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560541.760933:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862767360:0@lo:400:kworker.0 00000100:00100000:3.0:1787560541.760973:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc87ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862766080:0@lo:400:kworker.0 00010000:00080000:3.0:1787560541.760984:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cafeaba8700 x1874392862766592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560541.761000:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeaba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862766592:0@lo:400:kworker.0 00010000:00080000:3.0:1787560541.761011:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cafeab12680 x1874392862767104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560541.761019:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874392862767104:0@lo:400:kworker.0 00000100:00100000:3.0:1787560541.761029:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeabaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862766464:0@lo:400:kworker.0 00000100:00100000:3.0:1787560541.761037:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874392862766976:0@lo:400:kworker.0 00000100:00100000:3.0:1787560541.761113:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862767488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787560541.761141:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560541.761173:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862767488 00000100:00100000:3.0:1787560541.761176:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862767488 00000100:00100000:2.0:1787560541.762591:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862765952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560541.762685:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862765952:12345-0@lo:400:kworker.0 Request processed in 2980us (13733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560541.762693:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1787560541.762723:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787560541.762728:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787560541.762730:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560541.762770:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862765952:0@lo:400:kworker.0 00000100:00100000:3.0:1787560541.762971:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787560541.762982:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862767488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787560541.763002:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787560541.763042:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862767488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (1900us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560541.763049:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787560541.764186:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862767616:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560541.764235:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560541.764279:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862767616 00000100:00100000:0.0:1787560541.764285:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862767616 00000100:00100000:0.0:1787560541.764333:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787560541.764449:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862767616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787560541.764466:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560541.764503:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862767616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 163us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560541.764509:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1787560541.764542:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2f45f80 x1874392862767616/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560557 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560541.764558:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862767616:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560541.764588:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560541.764623:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862767232:0@lo:400:kworker.0 00000100:00100000:0.0:1787560541.766413:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560541.766477:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862766720 00000100:00100000:0.0:1787560541.766484:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862766720 00000100:00100000:0.0:1787560541.766524:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862767232 00000100:00100000:0.0:1787560541.766528:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862767232 00000100:00100000:0.0:1787560541.766547:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787560541.766556:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862766720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560541.766614:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862766720:12345-0@lo:400:kworker.0 Request processed in 60us (2025us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560541.766621:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787560541.766647:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787560541.766654:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862767232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560541.766683:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862767232:12345-0@lo:400:kworker.0 Request processed in 29us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560541.766689:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1787560541.768334:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2f45180 x1874392862767232/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560541.768367:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862767232:0@lo:400:kworker.0 00000100:00100000:0.0:1787560541.768409:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffb884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862766208:0@lo:400:kworker.0 00010000:00080000:0.0:1787560541.768422:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cafeab10e00 x1874392862766720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560541.768455:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862766720:0@lo:400:kworker.0 00000100:00080000:2.0:1787560541.768657:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787560541.768685:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2ccdc00 x1874392862767488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560557 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560541.768703:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862767488:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787560542.195665:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560543.239057:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560543.284204:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787560543.284228:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862767744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787560543.284340:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560543.284412:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862767744 00000100:00100000:3.0:1787560543.284420:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862767744 00000100:00100000:3.0:1787560543.284493:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787560543.284535:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862767744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787560543.284568:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787560543.284622:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862767744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560543.284629:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787560543.284677:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862767744:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787560544.244161:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560544.315356:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560544.315423:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862767872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787560544.315517:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560544.316793:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862767872 00000100:00100000:0.0:1787560544.316805:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862767872 00000100:00100000:0.0:1787560544.316901:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787560544.316911:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862767872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787560544.316945:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787560544.317009:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862767872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (1491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560544.317017:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787560544.327985:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862767872:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787560545.268602:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560545.845968:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862768000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787560545.846081:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560545.846206:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787560545.846213:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862768128:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787560545.846237:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560545.846385:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862768000 00000100:00100000:0.0:1787560545.846395:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862768000 00000100:00100000:0.0:1787560545.846481:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862768128 00000100:00100000:0.0:1787560545.846485:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862768128 00000100:00100000:0.0:1787560545.846502:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787560545.846510:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862768000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787560545.846538:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560545.846593:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862768000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560545.846599:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787560545.846615:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787560545.846621:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc87ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862768128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787560545.846631:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560545.846654:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc87ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862768128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 33us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560545.846659:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1787560545.849576:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787560545.850987:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2ccdc00 x1874392862768128/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560545.851012:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862768128:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1787560545.851028:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2f45180 x1874392862768000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560545.851102:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862768000:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787560546.291590:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560546.306701:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560546.306772:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560546.306806:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560546.306916:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853260160 00000100:00100000:0.0:1787560546.306926:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853260160 00000100:00100000:0.0:1787560546.307254:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853260032 00000100:00100000:0.0:1787560546.307258:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853260032 00000100:00100000:0.0:1787560546.307284:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 108 00000100:00100000:0.0:1787560546.307293:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:2405:x1874392853260160:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560546.307364:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:2405:x1874392853260160:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 72us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560546.307371:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 108 00000100:00100000:0.0:1787560546.307388:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 109 00000100:00100000:0.0:1787560546.307394:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+6:2405:x1874392853260032:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560546.307418:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+6:2405:x1874392853260032:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 24us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560546.307424:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 109 00000100:00080000:0.0:1787560546.307462:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787560546.307465:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787560546.308149:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853259904 00000100:00100000:1.0:1787560546.308155:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853259904 00000100:00100000:1.0:1787560546.308195:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 284 00000100:00100000:1.0:1787560546.308202:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd86e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+10:2405:x1874392853259904:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560546.308390:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd86e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+10:2405:x1874392853259904:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 187us (1700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560546.308399:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 284 00000100:00100000:1.0:1787560546.869864:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787560546.869890:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3240700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862768256:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787560546.869958:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560546.870027:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862768256 00000100:00100000:1.0:1787560546.870035:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862768256 00000100:00100000:1.0:1787560546.870094:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787560546.870105:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862768256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787560546.870137:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787560546.870187:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862768256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560546.870193:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1787560546.870214:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787560546.870243:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3240700 x1874392862768256/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560562 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560546.870260:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3240700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862768256:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787560546.870711:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862768768:0@lo:400:kworker.0 00000100:00100000:2.0:1787560546.870745:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560546.870769:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862769280:0@lo:400:kworker.0 00000100:00100000:2.0:1787560546.870791:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560546.870808:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862769792:0@lo:400:kworker.0 00000100:00100000:2.0:1787560546.870827:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560546.871035:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862768640:0@lo:400:kworker.0 00000100:00100000:1.0:1787560546.871073:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560546.871095:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874392862769152:0@lo:400:kworker.0 00000100:00100000:1.0:1787560546.871116:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560546.871132:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862769664:0@lo:400:kworker.0 00000100:00100000:1.0:1787560546.871151:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560546.871170:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787560546.871175:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862768512:0@lo:400:kworker.0 00000100:00100000:1.0:1787560546.871194:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560546.871211:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862769024:0@lo:400:kworker.0 00000100:00100000:1.0:1787560546.871231:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560546.871242:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862769536:0@lo:400:kworker.0 00000100:00100000:1.0:1787560546.871259:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560546.871403:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862768640 00000100:00100000:1.0:1787560546.871409:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862768640 00000100:00100000:1.0:1787560546.871461:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787560546.871470:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862768640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560546.871527:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862768640:12345-0@lo:400:kworker.0 Request processed in 58us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560546.871533:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787560546.871555:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862768768 00000100:00100000:1.0:1787560546.871570:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862768768 00000100:00100000:1.0:1787560546.871589:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862769152 00000100:00100000:1.0:1787560546.871591:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862769152 00000100:00100000:1.0:1787560546.871610:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862769664 00000100:00100000:1.0:1787560546.871613:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862769664 00000100:00100000:1.0:1787560546.871625:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862768512 00000100:00100000:1.0:1787560546.871627:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862768512 00000100:00100000:1.0:1787560546.871645:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862769024 00000100:00100000:1.0:1787560546.871648:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862769024 00000100:00100000:1.0:1787560546.871659:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862769536 00000100:00100000:1.0:1787560546.871661:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862769536 00000100:00100000:1.0:1787560546.871690:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787560546.871697:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862768768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560546.871727:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862768768:12345-0@lo:400:kworker.0 Request processed in 31us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560546.871734:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787560546.871745:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787560546.871751:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874392862769152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560546.871775:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874392862769152:12345-0@lo:400:kworker.0 Request processed in 24us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560546.871781:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787560546.871791:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787560546.871797:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874392862769664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560546.871821:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874392862769664:12345-0@lo:400:kworker.0 Request processed in 24us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560546.871827:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787560546.871968:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787560546.871975:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862768512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560546.872004:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862768512:12345-0@lo:400:kworker.0 Request processed in 30us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560546.872011:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787560546.872021:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787560546.872027:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862769024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560546.872061:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862769024:12345-0@lo:400:kworker.0 Request processed in 35us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560546.872068:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787560546.872079:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787560546.872085:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862769536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560546.872121:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862769536:12345-0@lo:400:kworker.0 Request processed in 36us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560546.872128:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787560546.872265:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862768768:0@lo:400:kworker.0 00000100:00100000:2.0:1787560546.872280:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1787560546.872288:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862768384:0@lo:400:kworker.0 00000100:00100000:2.0:1787560546.872318:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560546.872343:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862768896:0@lo:400:kworker.0 00000100:00100000:2.0:1787560546.872365:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560546.872381:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862769408:0@lo:400:kworker.0 00000100:00100000:2.0:1787560546.872415:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560546.872452:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3240700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862769920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560546.872495:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560546.872529:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862769280 00000100:00100000:2.0:1787560546.872535:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862769280 00000100:00100000:2.0:1787560546.872573:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862769792 00000100:00100000:2.0:1787560546.872576:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862769792 00000100:00100000:2.0:1787560546.872591:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862769408 00000100:00100000:2.0:1787560546.872593:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862769408 00000100:00100000:2.0:1787560546.872604:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787560546.872609:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3851f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862769280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560546.872644:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3851f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862769280:12345-0@lo:400:kworker.0 Request processed in 35us (1852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560546.872650:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787560546.872661:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787560546.872666:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862769792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560546.872689:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862769792:12345-0@lo:400:kworker.0 Request processed in 24us (1863us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560546.872694:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787560546.872702:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787560546.872707:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862769408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560546.872727:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862769408:12345-0@lo:400:kworker.0 Request processed in 20us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560546.872732:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787560546.872748:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862768896 00000100:00100000:2.0:1787560546.872751:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862768896 00000100:00100000:2.0:1787560546.872771:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787560546.872778:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862768896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560546.872807:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862768896:12345-0@lo:400:kworker.0 Request processed in 30us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560546.872820:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787560546.872972:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862769920 00000100:00100000:2.0:1787560546.872977:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862769920 00000100:00100000:2.0:1787560546.873002:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787560546.873008:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862769920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787560546.873022:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560546.873052:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862769920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560546.873058:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787560546.873085:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862768896:0@lo:400:kworker.0 00010000:00080000:2.0:1787560546.873096:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3852300 x1874392862769408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560546.873105:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862769408:0@lo:400:kworker.0 00010000:00080000:2.0:1787560546.873114:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3240700 x1874392862769920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560562 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560546.873127:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3240700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862769920:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787560546.873136:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3853800 x1874392862769280/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560546.873144:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862769280:0@lo:400:kworker.0 00010000:00080000:2.0:1787560546.873152:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3852680 x1874392862769792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560546.873159:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862769792:0@lo:400:kworker.0 00000100:00080000:2.0:1787560546.875530:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787560546.875569:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787560546.875573:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787560546.875632:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862768512:0@lo:400:kworker.0 00000100:00100000:2.0:1787560546.875649:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862769024:0@lo:400:kworker.0 00000100:00100000:2.0:1787560546.875661:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862769536:0@lo:400:kworker.0 00000100:00100000:2.0:1787560546.875674:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862768640:0@lo:400:kworker.0 00010000:00080000:2.0:1787560546.875689:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3851880 x1874392862769152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560546.875701:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874392862769152:0@lo:400:kworker.0 00010000:00080000:2.0:1787560546.875712:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3853480 x1874392862769664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560546.875721:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862769664:0@lo:400:kworker.0 00000100:00100000:1.0:1787560546.877456:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862768384 00000100:00100000:1.0:1787560546.877472:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862768384 00000100:00100000:1.0:1787560546.878999:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1787560546.879013:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd86e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3623:x1874392862768384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560546.879115:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd86e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3623:x1874392862768384:12345-0@lo:400:kworker.0 Request processed in 105us (6796us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560546.879123:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1787560546.879188:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862768384:0@lo:400:kworker.0 00010000:00010000:1.0:1787560547.315738:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560548.339607:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560548.403908:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787560548.403933:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862770048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787560548.404008:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560548.404349:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862770048 00000100:00100000:3.0:1787560548.404357:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862770048 00000100:00100000:3.0:1787560548.404410:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787560548.404419:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862770048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787560548.404621:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787560548.404684:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862770048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 266us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560548.404707:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787560548.404834:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862770048:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787560549.378225:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560549.429071:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787560549.429097:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffb884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862770176:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787560549.429176:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560549.429242:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862770176 00000100:00100000:0.0:1787560549.429251:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862770176 00000100:00100000:0.0:1787560549.429297:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787560549.429306:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862770176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787560549.429338:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787560549.429383:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862770176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560549.429399:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787560549.430043:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffb884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862770176:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787560550.388042:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560550.964580:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862770304:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787560550.964654:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560550.964726:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862770304 00000100:00100000:3.0:1787560550.964734:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862770304 00000100:00100000:3.0:1787560550.964786:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787560550.964796:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862770304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787560550.964829:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787560550.964887:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862770304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560550.964894:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1787560550.964935:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2ccdc00 x1874392862770304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560566 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560550.964951:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862770304:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787560550.965357:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787560550.965366:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862770432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787560550.965408:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560550.965554:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862770432 00000100:00100000:1.0:1787560550.965560:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862770432 00000100:00100000:1.0:1787560550.965597:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787560550.965605:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862770432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787560550.965617:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787560550.965650:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862770432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560550.965656:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1787560550.965979:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3242300 x1874392862770432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560566 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560550.965996:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862770432:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787560550.967519:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787560551.415019:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560551.426264:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560551.426315:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560551.426351:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560551.426609:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853260288 00000100:00100000:1.0:1787560551.426620:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853260288 00000100:00100000:3.0:1787560551.426624:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853260544 00000100:00100000:3.0:1787560551.426627:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853260544 00000100:00100000:3.0:1787560551.426671:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853260416 00000100:00100000:1.0:1787560551.426672:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 286 00000100:00100000:3.0:1787560551.426673:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853260416 00000100:00100000:1.0:1787560551.426682:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+10:2404:x1874392853260288:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560551.426694:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 116 00000100:00100000:3.0:1787560551.426714:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+5:2404:x1874392853260544:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560551.426750:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+10:2404:x1874392853260288:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 69us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560551.426762:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 286 00000100:00080000:0.0:1787560551.426780:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787560551.426784:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787560551.426890:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 117 00000100:00100000:2.0:1787560551.426900:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+6:2404:x1874392853260416:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560551.427708:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+5:2404:x1874392853260544:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 982us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560551.427717:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 116 00000100:00100000:2.0:1787560551.432450:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+6:2404:x1874392853260416:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 5527us (6072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560551.432467:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 117 00000100:00100000:2.0:1787560551.987885:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862770560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560551.987957:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560551.988043:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787560551.988049:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862770688:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787560551.988070:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560551.988146:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862770560 00000100:00100000:0.0:1787560551.988153:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862770560 00000100:00100000:0.0:1787560551.988202:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862770688 00000100:00100000:0.0:1787560551.988205:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862770688 00000100:00100000:0.0:1787560551.988220:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787560551.988228:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862770560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787560551.988254:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560551.988294:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862770560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560551.988301:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787560551.988316:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787560551.988321:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862770688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787560551.988329:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560551.988346:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862770688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 25us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560551.988351:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1787560551.988378:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec33c1c00 x1874392862770688/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560567 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560551.988406:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862770688:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1787560551.988417:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3242300 x1874392862770560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560567 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560551.988426:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862770560:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787560551.988511:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787560551.988714:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862770944:0@lo:400:kworker.0 00000100:00100000:3.0:1787560551.988745:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560551.988762:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeaba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862771456:0@lo:400:kworker.0 00000100:00100000:3.0:1787560551.988776:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560551.988790:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874392862771968:0@lo:400:kworker.0 00000100:00100000:3.0:1787560551.988806:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560551.988822:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787560551.988827:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862770816:0@lo:400:kworker.0 00000100:00100000:3.0:1787560551.988850:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560551.988868:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeaba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862771328:0@lo:400:kworker.0 00000100:00100000:3.0:1787560551.988888:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560551.988906:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862771840:0@lo:400:kworker.0 00000100:00100000:3.0:1787560551.988926:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560551.988951:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862771328 00000100:00100000:3.0:1787560551.988955:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862771328 00000100:00100000:3.0:1787560551.988985:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787560551.988991:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862771328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560551.989030:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862771328:12345-0@lo:400:kworker.0 Request processed in 39us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560551.989037:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787560551.989064:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862771840 00000100:00100000:3.0:1787560551.989068:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862771840 00000100:00100000:3.0:1787560551.989092:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787560551.989099:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862771840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560551.989128:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862771840:12345-0@lo:400:kworker.0 Request processed in 30us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560551.989134:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787560551.989153:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeabaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874392862771200:0@lo:400:kworker.0 00000100:00100000:3.0:1787560551.989176:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560551.989191:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862771712:0@lo:400:kworker.0 00000100:00100000:3.0:1787560551.989206:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560551.989223:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787560551.989228:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862771072:0@lo:400:kworker.0 00000100:00100000:3.0:1787560551.989248:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560551.989261:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874392862771584:0@lo:400:kworker.0 00000100:00100000:3.0:1787560551.989277:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560551.989287:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862772096:0@lo:400:kworker.0 00000100:00100000:3.0:1787560551.989304:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560551.989321:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862771712 00000100:00100000:3.0:1787560551.989325:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862771712 00000100:00100000:3.0:1787560551.989348:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787560551.989354:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862771712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560551.989384:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862771712:12345-0@lo:400:kworker.0 Request processed in 30us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560551.989390:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787560551.989409:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862770944 00000100:00100000:3.0:1787560551.989417:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862770944 00000100:00100000:3.0:1787560551.989460:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862771456 00000100:00100000:3.0:1787560551.989463:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862771456 00000100:00100000:3.0:1787560551.989485:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862771968 00000100:00100000:3.0:1787560551.989488:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862771968 00000100:00100000:3.0:1787560551.989499:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862771200 00000100:00100000:3.0:1787560551.989501:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862771200 00000100:00100000:3.0:1787560551.989510:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862771584 00000100:00100000:3.0:1787560551.989512:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862771584 00000100:00100000:3.0:1787560551.989535:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862772096 00000100:00100000:3.0:1787560551.989538:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862772096 00000100:00100000:3.0:1787560551.989552:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787560551.989558:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862770944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560551.989587:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862770944:12345-0@lo:400:kworker.0 Request processed in 29us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560551.989592:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787560551.989604:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787560551.989609:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862771456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560551.989632:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862771456:12345-0@lo:400:kworker.0 Request processed in 24us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560551.989637:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787560551.989646:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787560551.989650:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874392862771968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560551.989672:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874392862771968:12345-0@lo:400:kworker.0 Request processed in 22us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560551.989677:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787560551.989685:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787560551.989689:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874392862771200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560551.989722:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874392862771200:12345-0@lo:400:kworker.0 Request processed in 33us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560551.989727:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787560551.989737:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787560551.989743:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874392862771584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560551.989765:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874392862771584:12345-0@lo:400:kworker.0 Request processed in 23us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560551.989770:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787560551.989780:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787560551.989786:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874392862772096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560551.989822:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874392862772096:12345-0@lo:400:kworker.0 Request processed in 37us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560551.989828:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:3.0:1787560551.989843:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787560551.989846:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787560551.989869:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec32c4380 x1874392862771584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560551.989881:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874392862771584:0@lo:400:kworker.0 00010000:00080000:3.0:1787560551.989892:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcb09500 x1874392862772096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560551.989900:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862772096:0@lo:400:kworker.0 00000100:00100000:3.0:1787560551.989910:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeabaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874392862771200:0@lo:400:kworker.0 00010000:00080000:3.0:1787560551.989919:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec32c7b80 x1874392862771712/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560551.989938:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862771712:0@lo:400:kworker.0 00000100:00100000:3.0:1787560551.989976:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeaba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862771328:0@lo:400:kworker.0 00010000:00080000:3.0:1787560551.989986:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcb0aa00 x1874392862771840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560551.989994:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862771840:0@lo:400:kworker.0 00000100:00100000:3.0:1787560551.990003:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862770944:0@lo:400:kworker.0 00000100:00100000:3.0:1787560551.990010:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeaba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862771456:0@lo:400:kworker.0 00000100:00100000:3.0:1787560551.990018:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874392862771968:0@lo:400:kworker.0 00000100:00100000:0.0:1787560551.990372:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862771072 00000100:00100000:0.0:1787560551.990378:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862771072 00000100:00100000:0.0:1787560551.990414:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787560551.990421:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862771072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560551.990492:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862771072:12345-0@lo:400:kworker.0 Request processed in 71us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560551.990497:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787560551.990534:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862771072:0@lo:400:kworker.0 00000100:00100000:1.0:1787560551.990824:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862770816 00000100:00100000:1.0:1787560551.990829:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862770816 00000100:00100000:1.0:1787560551.990868:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1787560551.990876:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3624:x1874392862770816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560551.990923:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3624:x1874392862770816:12345-0@lo:400:kworker.0 Request processed in 48us (2071us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560551.990929:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787560551.991018:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862770816:0@lo:400:kworker.0 00010000:00010000:2.0:1787560552.435774:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560553.461060:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560553.531564:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff48fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862772224:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787560553.531636:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560553.531718:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862772224 00000100:00100000:2.0:1787560553.531725:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862772224 00000100:00100000:2.0:1787560553.531777:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787560553.531787:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862772224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787560553.531818:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787560553.531879:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862772224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560553.531887:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787560553.531933:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff48fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862772224:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1787560553.655949:0:11975:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 04:35:51 (1787560551) === 00000100:00100000:0.0:1787560554.064356:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560554.069042:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853260672 00000100:00100000:1.0:1787560554.069058:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853260672 00000100:00100000:1.0:1787560554.069140:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 288 00000100:00100000:1.0:1787560554.069152:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+10:8725:x1874392853260672:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787560554.069170:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560554.069188:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffcbffa00/0x4642c20bf2f33d9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fb5d expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560554.069217:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffcbffa00/0x4642c20bf2f33d9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb5d expref: 11 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560554.069228:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffcbffa00/0x4642c20bf2f33d9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb5d expref: 11 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560554.069252:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbffa00, rc 0) 00000100:00100000:1.0:1787560554.069326:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+11:8725:x1874392853260672:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 175us (4980us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560554.069333:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 288 00000100:00100000:2.0:1787560554.085801:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560554.086274:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853260800 00000100:00100000:0.0:1787560554.086285:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853260800 00000100:00100000:0.0:1787560554.086346:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 289 00000100:00100000:0.0:1787560554.086356:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+11:8725:x1874392853260800:12345-192.168.203.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787560554.086571:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+11:8725:x1874392853260800:12345-192.168.203.29@tcp:501:mount.lustre.0 Request processed in 215us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560554.086579:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 289 00000100:00100000:2.0:1787560554.088719:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560554.090011:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853260928 00000100:00100000:1.0:1787560554.090022:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853260928 00000100:00100000:1.0:1787560554.090077:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 290 00000100:00100000:1.0:1787560554.090088:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+11:8725:x1874392853260928:12345-192.168.203.29@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787560554.090241:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+11:8725:x1874392853260928:12345-192.168.203.29@tcp:503:mount.lustre.0 Request processed in 153us (1529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560554.090249:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 290 00000100:00100000:3.0:1787560554.112489:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560554.124563:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853261056 00000100:00100000:2.0:1787560554.124586:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853261056 00000100:00100000:2.0:1787560554.124697:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 291 00000100:00100000:2.0:1787560554.124712:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+11:8729:x1874392853261056:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787560554.124968:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+11:8729:x1874392853261056:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 258us (12493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560554.124978:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 291 00000100:00100000:3.0:1787560554.160905:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560554.161054:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853261184 00000100:00100000:2.0:1787560554.161069:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853261184 00000100:00100000:2.0:1787560554.161149:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 292 00000100:00100000:2.0:1787560554.161162:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+11:8729:x1874392853261184:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787560554.161389:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+11:8729:x1874392853261184:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 229us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560554.161399:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 292 00000100:00100000:0.0:1787560554.169998:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560554.170102:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853261312 00000100:00100000:2.0:1787560554.170118:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853261312 00000100:00100000:2.0:1787560554.170198:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 293 00000100:00100000:2.0:1787560554.170212:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+11:8729:x1874392853261312:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787560554.170480:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+11:8729:x1874392853261312:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 270us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560554.170490:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 293 00000100:00100000:3.0:1787560554.177788:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560554.177876:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853261440 00000100:00100000:1.0:1787560554.177890:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853261440 00000100:00100000:1.0:1787560554.177969:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 294 00000100:00100000:1.0:1787560554.177984:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+11:8725:x1874392853261440:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787560554.178008:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560554.178032:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffcbfea00/0x4642c20bf2f33da6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fb8e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560554.178069:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffcbfea00/0x4642c20bf2f33da6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb8e expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560554.178080:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffcbfea00/0x4642c20bf2f33da6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb8e expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560554.178090:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbfea00, rc 0) 00000100:00100000:1.0:1787560554.178185:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+12:8725:x1874392853261440:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 204us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560554.178193:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 294 00000100:00100000:3.0:1787560554.196758:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560554.196971:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853261568 00000100:00100000:0.0:1787560554.196985:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853261568 00000100:00100000:0.0:1787560554.197062:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 295 00000100:00100000:0.0:1787560554.197096:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+12:8725:x1874392853261568:12345-192.168.203.29@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787560554.197138:0:6493:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787560554.197161:0:6493:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787560554.197166:0:6493:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787560554.197169:0:6493:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787560554.197172:0:6493:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787560554.197175:0:6493:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1787560554.202561:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+12:8725:x1874392853261568:12345-192.168.203.29@tcp:256:mount.lustre.0 Request processed in 5450us (5801us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560554.202580:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 295 00000100:00100000:2.0:1787560554.209237:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560554.209486:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853261696 00000100:00100000:1.0:1787560554.209500:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853261696 00000100:00100000:1.0:1787560554.209614:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 296 00000100:00100000:1.0:1787560554.209628:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+12:8725:x1874392853261696:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787560554.209653:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560554.209678:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffcbff800/0x4642c20bf2f33dad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fb95 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560554.209717:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffcbff800/0x4642c20bf2f33dad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb95 expref: 13 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560554.209731:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffcbff800/0x4642c20bf2f33dad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb95 expref: 13 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560554.209742:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbff800, rc 0) 00000100:00100000:1.0:1787560554.209840:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+13:8725:x1874392853261696:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 215us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560554.209847:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 296 00000100:00100000:3.0:1787560554.214641:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560554.216902:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853261824 00000100:00100000:1.0:1787560554.216923:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853261824 00000100:00100000:1.0:1787560554.217003:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 297 00000100:00100000:1.0:1787560554.217014:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+13:8725:x1874392853261824:12345-192.168.203.29@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787560554.217211:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+13:8725:x1874392853261824:12345-192.168.203.29@tcp:501:mount.lustre.0 Request processed in 197us (2583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560554.217240:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 297 00000100:00100000:0.0:1787560554.221286:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560554.221483:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853261952 00000100:00100000:2.0:1787560554.221497:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853261952 00000100:00100000:2.0:1787560554.221585:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 298 00000100:00100000:2.0:1787560554.221599:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+13:8725:x1874392853261952:12345-192.168.203.29@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787560554.221811:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+13:8725:x1874392853261952:12345-192.168.203.29@tcp:503:mount.lustre.0 Request processed in 214us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560554.221819:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 298 00000100:00100000:0.0:1787560554.235185:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560554.235648:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853262080 00000100:00100000:2.0:1787560554.235666:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853262080 00000100:00100000:2.0:1787560554.235756:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 299 00000100:00100000:2.0:1787560554.235772:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+13:8734:x1874392853262080:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787560554.236071:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+13:8734:x1874392853262080:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 302us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560554.236081:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 299 00000100:00100000:3.0:1787560554.245078:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560554.245270:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853262208 00000100:00100000:1.0:1787560554.245284:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853262208 00000100:00100000:1.0:1787560554.245351:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 300 00000100:00100000:1.0:1787560554.245364:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+13:8734:x1874392853262208:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787560554.246825:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+13:8734:x1874392853262208:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 1452us (1751us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560554.246839:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 300 00000100:00100000:1.0:1787560554.253271:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560554.253312:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560554.253503:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560554.253805:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560554.253829:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853262464 00000100:00100000:0.0:1787560554.253842:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853262464 00000100:00100000:3.0:1787560554.253936:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853262592 00000100:00100000:3.0:1787560554.253942:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853262592 00000100:00100000:2.0:1787560554.254912:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853262336 00000100:00100000:2.0:1787560554.254924:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853262336 00000100:00100000:2.0:1787560554.255035:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 124 00000100:00100000:2.0:1787560554.255051:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+6:2405:x1874392853262464:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560554.255158:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+6:2405:x1874392853262464:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 112us (1901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560554.255167:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 124 00000100:00100000:2.0:1787560554.255187:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 125 00000100:00100000:2.0:1787560554.255196:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+5:2405:x1874392853262592:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560554.255223:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+5:2405:x1874392853262592:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 30us (1910us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560554.255229:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 125 00000100:00100000:0.0:1787560554.255538:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853262848 00000100:00100000:0.0:1787560554.255544:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853262848 00000100:00100000:0.0:1787560554.256148:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:0.0:1787560554.256157:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1874392853262336:12345-192.168.203.29@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787560554.256190:0:6498:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8@192.168.203.29@tcp t0 exp 0000000000000000 cur 273 last 0 00000020:00000080:0.0:1787560554.256241:0:6498:0:(genops.c:1385:class_connect()) connect: client 5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8, cookie 0x4642c20bf2f33db4 00000004:00100000:0.0:1787560554.256272:0:6498:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:0.0:1787560554.256602:0:6498:0:(import.c:65:import_set_state_nolock()) ffff9caec3384800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787560554.256691:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+6:2401:x1874392853262336:12345-192.168.203.29@tcp:38:mount.lustre.0 Request processed in 532us (3187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560554.256702:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:0.0:1787560554.256738:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:0.0:1787560554.256745:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1874392853262848:12345-192.168.203.29@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787560554.256783:0:6498:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8@192.168.203.29@tcp t0 exp 0000000000000000 cur 273 last 0 00000020:00000080:0.0:1787560554.256813:0:6498:0:(genops.c:1385:class_connect()) connect: client 5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8, cookie 0x4642c20bf2f33dbb 00000004:00100000:0.0:1787560554.256836:0:6498:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000100:00080000:0.0:1787560554.256895:0:6498:0:(import.c:65:import_set_state_nolock()) ffff9caec3386800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787560554.256932:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+6:2401:x1874392853262848:12345-192.168.203.29@tcp:38:mount.lustre.0 Request processed in 187us (3128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560554.256939:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00080000:0.0:1787560554.256963:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787560554.256968:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560554.266842:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560554.266904:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560554.267010:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560554.267108:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853263104 00000100:00100000:0.0:1787560554.267131:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853263104 00000100:00100000:0.0:1787560554.267219:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853262720 00000100:00100000:0.0:1787560554.267223:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853262720 00000100:00100000:0.0:1787560554.267233:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853262976 00000100:00100000:0.0:1787560554.267236:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853262976 00000100:00100000:0.0:1787560554.267261:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:0.0:1787560554.267272:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2351f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+7:8725:x1874392853263104:12345-192.168.203.29@tcp:41:mount.lustre.0 00000100:00100000:2.0:1787560554.267306:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 19 00000004:00000024:0.0:1787560554.267311:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787560554.267328:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2350e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+7:0:x1874392853262720:12345-192.168.203.29@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787560554.267362:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787560554.267422:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2351f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+7:8725:x1874392853263104:12345-192.168.203.29@tcp:41:mount.lustre.0 Request processed in 150us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560554.267472:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2350e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+7:0:x1874392853262720:12345-192.168.203.29@tcp:41:mount.lustre.0 Request processed in 108us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560554.267483:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:0.0:1787560554.267518:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:0.0:1787560554.267533:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+6:0:x1874392853262976:12345-192.168.203.29@tcp:41:mount.lustre.0 00000100:00080000:1.0:1787560554.267564:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787560554.267570:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1787560554.267591:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787560554.267636:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+6:0:x1874392853262976:12345-192.168.203.29@tcp:41:mount.lustre.0 Request processed in 110us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560554.274366:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:0.0:1787560554.277006:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:3.0:1787560554.277069:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560554.277838:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853263232 00000100:00100000:2.0:1787560554.277853:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853263232 00000100:00100000:2.0:1787560554.277929:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:2.0:1787560554.277941:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+6:8725:x1874392853263232:12345-192.168.203.29@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787560554.278063:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+6:8725:x1874392853263232:12345-192.168.203.29@tcp:40:mount.lustre.0 Request processed in 124us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560554.278071:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:1.0:1787560554.280342:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560554.280708:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853263616 00000100:00100000:2.0:1787560554.280720:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853263616 00000100:00100000:3.0:1787560554.281089:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560554.281185:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560554.281214:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853263360 00000100:00100000:3.0:1787560554.281218:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853263360 00000100:00100000:3.0:1787560554.281263:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853263488 00000100:00100000:3.0:1787560554.281266:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853263488 00000100:00100000:3.0:1787560554.281286:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:3.0:1787560554.281296:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1874392853263360:12345-192.168.203.29@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787560554.281340:0:8414:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8@192.168.203.29@tcp t0 exp 0000000000000000 cur 273 last 0 00000020:00000080:3.0:1787560554.281393:0:8414:0:(genops.c:1385:class_connect()) connect: client 5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8, cookie 0x4642c20bf2f33dc2 00002000:00100000:3.0:1787560554.281408:0:8414:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8/ffff9caec2f99000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787560554.281473:0:8414:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:3.0:1787560554.281588:0:8414:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787560554.281624:0:8414:0:(import.c:65:import_set_state_nolock()) ffff9caec2f9f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787560554.281702:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+6:2401:x1874392853263360:12345-192.168.203.29@tcp:8:mount.lustre.0 Request processed in 405us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560554.281711:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:3.0:1787560554.281730:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:3.0:1787560554.281735:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1874392853263488:12345-192.168.203.29@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787560554.281753:0:8414:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8@192.168.203.29@tcp t0 exp 0000000000000000 cur 273 last 0 00000020:00000080:3.0:1787560554.281771:0:8414:0:(genops.c:1385:class_connect()) connect: client 5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8, cookie 0x4642c20bf2f33dc9 00002000:00100000:3.0:1787560554.281777:0:8414:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8/ffff9caec2f9e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787560554.281801:0:8414:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:3.0:1787560554.281850:0:8414:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787560554.281868:0:8414:0:(import.c:65:import_set_state_nolock()) ffff9caec2f98800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787560554.281895:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+6:2401:x1874392853263488:12345-192.168.203.29@tcp:8:mount.lustre.0 Request processed in 157us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560554.281902:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:2.0:1787560554.283034:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:2.0:1787560554.283056:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+6:8725:x1874392853263616:12345-192.168.203.29@tcp:900:mount.lustre.0 00000100:00100000:2.0:1787560554.283139:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+6:8725:x1874392853263616:12345-192.168.203.29@tcp:900:mount.lustre.0 Request processed in 91us (2811us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560554.283146:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:3.0:1787560554.287193:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560554.287310:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853263744 00000100:00100000:1.0:1787560554.287324:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853263744 00000100:00100000:1.0:1787560554.287632:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:1.0:1787560554.287646:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+6:8725:x1874392853263744:12345-192.168.203.29@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787560554.287764:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787560554.287924:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+6:8725:x1874392853263744:12345-192.168.203.29@tcp:33:mount.lustre.0 Request processed in 281us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560554.287933:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 1 00010000:00010000:0.0:1787560554.483820:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560554.547840:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787560554.552021:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862772352:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787560554.552131:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560554.553001:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862772352 00000100:00100000:3.0:1787560554.553016:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862772352 00000100:00100000:3.0:1787560554.553087:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787560554.553100:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862772352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787560554.553140:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787560554.553227:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862772352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560554.553235:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787560554.558714:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862772352:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787560555.508263:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560556.085812:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff48fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862772480:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787560556.085911:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560556.086048:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862772480 00000100:00100000:2.0:1787560556.086059:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862772480 00000100:00100000:2.0:1787560556.086140:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787560556.086153:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862772480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787560556.086193:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560556.086261:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862772480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560556.086284:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1787560556.086397:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787560556.086601:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caff48fa300 x1874392862772480/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560572 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560556.086623:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff48fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862772480:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787560556.086860:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862772608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560556.086896:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560556.086968:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862772608 00000100:00100000:0.0:1787560556.086973:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862772608 00000100:00100000:0.0:1787560556.087017:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787560556.087026:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862772608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787560556.087039:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560556.087078:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862772608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560556.087085:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1787560556.087113:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec33c1c00 x1874392862772608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560572 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560556.087125:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862772608:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787560556.087168:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787560556.540001:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560557.109604:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862772736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787560557.109702:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560557.109795:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862772736 00000100:00100000:0.0:1787560557.109804:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862772736 00000100:00100000:0.0:1787560557.110468:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787560557.110483:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862772736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787560557.110595:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560557.110671:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862772736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 192us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560557.110679:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1787560557.110747:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec33c1c00 x1874392862772736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560573 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560557.110772:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862772736:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787560557.113711:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787560557.113736:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff48faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862772992:0@lo:400:kworker.0 00000100:00100000:2.0:1787560557.113821:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560557.114049:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff48f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862773504:0@lo:400:kworker.0 00000100:00100000:2.0:1787560557.114083:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560557.114103:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff48fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862774016:0@lo:400:kworker.0 00000100:00100000:2.0:1787560557.114130:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560557.114160:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1787560557.114166:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff48fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862772864:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787560557.114192:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560557.114212:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff48fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862773376:0@lo:400:kworker.0 00000100:00100000:2.0:1787560557.114242:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560557.114262:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff48f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862773888:0@lo:400:kworker.0 00000100:00100000:2.0:1787560557.114288:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560557.114309:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862774400:0@lo:400:kworker.0 00000100:00100000:2.0:1787560557.114335:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560557.114375:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff48fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862773120:0@lo:400:kworker.0 00000100:00100000:2.0:1787560557.114403:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560557.114423:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff48f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862773632:0@lo:400:kworker.0 00000100:00100000:2.0:1787560557.115010:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560557.115032:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874392862774144:0@lo:400:kworker.0 00000100:00100000:2.0:1787560557.115071:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560557.115099:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787560557.115107:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff48f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862773248:0@lo:400:kworker.0 00000100:00100000:2.0:1787560557.115132:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560557.115150:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff48fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862773760:0@lo:400:kworker.0 00000100:00100000:2.0:1787560557.115173:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560557.115184:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874392862774272:0@lo:400:kworker.0 00000100:00100000:2.0:1787560557.115206:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560557.115244:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862772992 00000100:00100000:2.0:1787560557.115254:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862772992 00000100:00100000:2.0:1787560557.115311:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1787560557.115322:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3624:x1874392862772992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560557.115401:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3624:x1874392862772992:12345-0@lo:400:kworker.0 Request processed in 80us (1578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560557.115410:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1787560557.115473:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862773504 00000100:00100000:2.0:1787560557.115477:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862773504 00000100:00100000:2.0:1787560557.115512:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862773248 00000100:00100000:2.0:1787560557.115515:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862773248 00000100:00100000:0.0:1787560557.115619:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862773376 00000100:00100000:0.0:1787560557.115623:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862773376 00000100:00100000:0.0:1787560557.115651:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862773120 00000100:00100000:0.0:1787560557.115654:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862773120 00000100:00100000:0.0:1787560557.115667:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862773632 00000100:00100000:0.0:1787560557.115670:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862773632 00000100:00100000:0.0:1787560557.115693:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862774144 00000100:00100000:0.0:1787560557.115697:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862774144 00000100:00100000:0.0:1787560557.115709:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862773760 00000100:00100000:0.0:1787560557.115712:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862773760 00000100:00100000:0.0:1787560557.115724:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862774272 00000100:00100000:0.0:1787560557.115726:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862774272 00000100:00100000:0.0:1787560557.115740:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787560557.115747:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862773376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560557.115789:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862773376:12345-0@lo:400:kworker.0 Request processed in 43us (1547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560557.115796:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787560557.115810:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787560557.115816:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862773120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560557.115860:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862773120:12345-0@lo:400:kworker.0 Request processed in 44us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560557.115866:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787560557.115879:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787560557.115886:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862773632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560557.115919:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862773632:12345-0@lo:400:kworker.0 Request processed in 34us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560557.115947:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787560557.115963:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787560557.115970:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec393b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874392862774144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560557.116004:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec393b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874392862774144:12345-0@lo:400:kworker.0 Request processed in 36us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560557.116010:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787560557.116021:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787560557.116028:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec393bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862773760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560557.116054:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec393bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862773760:12345-0@lo:400:kworker.0 Request processed in 29us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560557.116059:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787560557.116069:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787560557.116074:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874392862774272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560557.116098:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874392862774272:12345-0@lo:400:kworker.0 Request processed in 24us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560557.116104:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787560557.116587:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787560557.116600:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862773504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560557.116648:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862773504:12345-0@lo:400:kworker.0 Request processed in 52us (2564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560557.116654:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787560557.116676:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787560557.116682:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862773248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560557.116713:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862773248:12345-0@lo:400:kworker.0 Request processed in 31us (1580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560557.116719:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787560557.116741:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862774016 00000100:00100000:2.0:1787560557.116748:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862774016 00000100:00100000:2.0:1787560557.116776:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862773888 00000100:00100000:2.0:1787560557.116779:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862773888 00000100:00100000:2.0:1787560557.116791:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862774400 00000100:00100000:2.0:1787560557.116794:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862774400 00000100:00100000:2.0:1787560557.116812:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787560557.116819:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862774016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560557.116985:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787560557.116996:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862773888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560557.117032:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862773888:12345-0@lo:400:kworker.0 Request processed in 40us (2744us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560557.117038:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787560557.117051:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787560557.117057:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862774400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560557.117084:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862774400:12345-0@lo:400:kworker.0 Request processed in 28us (2749us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560557.117097:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787560557.117172:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862774016:12345-0@lo:400:kworker.0 Request processed in 352us (3040us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560557.117179:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787560557.117200:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862772864 00000100:00100000:2.0:1787560557.117204:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862772864 00000100:00100000:2.0:1787560557.117234:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787560557.117241:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862772864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787560557.117258:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560557.117293:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862772864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (3100us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560557.117300:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1787560557.117848:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caff48fa680 x1874392862772864/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560573 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560557.117875:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff48fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862772864:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787560557.117908:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff48fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862773376:0@lo:400:kworker.0 00010000:00080000:2.0:1787560557.117992:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caff48f8700 x1874392862773888/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560557.118003:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff48f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862773888:0@lo:400:kworker.0 00010000:00080000:2.0:1787560557.118016:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3851500 x1874392862774400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560557.118024:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862774400:0@lo:400:kworker.0 00000100:00100000:2.0:1787560557.118038:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff48faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862772992:0@lo:400:kworker.0 00000100:00100000:2.0:1787560557.118051:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff48f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862773504:0@lo:400:kworker.0 00010000:00080000:2.0:1787560557.118064:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caff48fa300 x1874392862774016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560557.118072:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff48fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862774016:0@lo:400:kworker.0 00000100:00080000:2.0:1787560557.118128:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787560557.118135:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787560557.118139:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560557.118160:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff48f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862773248:0@lo:400:kworker.0 00010000:00080000:2.0:1787560557.118175:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caff48fb100 x1874392862773760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560557.118183:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff48fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862773760:0@lo:400:kworker.0 00010000:00080000:2.0:1787560557.118195:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3851880 x1874392862774272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560557.118204:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874392862774272:0@lo:400:kworker.0 00000100:00100000:2.0:1787560557.118227:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff48fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862773120:0@lo:400:kworker.0 00000100:00100000:2.0:1787560557.118238:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff48f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862773632:0@lo:400:kworker.0 00000100:00100000:2.0:1787560557.118251:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874392862774144:0@lo:400:kworker.0 00010000:00010000:3.0:1787560557.555904:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560558.579707:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560558.644405:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787560558.645623:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862774528:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787560558.645698:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560558.649690:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862774528 00000100:00100000:2.0:1787560558.649706:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862774528 00000100:00100000:2.0:1787560558.649768:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787560558.649788:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862774528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787560558.649827:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787560558.649916:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862774528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (4218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560558.649923:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787560558.650103:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862774528:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787560559.609640:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560559.620693:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560559.620745:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560559.620768:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560559.620788:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560559.620804:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560559.620842:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560559.620870:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560559.620896:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853264128 00000100:00100000:1.0:1787560559.620906:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853264128 00000100:00100000:1.0:1787560559.620969:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853264384 00000100:00100000:1.0:1787560559.620971:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853264384 00000100:00100000:1.0:1787560559.620983:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853264000 00000100:00100000:1.0:1787560559.620985:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853264000 00000100:00100000:1.0:1787560559.620994:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853264256 00000100:00100000:1.0:1787560559.620997:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853264256 00000100:00100000:1.0:1787560559.621013:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 132 00000100:00100000:1.0:1787560559.621022:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853264128:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560559.621093:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853264128:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 72us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560559.621101:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 132 00000100:00100000:1.0:1787560559.621120:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 133 00000100:00100000:1.0:1787560559.621126:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+6:2403:x1874392853264384:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560559.621152:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+6:2403:x1874392853264384:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 26us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560559.621159:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 133 00000100:00100000:1.0:1787560559.621171:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 134 00000100:00100000:1.0:1787560559.621187:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+6:2403:x1874392853264000:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560559.621214:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+6:2403:x1874392853264000:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 31us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560559.621220:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 134 00000100:00100000:1.0:1787560559.621231:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 135 00000100:00100000:1.0:1787560559.621237:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+6:2403:x1874392853264256:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560559.621259:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+6:2403:x1874392853264256:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 23us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560559.621266:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 135 00000100:00100000:1.0:1787560559.621289:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853264640 00000100:00100000:1.0:1787560559.621292:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853264640 00000100:00100000:1.0:1787560559.621319:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853264512 00000100:00100000:1.0:1787560559.621322:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853264512 00000100:00100000:1.0:1787560559.621340:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 52 00000100:00100000:1.0:1787560559.621346:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+6:2403:x1874392853264640:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560559.621371:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+6:2403:x1874392853264640:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 25us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560559.621377:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 52 00000100:00100000:1.0:1787560559.621389:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 53 00000100:00100000:1.0:1787560559.621395:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+6:2403:x1874392853264512:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560559.621419:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+6:2403:x1874392853264512:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 24us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560559.621425:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 53 00000100:00080000:1.0:1787560559.621493:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787560559.621504:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787560559.621506:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787560559.621508:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787560559.621935:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853263872 00000100:00100000:0.0:1787560559.621941:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853263872 00000100:00100000:0.0:1787560559.621974:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 302 00000100:00100000:0.0:1787560559.621982:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc8c2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+13:2403:x1874392853263872:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560559.622023:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc8c2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+13:2403:x1874392853263872:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 41us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560559.622029:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 302 00000100:00100000:3.0:1787560559.668534:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862774656:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787560559.668616:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560559.668698:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862774656 00000100:00100000:3.0:1787560559.668707:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862774656 00000100:00100000:3.0:1787560559.668994:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787560559.669008:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc87f7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862774656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787560559.669047:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787560559.669094:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc87f7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862774656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560559.669110:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787560559.669453:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862774656:0@lo:41:osp-pre-1-0.0 00000001:00100000:0.0:1787560559.679971:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8 00000001:00100000:0.0:1787560559.680136:0:7430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8 00000001:00100000:3.0:1787560559.680462:0:9491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8 00000001:00100000:2.0:1787560559.681491:0:6478:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8 00000001:02000400:0.0:1787560560.199805:0:12168:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1787560560.630834:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560561.203644:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862774784:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787560561.203750:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560561.203849:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862774784 00000100:00100000:3.0:1787560561.203858:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862774784 00000100:00100000:3.0:1787560561.203926:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787560561.203938:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862774784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787560561.203975:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787560561.204028:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862774784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560561.204036:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1787560561.204060:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787560561.204100:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcb0b100 x1874392862774784/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560577 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560561.204120:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862774784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787560561.206775:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862774912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787560561.206865:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560561.206975:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862774912 00000100:00100000:3.0:1787560561.206986:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862774912 00000100:00100000:3.0:1787560561.207072:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787560561.207084:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862774912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787560561.207114:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1787560561.207186:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787560561.207841:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862774912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 753us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560561.207852:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1787560561.207983:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcbb8e00 x1874392862774912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560577 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560561.208009:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862774912:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787560561.651831:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560562.227843:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787560562.227876:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862775040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787560562.227967:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560562.228102:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862775040 00000100:00100000:0.0:1787560562.228113:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862775040 00000100:00100000:0.0:1787560562.228201:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787560562.228215:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862775040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787560562.228256:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560562.228315:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862775040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560562.228334:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1787560562.229210:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787560562.229271:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec33c1c00 x1874392862775040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560578 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560562.229300:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862775040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787560562.229693:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862775168:0@lo:400:kworker.0 00000100:00100000:1.0:1787560562.229757:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560562.229798:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862775680:0@lo:400:kworker.0 00000100:00100000:1.0:1787560562.229825:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560562.229846:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862776192:0@lo:400:kworker.0 00000100:00100000:1.0:1787560562.229872:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560562.229893:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787560562.229899:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862775296:0@lo:400:kworker.0 00000100:00100000:1.0:1787560562.229925:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560562.229943:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862775808:0@lo:400:kworker.0 00000100:00100000:1.0:1787560562.229985:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560562.230006:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874392862776320:0@lo:400:kworker.0 00000100:00100000:1.0:1787560562.230028:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560562.230055:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862775552:0@lo:400:kworker.0 00000100:00100000:1.0:1787560562.230077:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560562.230102:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862776064:0@lo:400:kworker.0 00000100:00100000:1.0:1787560562.230125:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560562.230154:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862776576:0@lo:400:kworker.0 00000100:00100000:1.0:1787560562.230177:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560562.230196:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787560562.230201:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862775424:0@lo:400:kworker.0 00000100:00100000:1.0:1787560562.230223:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560562.230241:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862775936:0@lo:400:kworker.0 00000100:00100000:1.0:1787560562.230262:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560562.230274:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874392862776448:0@lo:400:kworker.0 00000100:00100000:1.0:1787560562.230293:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560562.230318:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862775168 00000100:00100000:1.0:1787560562.230325:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862775168 00000100:00100000:1.0:1787560562.230380:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1787560562.230390:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc8c2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3625:x1874392862775168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560562.230483:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc8c2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3625:x1874392862775168:12345-0@lo:400:kworker.0 Request processed in 94us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560562.230491:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1787560562.230527:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862775680 00000100:00100000:1.0:1787560562.230532:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862775680 00000100:00100000:1.0:1787560562.230557:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862775424 00000100:00100000:1.0:1787560562.230559:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862775424 00000100:00100000:1.0:1787560562.230572:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787560562.230578:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862775680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560562.230614:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862775680:12345-0@lo:400:kworker.0 Request processed in 36us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560562.230630:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787560562.230643:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787560562.230648:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec390b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862775424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560562.230683:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec390b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862775424:12345-0@lo:400:kworker.0 Request processed in 34us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560562.230688:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787560562.230709:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862776192 00000100:00100000:1.0:1787560562.230712:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862776192 00000100:00100000:1.0:1787560562.230738:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862776064 00000100:00100000:1.0:1787560562.230742:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862776064 00000100:00100000:1.0:1787560562.230754:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862776576 00000100:00100000:1.0:1787560562.230757:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862776576 00000100:00100000:1.0:1787560562.230781:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787560562.230788:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862776192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560562.230820:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862776192:12345-0@lo:400:kworker.0 Request processed in 33us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560562.230827:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787560562.230838:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787560562.230845:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec390a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862776064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560562.230870:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec390a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862776064:12345-0@lo:400:kworker.0 Request processed in 26us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560562.230876:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787560562.230885:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787560562.230891:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec390aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862776576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560562.230918:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec390aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862776576:12345-0@lo:400:kworker.0 Request processed in 27us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560562.230934:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787560562.230955:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862775296 00000100:00100000:1.0:1787560562.230960:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862775296 00000100:00100000:1.0:1787560562.230980:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862775808 00000100:00100000:0.0:1787560562.231262:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787560562.231274:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862776704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560562.231307:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560562.231342:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862776704 00000100:00100000:0.0:1787560562.231346:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862776704 00000100:00100000:0.0:1787560562.231374:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787560562.231381:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862776704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787560562.231397:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560562.231467:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862776704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560562.231474:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1787560562.231511:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec33c3b80 x1874392862776704/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560578 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560562.231531:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862776704:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787560562.231845:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862775808 00000100:00100000:1.0:1787560562.231874:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862776320 00000100:00100000:1.0:1787560562.231878:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862776320 00000100:00100000:1.0:1787560562.231890:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862775552 00000100:00100000:1.0:1787560562.231893:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862775552 00000100:00100000:1.0:1787560562.231902:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862775936 00000100:00100000:1.0:1787560562.231904:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862775936 00000100:00100000:1.0:1787560562.231917:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862776448 00000100:00100000:1.0:1787560562.231920:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862776448 00000100:00100000:1.0:1787560562.231937:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787560562.231946:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862775296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560562.231990:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862775296:12345-0@lo:400:kworker.0 Request processed in 45us (2064us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560562.231996:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787560562.232010:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787560562.232016:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862775808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560562.232042:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862775808:12345-0@lo:400:kworker.0 Request processed in 27us (2057us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560562.232049:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787560562.232061:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787560562.232068:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec390a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874392862776320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560562.232096:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec390a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874392862776320:12345-0@lo:400:kworker.0 Request processed in 30us (2067us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560562.232102:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787560562.232122:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787560562.232129:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec390b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862775552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560562.233749:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787560562.233771:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862775936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560562.233865:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862775936:12345-0@lo:400:kworker.0 Request processed in 103us (3601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560562.233873:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787560562.233899:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787560562.233906:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec390bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874392862776448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560562.233935:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec390bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874392862776448:12345-0@lo:400:kworker.0 Request processed in 31us (3642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560562.233941:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787560562.234261:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec390b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862775552:12345-0@lo:400:kworker.0 Request processed in 2130us (4180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560562.234269:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:1.0:1787560562.234306:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787560562.234312:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787560562.234316:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787560562.234360:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862775424:0@lo:400:kworker.0 00010000:00080000:1.0:1787560562.234379:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcbbaa00 x1874392862775936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560562.234390:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862775936:0@lo:400:kworker.0 00010000:00080000:1.0:1787560562.234403:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcbb9c00 x1874392862776448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560562.234659:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874392862776448:0@lo:400:kworker.0 00000100:00100000:1.0:1787560562.234676:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862775552:0@lo:400:kworker.0 00010000:00080000:1.0:1787560562.234689:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcbbb800 x1874392862776064/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560562.234698:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862776064:0@lo:400:kworker.0 00010000:00080000:1.0:1787560562.234710:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcbb9180 x1874392862776576/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560562.234719:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862776576:0@lo:400:kworker.0 00000100:00100000:1.0:1787560562.234772:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862775296:0@lo:400:kworker.0 00000100:00100000:1.0:1787560562.234801:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862775808:0@lo:400:kworker.0 00000100:00100000:1.0:1787560562.234814:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874392862776320:0@lo:400:kworker.0 00000100:00100000:1.0:1787560562.234826:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862775168:0@lo:400:kworker.0 00000100:00100000:1.0:1787560562.234839:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862775680:0@lo:400:kworker.0 00010000:00080000:1.0:1787560562.234852:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcbb9500 x1874392862776192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560562.234862:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862776192:0@lo:400:kworker.0 00010000:00010000:1.0:1787560562.677657:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560563.702517:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560563.764231:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787560563.764261:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862776832:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787560563.764356:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560563.764570:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862776832 00000100:00100000:3.0:1787560563.764581:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862776832 00000100:00100000:3.0:1787560563.764641:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787560563.764654:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862776832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787560563.764698:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787560563.765273:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862776832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 618us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560563.765283:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787560563.765563:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862776832:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787560564.723657:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560564.735193:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560564.735324:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560564.737425:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853264896 00000100:00100000:0.0:1787560564.737487:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853264896 00000100:00100000:0.0:1787560564.737586:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 142 00000100:00100000:0.0:1787560564.737601:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+6:2402:x1874392853264896:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560564.738462:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+6:2402:x1874392853264896:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 836us (3107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560564.738474:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 142 00000100:00080000:0.0:1787560564.738513:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560564.738578:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560564.738740:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560564.738851:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560564.738939:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560564.738964:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560564.738992:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853265536 00000100:00100000:0.0:1787560564.739001:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853265536 00000100:00100000:0.0:1787560564.739179:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853265408 00000100:00100000:0.0:1787560564.739184:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853265408 00000100:00100000:0.0:1787560564.739212:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 57 00000100:00100000:0.0:1787560564.739222:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2402:x1874392853265536:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560564.739281:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2402:x1874392853265536:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 61us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560564.739287:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 57 00000100:00100000:0.0:1787560564.739300:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 58 00000100:00100000:0.0:1787560564.739306:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853265408:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560564.739331:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853265408:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 26us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560564.739338:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 58 00000100:00080000:0.0:1787560564.739362:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787560564.739365:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787560564.739462:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853265024 00000100:00100000:0.0:1787560564.739466:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853265024 00000100:00100000:0.0:1787560564.739491:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853265280 00000100:00100000:0.0:1787560564.739498:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853265280 00000100:00100000:0.0:1787560564.739510:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853265152 00000100:00100000:0.0:1787560564.739512:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853265152 00000100:00100000:0.0:1787560564.739530:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 143 00000100:00100000:0.0:1787560564.739538:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:2402:x1874392853265024:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560564.739545:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853264768 00000100:00100000:2.0:1787560564.739553:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853264768 00000100:00100000:2.0:1787560564.739574:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 144 00000100:00100000:2.0:1787560564.739587:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2402:x1874392853265280:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560564.739589:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:2402:x1874392853265024:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 51us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560564.739600:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 143 00000100:00100000:0.0:1787560564.739615:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 145 00000100:00100000:0.0:1787560564.739622:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853265152:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560564.739630:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2402:x1874392853265280:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 47us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560564.739639:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 144 00000100:00100000:0.0:1787560564.739654:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853265152:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 32us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560564.739662:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 145 00000100:00080000:0.0:1787560564.740724:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787560564.740736:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787560564.744683:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 304 00000100:00100000:2.0:1787560564.744724:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd840bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+13:2402:x1874392853264768:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560564.744849:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd840bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+13:2402:x1874392853264768:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 139us (9821us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560564.744868:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 304 00000100:00100000:0.0:1787560564.791773:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2cce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862776960:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787560564.791870:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560564.792909:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862776960 00000100:00100000:1.0:1787560564.792929:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862776960 00000100:00100000:1.0:1787560564.793010:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787560564.793022:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862776960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787560564.793071:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787560564.793154:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862776960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (1283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560564.793163:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787560564.793206:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2cce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862776960:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787560565.758805:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560566.332306:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862777088:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787560566.332390:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560566.332609:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862777088 00000100:00100000:1.0:1787560566.332618:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862777088 00000100:00100000:1.0:1787560566.332677:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787560566.332687:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862777088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787560566.332725:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787560566.332786:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862777088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560566.332794:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:1.0:1787560566.332836:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3909180 x1874392862777088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560582 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560566.332854:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862777088:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787560566.333841:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787560566.334914:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787560566.334932:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec393b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862777216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560566.334983:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560566.335027:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862777216 00000100:00100000:2.0:1787560566.335033:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862777216 00000100:00100000:2.0:1787560566.335075:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787560566.335082:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862777216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787560566.335100:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560566.335142:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862777216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560566.335149:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1787560566.335166:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787560566.335186:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec393b100 x1874392862777216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560582 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560566.335202:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec393b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862777216:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787560566.776606:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560567.347758:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787560567.347783:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862777344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787560567.347858:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560567.348170:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862777600:0@lo:400:kworker.0 00000100:00100000:0.0:1787560567.348203:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560567.348221:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862778112:0@lo:400:kworker.0 00000100:00100000:0.0:1787560567.348240:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560567.348266:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1fad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874392862778624:0@lo:400:kworker.0 00000100:00100000:0.0:1787560567.348297:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560567.348321:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787560567.348326:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2cce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862777472:0@lo:400:kworker.0 00000100:00100000:0.0:1787560567.348352:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560567.348370:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862777984:0@lo:400:kworker.0 00000100:00100000:0.0:1787560567.348408:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560567.348451:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862778496:0@lo:400:kworker.0 00000100:00100000:0.0:1787560567.348471:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560567.348498:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862777600 00000100:00100000:0.0:1787560567.348505:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862777600 00000100:00100000:0.0:1787560567.348559:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862778112 00000100:00100000:0.0:1787560567.348563:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862778112 00000100:00100000:0.0:1787560567.348584:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862778624 00000100:00100000:0.0:1787560567.348587:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862778624 00000100:00100000:0.0:1787560567.348604:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787560567.348612:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1fac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862777600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560567.348662:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1fac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862777600:12345-0@lo:400:kworker.0 Request processed in 50us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560567.348669:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787560567.348686:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787560567.348692:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1faf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862778112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560567.348723:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1faf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862778112:12345-0@lo:400:kworker.0 Request processed in 32us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560567.348729:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787560567.348739:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787560567.348745:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1fae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874392862778624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560567.348768:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1fae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874392862778624:12345-0@lo:400:kworker.0 Request processed in 24us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560567.348774:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787560567.348792:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862778496 00000100:00100000:0.0:1787560567.348795:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862778496 00000100:00100000:0.0:1787560567.348818:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787560567.348832:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1fac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862778496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560567.348862:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1fac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862778496:12345-0@lo:400:kworker.0 Request processed in 32us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560567.348867:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1787560567.348906:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcaa8700 x1874392862778496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560567.348920:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862778496:0@lo:400:kworker.0 00000100:00100000:0.0:1787560567.348931:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862777600:0@lo:400:kworker.0 00000100:00100000:0.0:1787560567.348940:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862778112:0@lo:400:kworker.0 00000100:00100000:0.0:1787560567.348948:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1fad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874392862778624:0@lo:400:kworker.0 00000100:00100000:3.0:1787560567.349166:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862777984 00000100:00100000:3.0:1787560567.349171:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862777984 00000100:00100000:3.0:1787560567.349205:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787560567.349212:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1faea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862777984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560567.349255:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1faea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862777984:12345-0@lo:400:kworker.0 Request processed in 44us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560567.349261:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787560567.349283:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862777728:0@lo:400:kworker.0 00000100:00100000:3.0:1787560567.349323:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560567.349341:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862778240:0@lo:400:kworker.0 00000100:00100000:3.0:1787560567.349363:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560567.349391:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1faf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874392862778752:0@lo:400:kworker.0 00000100:00100000:3.0:1787560567.349414:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560567.349472:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787560567.349479:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862777856:0@lo:400:kworker.0 00000100:00100000:3.0:1787560567.349502:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560567.349526:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862778368:0@lo:400:kworker.0 00000100:00100000:3.0:1787560567.349544:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560567.349558:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1fadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862778880:0@lo:400:kworker.0 00000100:00100000:3.0:1787560567.349575:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560567.349597:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862778368 00000100:00100000:3.0:1787560567.349600:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862778368 00000100:00100000:3.0:1787560567.349620:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862778880 00000100:00100000:3.0:1787560567.349622:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862778880 00000100:00100000:3.0:1787560567.349641:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787560567.349647:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862778368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560567.349681:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862778368:12345-0@lo:400:kworker.0 Request processed in 34us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560567.349687:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787560567.349699:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787560567.349705:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862778880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560567.349731:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862778880:12345-0@lo:400:kworker.0 Request processed in 27us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560567.349736:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787560567.349750:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862778240 00000100:00100000:3.0:1787560567.349753:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862778240 00000100:00100000:3.0:1787560567.349768:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862778752 00000100:00100000:3.0:1787560567.349770:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862778752 00000100:00100000:3.0:1787560567.349789:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862777856 00000100:00100000:3.0:1787560567.349792:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862777856 00000100:00100000:3.0:1787560567.349802:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787560567.349807:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862778240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560567.349837:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862778240:12345-0@lo:400:kworker.0 Request processed in 30us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560567.349843:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787560567.349853:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787560567.349859:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874392862778752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560567.349883:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874392862778752:12345-0@lo:400:kworker.0 Request processed in 24us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560567.349888:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787560567.349898:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787560567.349905:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862777856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560567.349927:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862777856:12345-0@lo:400:kworker.0 Request processed in 24us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560567.349933:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787560567.349962:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862777984:0@lo:400:kworker.0 00000100:00100000:3.0:1787560567.349982:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862777856:0@lo:400:kworker.0 00010000:00080000:3.0:1787560567.349992:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcaab800 x1874392862778368/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560567.350002:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862778368:0@lo:400:kworker.0 00010000:00080000:3.0:1787560567.350011:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec1fadc00 x1874392862778880/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560567.350031:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1fadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862778880:0@lo:400:kworker.0 00010000:00080000:3.0:1787560567.350043:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcaa8380 x1874392862778240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560567.350051:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862778240:0@lo:400:kworker.0 00010000:00080000:3.0:1787560567.350061:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec1faf100 x1874392862778752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560567.350067:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1faf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874392862778752:0@lo:400:kworker.0 00000100:00080000:2.0:1787560567.350313:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787560567.350318:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787560567.350320:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560567.350329:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787560567.350338:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec393b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862779008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787560567.350366:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560567.350391:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862777344 00000100:00100000:2.0:1787560567.350395:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862777344 00000100:00100000:2.0:1787560567.350463:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862779008 00000100:00100000:2.0:1787560567.350466:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862779008 00000100:00100000:2.0:1787560567.350480:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787560567.350486:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862777344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787560567.350517:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560567.350555:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862777344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (2696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560567.350561:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787560567.350573:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787560567.350579:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862779008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787560567.350588:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560567.350614:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862779008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560567.350627:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1787560567.350643:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787560567.350659:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec393b100 x1874392862779008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560583 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560567.350673:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec393b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862779008:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1787560567.350693:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3909180 x1874392862777344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560583 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560567.350705:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862777344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787560567.350854:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862777728 00000100:00100000:0.0:1787560567.350858:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862777728 00000100:00100000:0.0:1787560567.350892:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787560567.350899:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862777728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560567.350938:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862777728:12345-0@lo:400:kworker.0 Request processed in 39us (1614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560567.350944:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787560567.350973:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862777728:0@lo:400:kworker.0 00000100:00100000:1.0:1787560567.351047:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862777472 00000100:00100000:1.0:1787560567.351052:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862777472 00000100:00100000:1.0:1787560567.351086:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1787560567.351093:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd8409850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3624:x1874392862777472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560567.351127:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd8409850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3624:x1874392862777472:12345-0@lo:400:kworker.0 Request processed in 35us (2775us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560567.351133:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1787560567.351425:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2cce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862777472:0@lo:400:kworker.0 00010000:00010000:2.0:1787560567.801238:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787560568.109168:0:12483:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787560568.109402:0:12483:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787560568.820845:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560568.883975:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec393b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862779136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787560568.884078:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560568.884238:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862779136 00000100:00100000:1.0:1787560568.884249:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862779136 00000100:00100000:1.0:1787560568.884315:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787560568.884327:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1fad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862779136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787560568.884390:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787560568.884479:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1fad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862779136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 154us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560568.884486:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787560568.885778:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec393b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862779136:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787560569.847640:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560569.853492:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560569.853521:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560569.853557:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560569.853580:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560569.853618:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560569.853648:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560569.853683:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853265792 00000100:00100000:1.0:1787560569.853696:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853265792 00000100:00100000:1.0:1787560569.853761:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853266048 00000100:00100000:1.0:1787560569.853765:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853266048 00000100:00100000:1.0:1787560569.853782:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853265920 00000100:00100000:1.0:1787560569.853785:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853265920 00000100:00100000:1.0:1787560569.853798:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853266176 00000100:00100000:1.0:1787560569.853800:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853266176 00000100:00100000:1.0:1787560569.853816:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 152 00000100:00100000:1.0:1787560569.853827:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec390b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+6:2402:x1874392853265792:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560569.853917:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec390b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+6:2402:x1874392853265792:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 92us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560569.853925:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 152 00000100:00100000:1.0:1787560569.853944:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 153 00000100:00100000:1.0:1787560569.853950:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2402:x1874392853266048:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560569.853970:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2402:x1874392853266048:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 21us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560569.853976:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 153 00000100:00100000:1.0:1787560569.853985:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 154 00000100:00100000:1.0:1787560569.853990:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853265920:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560569.854008:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853265920:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 18us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560569.854013:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 154 00000100:00100000:1.0:1787560569.854022:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 155 00000100:00100000:1.0:1787560569.854034:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853266176:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560569.854055:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853266176:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 22us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560569.854061:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 155 00000100:00100000:1.0:1787560569.854079:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853265664 00000100:00100000:1.0:1787560569.854082:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853265664 00000100:00100000:1.0:1787560569.854106:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 306 00000100:00100000:1.0:1787560569.854112:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd8408050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+13:2403:x1874392853265664:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560569.854133:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd8408050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+13:2403:x1874392853265664:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 21us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560569.854139:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 306 00000100:00100000:1.0:1787560569.854171:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853266432 00000100:00100000:1.0:1787560569.854175:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853266432 00000100:00100000:1.0:1787560569.854201:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 62 00000100:00100000:1.0:1787560569.854207:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853266432:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560569.854229:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853266432:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 23us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560569.854235:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 62 00000100:00080000:1.0:1787560569.854249:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787560569.854254:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787560569.854256:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560569.866662:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560569.866708:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853266304 00000100:00100000:3.0:1787560569.866720:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853266304 00000100:00100000:3.0:1787560569.866792:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 63 00000100:00100000:3.0:1787560569.866805:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2402:x1874392853266304:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560569.866898:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2402:x1874392853266304:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 96us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560569.866906:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 63 00000100:00080000:3.0:1787560569.866928:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787560569.907729:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787560569.908126:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1faf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862779264:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787560569.908220:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560569.908466:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862779264 00000100:00100000:2.0:1787560569.908479:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862779264 00000100:00100000:2.0:1787560569.908548:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787560569.908560:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862779264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787560569.908610:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787560569.908668:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862779264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560569.908677:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787560569.908951:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1faf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862779264:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1787560570.573604:0:12580:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787560570.573982:0:12580:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787560570.867845:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560571.444697:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787560571.444732:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862779392:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787560571.444852:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560571.445026:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862779392 00000100:00100000:1.0:1787560571.445039:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862779392 00000100:00100000:1.0:1787560571.445121:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787560571.445134:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafefc4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862779392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787560571.445181:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787560571.445238:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafefc4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862779392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560571.445247:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:0.0:1787560571.445490:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3908000 x1874392862779392/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560587 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560571.445513:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862779392:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787560571.445592:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560571.455378:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787560571.455644:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862779520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787560571.455741:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560571.463061:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862779520 00000100:00100000:1.0:1787560571.463084:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862779520 00000100:00100000:1.0:1787560571.463222:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787560571.463235:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1fae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862779520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787560571.463272:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787560571.465878:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1fae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862779520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2632us (10123us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560571.465897:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:0.0:1787560571.466042:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3909880 x1874392862779520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560587 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560571.466070:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862779520:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787560571.474868:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787560571.891691:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560572.470105:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1faca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862779648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560572.470195:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560572.470460:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862779648 00000100:00100000:0.0:1787560572.470470:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862779648 00000100:00100000:0.0:1787560572.470543:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787560572.470554:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1faf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862779648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787560572.470590:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560572.470641:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1faf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862779648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560572.470650:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1787560572.470674:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787560572.470786:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec1faca80 x1874392862779648/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560588 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560572.470809:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1faca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862779648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787560572.477104:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787560572.477136:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec390ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862779776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787560572.477228:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560572.477472:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862779776 00000100:00100000:1.0:1787560572.477482:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862779776 00000100:00100000:1.0:1787560572.477555:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787560572.477568:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862779776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787560572.477599:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787560572.477791:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862779776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560572.477800:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:1.0:1787560572.477855:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec390ad80 x1874392862779776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560588 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560572.477880:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec390ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862779776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787560572.478203:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec390ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862779904:0@lo:400:kworker.0 00000100:00100000:1.0:1787560572.478244:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560572.478450:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862780032:0@lo:400:kworker.0 00000100:00100000:0.0:1787560572.478487:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560572.478514:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874392862780544:0@lo:400:kworker.0 00000100:00100000:0.0:1787560572.478533:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560572.478547:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874392862781056:0@lo:400:kworker.0 00000100:00100000:0.0:1787560572.478563:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560572.478579:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787560572.478584:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862780160:0@lo:400:kworker.0 00000100:00100000:0.0:1787560572.478604:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560572.478617:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862780672:0@lo:400:kworker.0 00000100:00100000:0.0:1787560572.478634:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560572.478646:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862781184:0@lo:400:kworker.0 00000100:00100000:0.0:1787560572.478674:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560572.478814:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862780032 00000100:00100000:0.0:1787560572.478819:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862780032 00000100:00100000:0.0:1787560572.478849:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862780544 00000100:00100000:0.0:1787560572.478851:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862780544 00000100:00100000:0.0:1787560572.478863:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862781056 00000100:00100000:0.0:1787560572.478865:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862781056 00000100:00100000:0.0:1787560572.478874:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862780672 00000100:00100000:0.0:1787560572.478876:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862780672 00000100:00100000:0.0:1787560572.478887:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862781184 00000100:00100000:0.0:1787560572.478889:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862781184 00000100:00100000:0.0:1787560572.478901:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787560572.478909:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1faca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862780032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560572.478954:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1faca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862780032:12345-0@lo:400:kworker.0 Request processed in 46us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560572.478974:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787560572.478988:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787560572.478993:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1faf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874392862780544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560572.479015:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1faf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874392862780544:12345-0@lo:400:kworker.0 Request processed in 23us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560572.479020:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787560572.479029:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787560572.479033:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1fadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874392862781056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560572.479052:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1fadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874392862781056:12345-0@lo:400:kworker.0 Request processed in 18us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560572.479057:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787560572.479065:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787560572.479070:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862780672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560572.479088:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862780672:12345-0@lo:400:kworker.0 Request processed in 19us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560572.479094:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787560572.479101:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787560572.479106:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2cce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874392862781184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560572.479124:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2cce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874392862781184:12345-0@lo:400:kworker.0 Request processed in 18us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560572.479129:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787560572.479151:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862780160 00000100:00100000:0.0:1787560572.479154:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862780160 00000100:00100000:0.0:1787560572.479175:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787560572.479180:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862780160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560572.479214:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862780160:12345-0@lo:400:kworker.0 Request processed in 34us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560572.479221:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:0.0:1787560572.479240:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787560572.479245:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787560572.479248:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787560572.479448:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862780288:0@lo:400:kworker.0 00000100:00100000:2.0:1787560572.479482:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560572.479505:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862780800:0@lo:400:kworker.0 00000100:00100000:2.0:1787560572.479526:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560572.479570:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862780800 00000100:00100000:2.0:1787560572.479573:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862780800 00000100:00100000:2.0:1787560572.479601:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787560572.479607:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862780800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560572.479638:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862780800:12345-0@lo:400:kworker.0 Request processed in 31us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560572.479643:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787560572.479825:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862780416:0@lo:400:kworker.0 00000100:00100000:1.0:1787560572.479851:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560572.479865:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862780928:0@lo:400:kworker.0 00000100:00100000:1.0:1787560572.479881:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560572.479916:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862780416 00000100:00100000:1.0:1787560572.479919:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862780416 00000100:00100000:1.0:1787560572.479940:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787560572.479946:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862780416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560572.479976:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862780416:12345-0@lo:400:kworker.0 Request processed in 30us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560572.479982:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787560572.480011:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862780416:0@lo:400:kworker.0 00000100:00100000:0.0:1787560572.480419:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862779904 00000100:00100000:0.0:1787560572.480424:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862779904 00000100:00100000:0.0:1787560572.480466:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1787560572.480472:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd087b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3626:x1874392862779904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560572.480514:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd087b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3626:x1874392862779904:12345-0@lo:400:kworker.0 Request processed in 43us (2270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560572.480521:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1787560572.480553:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec390ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862779904:0@lo:400:kworker.0 00000100:00100000:0.0:1787560572.480593:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862780160:0@lo:400:kworker.0 00010000:00080000:0.0:1787560572.480607:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec33c3480 x1874392862780672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560572.480618:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862780672:0@lo:400:kworker.0 00010000:00080000:0.0:1787560572.480628:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec33c2300 x1874392862781184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560572.480637:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862781184:0@lo:400:kworker.0 00000100:00100000:0.0:1787560572.480648:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862780032:0@lo:400:kworker.0 00000100:00100000:0.0:1787560572.480669:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874392862780544:0@lo:400:kworker.0 00010000:00080000:2.0:1787560572.480771:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec33c0a80 x1874392862780800/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560572.480782:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862780800:0@lo:400:kworker.0 00000100:00100000:2.0:1787560572.480803:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862780288 00000100:00100000:2.0:1787560572.480807:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862780288 00000100:00100000:2.0:1787560572.480833:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787560572.480839:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862780288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560572.480876:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862780288:12345-0@lo:400:kworker.0 Request processed in 38us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560572.480882:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787560572.480906:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862780288:0@lo:400:kworker.0 00000100:00100000:0.0:1787560572.481015:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874392862781056:0@lo:400:kworker.0 00000100:00100000:3.0:1787560572.481413:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862780928 00000100:00100000:3.0:1787560572.481420:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862780928 00000100:00100000:3.0:1787560572.483054:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787560572.483073:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862780928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560572.483196:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862780928:12345-0@lo:400:kworker.0 Request processed in 129us (3311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560572.483205:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1787560572.483283:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec33c0e00 x1874392862780928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560572.483300:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862780928:0@lo:400:kworker.0 00000020:00000004:3.0:1787560572.824142:0:12678:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787560572.824709:0:12678:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787560572.918658:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560573.939935:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560574.007968:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787560574.009770:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffb887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862781312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787560574.009876:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560574.010000:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862781312 00000100:00100000:2.0:1787560574.010012:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862781312 00000100:00100000:2.0:1787560574.010083:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787560574.010095:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862781312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787560574.010142:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787560574.010213:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862781312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560574.010234:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787560574.010469:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffb887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862781312:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787560574.965642:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560574.986965:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560574.987016:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560574.987043:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560574.987090:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853266560 00000100:00100000:0.0:1787560574.987103:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853266560 00000100:00100000:0.0:1787560574.987170:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 308 00000100:00100000:0.0:1787560574.987183:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd0878450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+13:2402:x1874392853266560:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560574.987288:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd0878450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+13:2402:x1874392853266560:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 107us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560574.987297:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 308 00000100:00100000:0.0:1787560574.987347:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853266688 00000100:00100000:0.0:1787560574.987351:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853266688 00000100:00100000:0.0:1787560574.987401:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853266944 00000100:00100000:0.0:1787560574.987404:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853266944 00000100:00100000:0.0:1787560574.987675:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 162 00000100:00100000:0.0:1787560574.987687:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:2403:x1874392853266688:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560574.987728:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:2403:x1874392853266688:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 44us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560574.987736:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 162 00000100:00100000:0.0:1787560574.987750:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 163 00000100:00100000:0.0:1787560574.987757:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853266944:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560574.987782:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853266944:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 26us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560574.987787:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 163 00000100:00080000:0.0:1787560574.987975:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560574.990070:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560574.990110:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560574.990148:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560574.990174:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560574.990200:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853266816 00000100:00100000:0.0:1787560574.990212:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853266816 00000100:00100000:0.0:1787560574.990281:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853267072 00000100:00100000:0.0:1787560574.990285:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853267072 00000100:00100000:2.0:1787560574.990467:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853267200 00000100:00100000:2.0:1787560574.990473:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853267200 00000100:00100000:2.0:1787560574.990506:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853267328 00000100:00100000:2.0:1787560574.990509:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853267328 00000100:00100000:2.0:1787560574.990533:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:2.0:1787560574.990544:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2401:x1874392853267200:12345-192.168.203.29@tcp:9:kworker.0 00000020:00000080:2.0:1787560574.990590:0:8412:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33dc2 00000100:00080000:2.0:1787560574.990600:0:8412:0:(import.c:65:import_set_state_nolock()) ffff9caec2f9f000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787560574.990732:0:8412:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1787560574.990918:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:3.0:1787560574.990929:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2cce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2401:x1874392853267328:12345-192.168.203.29@tcp:9:kworker.0 00000020:00000080:3.0:1787560574.991005:0:8414:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33dc9 00000100:00080000:3.0:1787560574.991012:0:8414:0:(import.c:65:import_set_state_nolock()) ffff9caec2f98800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787560574.991049:0:8414:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1787560574.991161:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+2:2401:x1874392853267200:12345-192.168.203.29@tcp:9:kworker.0 Request processed in 618us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560574.991169:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 22 00010000:00010000:2.0:1787560574.991198:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560574.991237:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560574.992684:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 164 00000100:00100000:0.0:1787560574.992723:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+5:2402:x1874392853266816:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560574.992851:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2cce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+2:2401:x1874392853267328:12345-192.168.203.29@tcp:9:kworker.0 Request processed in 1922us (2737us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560574.992862:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:0.0:1787560574.995415:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+5:2402:x1874392853266816:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 2693us (5248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560574.999207:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 164 00000100:00100000:0.0:1787560574.999265:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 165 00000100:00100000:0.0:1787560574.999295:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2402:x1874392853267072:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560574.999412:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2402:x1874392853267072:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 138us (9236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560574.999419:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 165 00000100:00080000:0.0:1787560574.999644:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787560574.999651:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787560574.999655:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787560575.038670:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787560575.038704:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862781440:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787560575.038798:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560575.038876:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862781440 00000100:00100000:0.0:1787560575.038885:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862781440 00000100:00100000:0.0:1787560575.038947:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787560575.038956:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862781440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787560575.038998:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787560575.039046:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862781440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560575.039054:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787560575.039103:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862781440:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1787560575.578314:0:12776:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787560575.578991:0:12776:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787560575.991981:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560576.563633:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862781568:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787560576.563733:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560576.563830:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862781568 00000100:00100000:0.0:1787560576.563840:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862781568 00000100:00100000:0.0:1787560576.563911:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787560576.563923:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec390ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862781568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787560576.563960:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560576.564008:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec390ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862781568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560576.564029:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1787560576.564052:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787560576.564086:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3908000 x1874392862781568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560592 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560576.564107:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862781568:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787560576.575244:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787560576.575292:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862781696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787560576.575396:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560576.575495:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862781696 00000100:00100000:1.0:1787560576.575505:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862781696 00000100:00100000:1.0:1787560576.575583:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787560576.575613:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862781696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787560576.575642:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787560576.575702:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862781696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560576.575710:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1787560576.575735:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787560576.575740:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcb0a680 x1874392862781696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560592 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560576.575771:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862781696:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787560577.012011:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560577.587783:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862781824:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787560577.587882:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560577.588103:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862781824 00000100:00100000:0.0:1787560577.588114:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862781824 00000100:00100000:0.0:1787560577.588199:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787560577.588212:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862781824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787560577.588269:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560577.588328:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862781824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560577.588337:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1787560577.588457:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787560577.588494:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3908000 x1874392862781824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560593 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560577.588516:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862781824:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787560577.589010:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec393ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862782208:0@lo:400:kworker.0 00000100:00100000:2.0:1787560577.589055:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560577.589080:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec393a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862782720:0@lo:400:kworker.0 00000100:00100000:2.0:1787560577.589101:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560577.589131:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec393b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874392862783232:0@lo:400:kworker.0 00000100:00100000:2.0:1787560577.589152:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560577.589174:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787560577.589180:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862782080:0@lo:400:kworker.0 00000100:00100000:2.0:1787560577.589210:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560577.589237:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec393b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862782592:0@lo:400:kworker.0 00000100:00100000:2.0:1787560577.589264:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560577.589282:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862783104:0@lo:400:kworker.0 00000100:00100000:2.0:1787560577.589306:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560577.589336:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862782208 00000100:00100000:2.0:1787560577.589342:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862782208 00000100:00100000:2.0:1787560577.589396:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862782720 00000100:00100000:2.0:1787560577.589400:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862782720 00000100:00100000:2.0:1787560577.589422:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862783232 00000100:00100000:2.0:1787560577.589425:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862783232 00000100:00100000:2.0:1787560577.589479:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787560577.589489:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862782208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560577.589542:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862782208:12345-0@lo:400:kworker.0 Request processed in 54us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560577.589549:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787560577.589566:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787560577.589572:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862782720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560577.589599:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862782720:12345-0@lo:400:kworker.0 Request processed in 28us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560577.589605:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787560577.589615:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787560577.589621:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874392862783232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560577.589656:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874392862783232:12345-0@lo:400:kworker.0 Request processed in 34us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560577.589662:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787560577.589689:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862782080 00000100:00100000:2.0:1787560577.589693:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862782080 00000100:00100000:2.0:1787560577.589720:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1787560577.589726:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd3219c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3624:x1874392862782080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560577.589757:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd3219c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3624:x1874392862782080:12345-0@lo:400:kworker.0 Request processed in 31us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560577.589763:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1787560577.589796:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862782592 00000100:00100000:2.0:1787560577.589800:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862782592 00000100:00100000:2.0:1787560577.589825:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787560577.589832:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862782592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560577.589865:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862782592:12345-0@lo:400:kworker.0 Request processed in 34us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560577.589871:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787560577.589890:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862783104 00000100:00100000:2.0:1787560577.589893:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862783104 00000100:00100000:2.0:1787560577.589921:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787560577.589929:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862783104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560577.589961:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862783104:12345-0@lo:400:kworker.0 Request processed in 34us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560577.589967:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1787560577.590000:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560577.590027:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862782080:0@lo:400:kworker.0 00000100:00100000:2.0:1787560577.590051:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec393b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862782592:0@lo:400:kworker.0 00010000:00080000:2.0:1787560577.590066:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3938a80 x1874392862783104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560577.590077:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862783104:0@lo:400:kworker.0 00000100:00100000:2.0:1787560577.590088:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec393ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862782208:0@lo:400:kworker.0 00000100:00100000:2.0:1787560577.590099:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec393a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862782720:0@lo:400:kworker.0 00000100:00100000:2.0:1787560577.590110:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec393b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874392862783232:0@lo:400:kworker.0 00000100:00100000:1.0:1787560577.590609:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffb887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862781952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787560577.590656:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560577.590693:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec393a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874392862782464:0@lo:400:kworker.0 00000100:00100000:1.0:1787560577.590720:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560577.590758:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862782976:0@lo:400:kworker.0 00000100:00100000:1.0:1787560577.590783:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560577.590798:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862783488:0@lo:400:kworker.0 00000100:00100000:1.0:1787560577.590815:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560577.590833:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787560577.590840:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862782336:0@lo:400:kworker.0 00000100:00100000:1.0:1787560577.590861:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560577.590876:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec393aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874392862782848:0@lo:400:kworker.0 00000100:00100000:1.0:1787560577.590896:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560577.590912:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862783360:0@lo:400:kworker.0 00000100:00100000:1.0:1787560577.590933:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560577.591061:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862782976 00000100:00100000:3.0:1787560577.591068:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862782976 00000100:00100000:3.0:1787560577.591107:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862783488 00000100:00100000:3.0:1787560577.591110:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862783488 00000100:00100000:3.0:1787560577.591139:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787560577.591147:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862782976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560577.591195:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862782976:12345-0@lo:400:kworker.0 Request processed in 49us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560577.591203:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787560577.591218:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787560577.591225:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862783488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560577.591255:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862783488:12345-0@lo:400:kworker.0 Request processed in 31us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560577.591260:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1787560577.591280:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787560577.591294:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862782464 00000100:00100000:3.0:1787560577.591298:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862782464 00000100:00100000:3.0:1787560577.591322:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862782848 00000100:00100000:3.0:1787560577.591325:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862782848 00000100:00100000:3.0:1787560577.591340:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862783360 00000100:00100000:3.0:1787560577.591356:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862783360 00000100:00100000:3.0:1787560577.591372:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787560577.591378:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874392862782464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560577.591410:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874392862782464:12345-0@lo:400:kworker.0 Request processed in 32us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560577.591416:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787560577.591479:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787560577.591485:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874392862782848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560577.591511:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874392862782848:12345-0@lo:400:kworker.0 Request processed in 27us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560577.591516:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787560577.591525:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787560577.591529:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874392862783360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560577.591549:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874392862783360:12345-0@lo:400:kworker.0 Request processed in 21us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560577.591555:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:3.0:1787560577.591571:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787560577.591704:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3939500 x1874392862783360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560577.591719:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862783360:0@lo:400:kworker.0 00000100:00100000:1.0:1787560577.591755:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec393a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874392862782464:0@lo:400:kworker.0 00010000:00080000:1.0:1787560577.591767:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3938700 x1874392862782976/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560577.591775:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862782976:0@lo:400:kworker.0 00010000:00080000:1.0:1787560577.591784:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3853b80 x1874392862783488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560577.591793:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862783488:0@lo:400:kworker.0 00010000:00080000:1.0:1787560577.591824:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec393aa00 x1874392862782848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560577.591832:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec393aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874392862782848:0@lo:400:kworker.0 00000100:00100000:0.0:1787560577.591927:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862782336 00000100:00100000:0.0:1787560577.591931:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862782336 00000100:00100000:0.0:1787560577.591983:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787560577.591991:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862782336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560577.592046:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862782336:12345-0@lo:400:kworker.0 Request processed in 55us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560577.592053:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787560577.592211:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862782336:0@lo:400:kworker.0 00000100:00100000:2.0:1787560577.592426:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862781952 00000100:00100000:2.0:1787560577.592465:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862781952 00000100:00100000:2.0:1787560577.592496:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787560577.592504:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862781952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787560577.592526:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560577.592773:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862781952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 268us (2114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560577.592779:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:3.0:1787560577.594100:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffb887b80 x1874392862781952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560593 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560577.594131:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffb887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862781952:0@lo:13:osp-pre-1-0.0 00000020:00000004:1.0:1787560577.858392:0:12873:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787560577.858984:0:12873:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787560578.037009:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560579.063053:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560579.125552:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787560579.125582:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffb887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862783616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787560579.125669:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560579.125841:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862783616 00000100:00100000:0.0:1787560579.125850:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862783616 00000100:00100000:0.0:1787560579.125917:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787560579.125927:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862783616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787560579.125976:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787560579.126032:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862783616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560579.126040:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787560579.126267:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffb887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862783616:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787560580.086812:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560580.094775:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560580.094826:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560580.094867:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560580.094888:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560580.094917:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560580.094952:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853267712 00000100:00100000:0.0:1787560580.094963:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853267712 00000100:00100000:3.0:1787560580.094969:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853267968 00000100:00100000:3.0:1787560580.094983:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853267968 00000100:00100000:0.0:1787560580.095034:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853267584 00000100:00100000:3.0:1787560580.095042:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853267840 00000100:00100000:3.0:1787560580.095047:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853267840 00000100:00100000:0.0:1787560580.095052:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853267584 00000100:00100000:3.0:1787560580.095084:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 172 00000100:00100000:3.0:1787560580.095099:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853267712:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560580.095216:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853267712:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 117us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560580.095226:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 172 00000100:00100000:1.0:1787560580.095677:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853267456 00000100:00100000:1.0:1787560580.095684:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853267456 00000100:00100000:1.0:1787560580.095729:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 310 00000100:00100000:1.0:1787560580.095738:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+13:2403:x1874392853267456:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560580.095775:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+13:2403:x1874392853267456:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 39us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560580.095782:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 310 00000100:00080000:2.0:1787560580.101352:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787560580.101363:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787560580.103494:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 173 00000100:00100000:0.0:1787560580.103558:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853267968:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560580.103610:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 174 00000100:00100000:3.0:1787560580.103638:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853267840:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560580.103649:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853267968:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 138us (8778us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560580.103658:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 173 00000100:00100000:0.0:1787560580.103690:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 175 00000100:00100000:0.0:1787560580.103698:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+6:2403:x1874392853267584:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560580.103737:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+6:2403:x1874392853267584:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 40us (8848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560580.103746:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 175 00000100:00100000:3.0:1787560580.103789:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853267840:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 163us (8868us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560580.103800:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 174 00000100:00100000:0.0:1787560580.150579:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862783744:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787560580.150666:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560580.150780:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862783744 00000100:00100000:1.0:1787560580.150797:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862783744 00000100:00100000:1.0:1787560580.150886:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787560580.150901:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862783744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787560580.150973:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787560580.151291:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862783744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 393us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560580.151301:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787560580.151555:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862783744:0@lo:41:osp-pre-1-0.0 00000001:00100000:0.0:1787560580.662964:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8 00000020:00000080:0.0:1787560580.662975:0:8407:0:(genops.c:885:class_export_put()) final put ffff9caec2f99000/5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8 00000020:00000080:2.0:1787560580.663067:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec2f99000/5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8 for lustre-OST0000 00000020:00000080:2.0:1787560580.669972:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec2f9f000 for lustre-OST0000 00000001:00100000:1.0:1787560580.672559:0:9491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8 00000020:00000080:1.0:1787560580.672570:0:9491:0:(genops.c:885:class_export_put()) final put ffff9caec2f9e800/5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8 00000020:00000080:2.0:1787560580.673902:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec2f9e800/5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8 for lustre-OST0001 00000020:00000080:2.0:1787560580.673968:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec2f98800 for lustre-OST0001 00010000:00010000:2.0:1787560581.109601:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787560581.545364:0:13018:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1787560581.686348:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787560581.686374:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862783872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787560581.687673:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560581.687742:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862784000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787560581.687771:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560581.688136:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862783872 00000100:00100000:1.0:1787560581.688145:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862783872 00000100:00100000:1.0:1787560581.688194:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862784000 00000100:00100000:1.0:1787560581.688197:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862784000 00000100:00100000:1.0:1787560581.688215:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787560581.688224:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862783872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787560581.688255:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787560581.688303:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862783872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560581.688310:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787560581.688345:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787560581.688352:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862784000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787560581.688361:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787560581.688385:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862784000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560581.688402:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:1.0:1787560581.688473:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3853b80 x1874392862784000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560597 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560581.688491:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862784000:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1787560581.688503:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcbb8000 x1874392862783872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560597 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560581.688514:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862783872:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787560581.688766:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787560582.132384:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560582.708370:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862784128:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787560582.708467:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560582.708506:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862784128 00000100:00100000:3.0:1787560582.708516:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862784128 00000100:00080000:2.0:1787560582.708555:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787560582.708648:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862784384:0@lo:400:kworker.0 00000100:00100000:0.0:1787560582.708683:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560582.708721:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862784384 00000100:00100000:0.0:1787560582.708726:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862784384 00000100:00100000:0.0:1787560582.708756:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787560582.708764:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862784384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560582.708816:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862784384:12345-0@lo:400:kworker.0 Request processed in 52us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560582.708840:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787560582.708884:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862784384:0@lo:400:kworker.0 00000100:00100000:0.0:1787560582.708920:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862784512:0@lo:400:kworker.0 00000100:00100000:0.0:1787560582.708947:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560582.709002:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2005f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862784896:0@lo:400:kworker.0 00000100:00100000:0.0:1787560582.709025:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560582.709068:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874392862785024:0@lo:400:kworker.0 00000100:00100000:0.0:1787560582.709089:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560582.709122:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862784512 00000100:00100000:3.0:1787560582.709127:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787560582.709128:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862784512 00000100:00100000:3.0:1787560582.709143:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862784128:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560582.709169:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2005c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874392862785408:0@lo:400:kworker.0 00000100:00100000:2.0:1787560582.709174:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00002000:00000024:3.0:1787560582.709180:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560582.709186:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862784512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560582.709199:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560582.709291:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862784896 00000100:00100000:1.0:1787560582.709300:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862784896 00000100:00100000:1.0:1787560582.709333:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862785024 00000100:00100000:1.0:1787560582.709337:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862785024 00000100:00100000:1.0:1787560582.709348:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862785408 00000100:00100000:1.0:1787560582.709350:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862785408 00000100:00100000:1.0:1787560582.709365:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787560582.709371:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862784896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560582.710147:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862784128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1006us (1679us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560582.710155:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787560582.710763:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787560582.710776:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874392862785024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560582.711155:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874392862785024:12345-0@lo:400:kworker.0 Request processed in 382us (2063us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560582.711162:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787560582.711190:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787560582.711198:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874392862785408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560582.711229:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874392862785408:12345-0@lo:400:kworker.0 Request processed in 33us (2031us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560582.711246:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787560582.711989:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862784256:0@lo:400:kworker.0 00000100:00100000:3.0:1787560582.712038:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560582.712099:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862784768:0@lo:400:kworker.0 00000100:00100000:3.0:1787560582.712127:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560582.712149:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862785280:0@lo:400:kworker.0 00000100:00100000:3.0:1787560582.712173:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560582.712202:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787560582.712208:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862784640:0@lo:400:kworker.0 00000100:00100000:3.0:1787560582.712231:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560582.712247:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862785152:0@lo:400:kworker.0 00000100:00100000:3.0:1787560582.712269:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560582.712299:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862784768 00000100:00100000:3.0:1787560582.712306:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862784768 00000100:00100000:2.0:1787560582.712424:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862784512:12345-0@lo:400:kworker.0 Request processed in 3240us (3474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560582.712451:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787560582.712485:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862784256 00000100:00100000:2.0:1787560582.712489:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862784256 00000100:00100000:2.0:1787560582.712527:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1787560582.712535:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3624:x1874392862784256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560582.712574:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3624:x1874392862784256:12345-0@lo:400:kworker.0 Request processed in 40us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560582.712581:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00080000:2.0:1787560582.712607:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787560582.712613:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560582.712637:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862784256:0@lo:400:kworker.0 00000100:00100000:0.0:1787560582.712724:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2005c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874392862785408:0@lo:400:kworker.0 00000100:00100000:0.0:1787560582.712741:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787560582.712748:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862785536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787560582.712778:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787560582.712831:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2005500 x1874392862785024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560582.712835:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787560582.712849:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862784768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560582.712849:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874392862785024:0@lo:400:kworker.0 00000100:00100000:0.0:1787560582.712865:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862784512:0@lo:400:kworker.0 00000100:00100000:0.0:1787560582.712890:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862784640 00000100:00100000:0.0:1787560582.712894:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862784640 00000100:00100000:3.0:1787560582.712899:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862784768:12345-0@lo:400:kworker.0 Request processed in 53us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560582.712906:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787560582.712926:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787560582.712932:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862785280 00000100:00100000:0.0:1787560582.712935:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862784640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560582.712938:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862785280 00000100:00100000:0.0:1787560582.712985:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862784640:12345-0@lo:400:kworker.0 Request processed in 51us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560582.712991:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787560582.713899:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862785664:0@lo:400:kworker.0 00000100:00100000:0.0:1787560582.713941:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787560582.713989:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3853b80 x1874392862784128/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560598 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560582.714007:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862784128:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560582.714035:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862785664 00000100:00100000:0.0:1787560582.714039:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862785664 00000100:00100000:0.0:1787560582.714070:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787560582.714078:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2004380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874392862785664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560582.714117:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2004380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874392862785664:12345-0@lo:400:kworker.0 Request processed in 40us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560582.714123:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00010000:00080000:0.0:1787560582.714149:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2005500 x1874392862785664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560582.714159:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862785664:0@lo:400:kworker.0 00000100:00100000:2.0:1787560582.714292:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862785536 00000100:00100000:2.0:1787560582.714297:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862785536 00000100:00100000:2.0:1787560582.714360:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787560582.714367:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862785536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787560582.714382:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560582.714422:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862785536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (1644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560582.714428:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1787560582.714466:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787560582.714470:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787560582.714490:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862784640:0@lo:400:kworker.0 00000100:00100000:2.0:1787560582.714501:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862784768:0@lo:400:kworker.0 00010000:00080000:2.0:1787560582.714530:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcbb8000 x1874392862785536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560598 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560582.714543:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862785536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787560582.715528:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862785152 00000100:00100000:3.0:1787560582.715536:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862785152 00000100:00100000:3.0:1787560582.715559:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787560582.715567:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862785280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560582.715624:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862785280:12345-0@lo:400:kworker.0 Request processed in 58us (3450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560582.715630:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787560582.715643:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787560582.715649:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862785152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560582.715690:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862785152:12345-0@lo:400:kworker.0 Request processed in 41us (3419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560582.715696:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:3.0:1787560582.715739:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2004000 x1874392862785152/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560582.715762:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862785152:0@lo:400:kworker.0 00010000:00080000:3.0:1787560582.715775:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2007480 x1874392862785280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560582.715784:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862785280:0@lo:400:kworker.0 00000100:00100000:1.0:1787560582.720035:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862784896:12345-0@lo:400:kworker.0 Request processed in 10653us (10997us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560582.720051:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787560582.720179:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2005f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862784896:0@lo:400:kworker.0 00010000:00010000:2.0:1787560583.159021:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560584.185322:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560584.243632:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787560584.243657:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc87ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862785792:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787560584.243742:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560584.243771:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862785792 00000100:00100000:2.0:1787560584.243780:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862785792 00000100:00100000:2.0:1787560584.243845:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787560584.243854:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc87ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862785792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787560584.243891:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787560584.243944:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc87ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862785792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560584.243951:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787560584.244383:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc87ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862785792:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1787560584.955797:0:13165:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa1fe85a0 20000000:00000080:3.0:1787560584.955816:0:13165:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9caff4920c00 uarg=0000000000000000 20000000:01000000:3.0:1787560584.955860:0:13165:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787560584.955866:0:13165:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787560584.955870:0:13165:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787560584.956318:0:13166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1787560584.956560:0:13165:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787560584.962290:0:13165:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787560584.962334:0:13165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f33dd0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560584.962354:0:13165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cafc1657200/0x4642c20bf2f33d67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33d60 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560584.962378:0:13165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caffcbff600/0x4642c20bf2f33d75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33d6e expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560584.962386:0:13165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caffcbfec00/0x4642c20bf2f33d83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33d7c expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560584.962392:0:13165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cafc1656800/0x4642c20bf2f33d91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33d8a expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560584.962402:0:13165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caffcbfe200/0x4642c20bf2f33d98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb56 expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560584.962409:0:13165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caffcbff800/0x4642c20bf2f33dad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb95 expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560584.962416:0:13165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f33dd0 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560584.962675:0:13165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caffcbff800/0x4642c20bf2f33dad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb95 expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560584.962689:0:13165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9caffcbff800/0x4642c20bf2f33dad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb95 expref: 12 pid: 6492 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560584.962703:0:13165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc87ad180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1874392862785920:192.168.203.29@tcp:104: 00010000:00010000:3.0:1787560584.962820:0:13165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caffcbfe200/0x4642c20bf2f33d98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb56 expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560584.962829:0:13165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9caffcbfe200/0x4642c20bf2f33d98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb56 expref: 12 pid: 6494 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560584.962846:0:13165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc87ae300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1874392862786048:192.168.203.29@tcp:104: 00010000:00010000:3.0:1787560584.962885:0:13165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cafc1656800/0x4642c20bf2f33d91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f33d8a expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560584.962892:0:13165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cafc1656800/0x4642c20bf2f33d91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f33d8a expref: 23 pid: 6492 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560584.962901:0:13165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc87ace00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1874392862786176:0@lo:104: 00000100:00100000:3.0:1787560584.962945:0:13165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787560584.962992:0:13165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caffcbfec00/0x4642c20bf2f33d83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f33d7c expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560584.963001:0:13165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9caffcbfec00/0x4642c20bf2f33d83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f33d7c expref: 23 pid: 6492 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560584.963009:0:13165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc87aca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1874392862786304:0@lo:104: 00000100:00100000:3.0:1787560584.963033:0:13165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560584.963067:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862786176 00000100:00100000:3.0:1787560584.963074:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862786176 00000100:00100000:3.0:1787560584.963112:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862786304 00000100:00100000:3.0:1787560584.963116:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862786304 00000100:00100000:3.0:1787560584.963130:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787560584.963138:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc87af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+4:13165:x1874392862786176:12345-0@lo:104: 00010000:00010000:3.0:1787560584.963150:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cafc1656000/0x4642c20bf2f33d8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33d91 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560584.963197:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787560584.963203:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc87af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+4:13165:x1874392862786176:12345-0@lo:104: Request processed in 66us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560584.963217:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787560584.963247:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787560584.963253:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc87ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:13165:x1874392862786304:12345-0@lo:104: 00010000:00010000:3.0:1787560584.963261:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9caffcbff400/0x4642c20bf2f33d7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33d83 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560584.963305:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787560584.963311:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc87ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:13165:x1874392862786304:12345-0@lo:104: Request processed in 58us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560584.963316:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:3.0:1787560584.963346:0:13165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caffcbff600/0x4642c20bf2f33d75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f33d6e expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560584.963354:0:13165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9caffcbff600/0x4642c20bf2f33d75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f33d6e expref: 23 pid: 6492 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560584.963361:0:13165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc87ac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1874392862786432:0@lo:104: 00000100:00100000:3.0:1787560584.963384:0:13165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560584.963403:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862786432 00000100:00100000:3.0:1787560584.963407:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862786432 00000100:00100000:3.0:1787560584.963423:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787560584.963465:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc87ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:13165:x1874392862786432:12345-0@lo:104: 00010000:00010000:3.0:1787560584.963474:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33d6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33d75 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560584.963508:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787560584.963512:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc87ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:13165:x1874392862786432:12345-0@lo:104: Request processed in 85us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560584.963527:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:3.0:1787560584.963558:0:13165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cafc1657200/0x4642c20bf2f33d67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f33d60 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560584.963566:0:13165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cafc1657200/0x4642c20bf2f33d67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f33d60 expref: 23 pid: 6492 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560584.963574:0:13165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc87aea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1874392862786560:0@lo:104: 00000100:00100000:3.0:1787560584.963599:0:13165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560584.963618:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862786560 00000100:00100000:3.0:1787560584.963621:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862786560 00000100:00100000:3.0:1787560584.963638:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787560584.963644:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:13165:x1874392862786560:12345-0@lo:104: 00010000:00010000:3.0:1787560584.963651:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9caffcbff000/0x4642c20bf2f33d60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33d67 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560584.963681:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787560584.963685:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:13165:x1874392862786560:12345-0@lo:104: Request processed in 42us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560584.963690:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787560584.963711:0:13165:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec21fb300 going to sleep for 11 seconds 00000100:00100000:3.0:1787560584.963733:0:13165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc87ace00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1874392862786176:0@lo:104: 00000100:00100000:3.0:1787560584.963741:0:13165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc87aca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1874392862786304:0@lo:104: 00000100:00100000:3.0:1787560584.963747:0:13165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc87ac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1874392862786432:0@lo:104: 00000100:00100000:3.0:1787560584.963752:0:13165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc87aea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1874392862786560:0@lo:104: 00010000:00010000:1.0:1787560584.963824:0:9501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787560584.963831:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cafc1656000/0x4642c20bf2f33d8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33d91 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.963838:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafc1656000 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:1.0:1787560584.963842:0:9501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cafc1656000/0x4642c20bf2f33d8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33d91 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.963857:0:9501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cafc1656000/0x4642c20bf2f33d8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33d91 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560584.963864:0:9501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cafc1656000/0x4642c20bf2f33d8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33d91 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560584.963871:0:9501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787560584.963906:0:9501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cafc1656000/0x4642c20bf2f33d8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33d91 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.963913:0:9501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560584.963933:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cafc1656000/0x4642c20bf2f33d8a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33d91 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.963939:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cafc1656000/0x4642c20bf2f33d8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33d91 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.963955:0:9501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787560584.963958:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caffcbff400/0x4642c20bf2f33d7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33d83 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.963963:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbff400 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:1.0:1787560584.963966:0:9501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caffcbff400/0x4642c20bf2f33d7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33d83 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.963972:0:9501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caffcbff400/0x4642c20bf2f33d7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33d83 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560584.963978:0:9501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caffcbff400/0x4642c20bf2f33d7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33d83 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560584.963990:0:9501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787560584.964004:0:9501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caffcbff400/0x4642c20bf2f33d7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33d83 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.964010:0:9501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560584.964016:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caffcbff400/0x4642c20bf2f33d7c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33d83 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.964022:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caffcbff400/0x4642c20bf2f33d7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33d83 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.964031:0:9501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787560584.964034:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33d6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33d75 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.964040:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6200 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:1.0:1787560584.964042:0:9501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33d6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33d75 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.964048:0:9501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33d6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33d75 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560584.964053:0:9501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33d6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33d75 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560584.964058:0:9501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787560584.964069:0:9501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33d6e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33d75 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.964074:0:9501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560584.964095:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33d6e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33d75 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.964101:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33d6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33d75 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.964109:0:9501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560584.964112:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caffcbff000/0x4642c20bf2f33d60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33d67 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.964117:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbff000 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:1.0:1787560584.964119:0:9501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caffcbff000/0x4642c20bf2f33d60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33d67 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.964125:0:9501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caffcbff000/0x4642c20bf2f33d60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33d67 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560584.964130:0:9501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caffcbff000/0x4642c20bf2f33d60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33d67 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560584.964134:0:9501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787560584.964147:0:9501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caffcbff000/0x4642c20bf2f33d60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33d67 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.964151:0:9501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560584.964156:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caffcbff000/0x4642c20bf2f33d60 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33d67 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.964162:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caffcbff000/0x4642c20bf2f33d60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33d67 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.964173:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560584.964179:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560584.964180:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560584.964193:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862786688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560584.964225:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560584.964248:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787560584.964253:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862786816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560584.964273:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560584.964314:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862786944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560584.964336:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560584.964354:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787560584.964359:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862787072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560584.964378:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560584.964406:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862786688 00000100:00100000:1.0:1787560584.964410:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862786688 00010000:00010000:1.0:1787560584.964453:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cafc1656800/0x4642c20bf2f33d91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33d8a expref: 24 pid: 6492 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560584.964469:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862786816 00000100:00100000:1.0:1787560584.964472:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862786816 00010000:00010000:1.0:1787560584.964483:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caffcbfec00/0x4642c20bf2f33d83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33d7c expref: 25 pid: 6492 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560584.964493:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862786944 00000100:00100000:1.0:1787560584.964495:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862786944 00010000:00010000:1.0:1787560584.964505:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caffcbff600/0x4642c20bf2f33d75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33d6e expref: 26 pid: 6492 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560584.964515:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862787072 00000100:00100000:1.0:1787560584.964517:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862787072 00010000:00010000:1.0:1787560584.964527:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cafc1657200/0x4642c20bf2f33d67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33d60 expref: 27 pid: 6492 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560584.964548:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787560584.964554:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+27:3625:x1874392862786688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560584.964617:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560584.964622:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cafc1656800/0x4642c20bf2f33d91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33d8a expref: 27 pid: 6492 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.964631:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cafc1656800/0x4642c20bf2f33d91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f33d8a expref: 27 pid: 6492 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.964645:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafc1656800/0x4642c20bf2f33d91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f33d8a expref: 27 pid: 6492 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.964657:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560584.964687:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+26:3625:x1874392862786688:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560584.964693:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787560584.964708:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787560584.964714:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+25:3625:x1874392862786816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560584.964721:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560584.964726:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caffcbfec00/0x4642c20bf2f33d83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33d7c expref: 25 pid: 6492 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.964734:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caffcbfec00/0x4642c20bf2f33d83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f33d7c expref: 25 pid: 6492 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.964743:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffcbfec00/0x4642c20bf2f33d83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f33d7c expref: 25 pid: 6492 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.964763:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560584.964787:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3625:x1874392862786816:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560584.964793:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787560584.964807:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787560584.964813:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:3623:x1874392862786944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560584.964821:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560584.964825:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caffcbff600/0x4642c20bf2f33d75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33d6e expref: 23 pid: 6492 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.964834:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caffcbff600/0x4642c20bf2f33d75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f33d6e expref: 23 pid: 6492 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.964843:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffcbff600/0x4642c20bf2f33d75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f33d6e expref: 23 pid: 6492 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.964851:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560584.964877:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:3623:x1874392862786944:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560584.964883:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787560584.964895:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787560584.964901:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:3623:x1874392862787072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560584.964908:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560584.964913:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cafc1657200/0x4642c20bf2f33d67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33d60 expref: 21 pid: 6492 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.964920:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cafc1657200/0x4642c20bf2f33d67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f33d60 expref: 21 pid: 6492 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.964936:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafc1657200/0x4642c20bf2f33d67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f33d60 expref: 21 pid: 6492 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.964945:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560584.964968:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:3623:x1874392862787072:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560584.964974:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787560584.965012:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862787072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560584.965021:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862786944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560584.965045:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862786816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560584.965052:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862786688:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787560584.968142:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560584.968153:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560584.969836:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560584.970125:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560584.970167:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560584.970246:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853268224 00000100:00100000:1.0:1787560584.970255:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853268224 00010000:00010000:1.0:1787560584.970304:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caffcbfe200/0x4642c20bf2f33d98 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb56 expref: 13 pid: 6494 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560584.970342:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853268096 00000100:00100000:1.0:1787560584.970346:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853268096 00010000:00010000:1.0:1787560584.970359:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caffcbff800/0x4642c20bf2f33dad lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb95 expref: 14 pid: 6492 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560584.970379:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 44 00000100:00100000:1.0:1787560584.970389:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2005f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a608f87b-4315-497d-a70e-0ed75a6814da+14:2404:x1874392853268224:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560584.970404:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560584.970410:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caffcbfe200/0x4642c20bf2f33d98 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb56 expref: 14 pid: 6494 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.970453:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caffcbfe200/0x4642c20bf2f33d98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb56 expref: 14 pid: 6494 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.970474:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560584.970526:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2005f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a608f87b-4315-497d-a70e-0ed75a6814da+14:2404:x1874392853268224:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 138us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560584.970534:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 44 00000100:00100000:1.0:1787560584.970553:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 45 00000100:00100000:1.0:1787560584.970561:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd7cb6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a608f87b-4315-497d-a70e-0ed75a6814da+13:2404:x1874392853268096:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560584.970582:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560584.970588:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caffcbff800/0x4642c20bf2f33dad lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb95 expref: 13 pid: 6492 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.970598:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caffcbff800/0x4642c20bf2f33dad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb95 expref: 13 pid: 6492 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.970611:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f33dd0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.970619:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f33dd0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.970634:0:6485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f33dd0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.970641:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f33dd0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.970647:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f33dd0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.970661:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f33dd0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.970667:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7000 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560584.970671:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f33dd0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.970678:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f33dd0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.970687:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f33dd0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560584.970699:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560584.970720:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd7cb6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a608f87b-4315-497d-a70e-0ed75a6814da+13:2404:x1874392853268096:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 160us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560584.970727:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 45 00010000:00010000:3.0:1787560584.972394:0:13165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffcbff800/0x4642c20bf2f33dad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb95 expref: 12 pid: 6492 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560584.976896:0:13165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc87ad180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1874392862785920:192.168.203.29@tcp:104: 00010000:00010000:3.0:1787560584.976977:0:13165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffcbfe200/0x4642c20bf2f33d98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb56 expref: 11 pid: 6494 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560584.976993:0:13165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc87ae300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1874392862786048:192.168.203.29@tcp:104: 00010000:00010000:3.0:1787560584.977031:0:13165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f33dd0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560584.977041:0:13165:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f33dd0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560584.977048:0:13165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f33dd0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560584.977053:0:13165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f33dd0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560585.204979:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560585.218970:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560585.219015:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560585.219035:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560585.219064:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560585.219093:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853268352 00000100:00100000:0.0:1787560585.219102:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853268352 00000100:00100000:0.0:1787560585.219154:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853268608 00000100:00100000:0.0:1787560585.219158:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853268608 00000100:00100000:0.0:1787560585.219170:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853268480 00000100:00100000:0.0:1787560585.219172:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853268480 00000100:00100000:0.0:1787560585.219184:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853268736 00000100:00100000:0.0:1787560585.219186:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853268736 00000100:00100000:0.0:1787560585.219204:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 182 00000100:00080000:2.0:1787560585.219611:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787560585.219615:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560585.220533:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:2402:x1874392853268352:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560585.221383:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:2402:x1874392853268352:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 860us (2417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560585.221395:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 182 00000100:00100000:0.0:1787560585.221453:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 183 00000100:00100000:0.0:1787560585.221464:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2402:x1874392853268608:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560585.221494:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2402:x1874392853268608:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 34us (2479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560585.221500:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 183 00000100:00100000:0.0:1787560585.221513:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 184 00000100:00100000:0.0:1787560585.221519:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+5:2402:x1874392853268480:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560585.221546:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+5:2402:x1874392853268480:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 27us (2510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560585.221552:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 184 00000100:00100000:0.0:1787560585.221593:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 185 00000100:00100000:0.0:1787560585.221600:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2402:x1874392853268736:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560585.221627:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2402:x1874392853268736:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 28us (2563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560585.223861:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 185 00000100:00100000:1.0:1787560585.268596:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec393aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862787200:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787560585.268674:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560585.268850:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862787200 00000100:00100000:2.0:1787560585.268861:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862787200 00000100:00100000:2.0:1787560585.268924:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787560585.268936:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862787200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787560585.268972:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787560585.269028:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862787200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560585.269035:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787560585.269536:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec393aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862787200:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787560586.119878:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560586.119973:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853268864 00000100:00100000:2.0:1787560586.119986:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853268864 00000100:00100000:2.0:1787560586.120052:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 312 00000100:00100000:2.0:1787560586.120063:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+11:6179:x1874392853268864:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560586.120079:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560586.120099:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca48c00/0x4642c20bf2f33dd7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fbc6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560586.120126:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca48c00/0x4642c20bf2f33dd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbc6 expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560586.120137:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca48c00/0x4642c20bf2f33dd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbc6 expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560586.120146:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca48c00, rc 0) 00000100:00100000:2.0:1787560586.120218:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+12:6179:x1874392853268864:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 Request processed in 148us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560586.120225:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 312 00000100:00100000:2.0:1787560586.126754:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560586.126920:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853268992 00000100:00100000:1.0:1787560586.126929:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853268992 00000100:00100000:1.0:1787560586.126981:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 313 00000100:00100000:1.0:1787560586.126991:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+12:6179:x1874392853268992:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787560586.127134:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+12:6179:x1874392853268992:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 Request processed in 143us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560586.127151:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 313 00000100:00100000:1.0:1787560586.134906:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560586.134978:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853269120 00000100:00100000:0.0:1787560586.134987:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853269120 00000100:00100000:0.0:1787560586.135037:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 314 00000100:00100000:0.0:1787560586.135047:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+12:6179:x1874392853269120:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787560586.135194:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+12:6179:x1874392853269120:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 Request processed in 146us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560586.135203:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 314 10000000:01000000:2.0:1787560586.163702:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787560586.163729:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9caec1ef6000 from 7 10000000:01000000:2.0:1787560586.163734:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787560586.163781:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49600/0x4642c20bf2f33dde lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560586.163792:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffca49600/0x4642c20bf2f33dde lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560586.163802:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffca49600/0x4642c20bf2f33dde lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560586.163829:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3938700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862787328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787560586.163904:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560586.163959:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c86480 going to sleep for 11 seconds 00000100:00100000:3.0:1787560586.165640:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862787328 00000100:00100000:3.0:1787560586.165654:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862787328 00000100:00100000:3.0:1787560586.165758:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1787560586.165768:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:6497:x1874392862787328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787560586.165785:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560586.165802:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f33de5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33dde expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560586.165830:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f33de5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33dde expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560586.165858:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f33de5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33dde expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560586.165868:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f7000, rc 0) 00000100:00100000:3.0:1787560586.165933:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:6497:x1874392862787328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (2028us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560586.165940:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1787560586.166091:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3938700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862787328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560586.166109:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffca49600/0x4642c20bf2f33dde lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33de5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560586.166119:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffca49600/0x4642c20bf2f33dde lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33de5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560586.166206:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3938700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862787456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560586.166238:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560586.166273:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c86480 going to sleep for 11 seconds 00000100:00100000:1.0:1787560586.166322:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862787456 00000100:00100000:1.0:1787560586.166327:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862787456 00000100:00100000:1.0:1787560586.166358:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1787560586.166365:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:6497:x1874392862787456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787560586.166630:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:6497:x1874392862787456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 265us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560586.166636:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1787560586.166759:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3938700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862787456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560586.166788:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3938700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862787584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560586.166826:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560586.166841:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c86480 going to sleep for 11 seconds 00000100:00100000:2.0:1787560586.166859:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862787584 00000100:00100000:2.0:1787560586.166863:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862787584 00000100:00100000:2.0:1787560586.166891:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1787560586.166897:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:6497:x1874392862787584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560586.166979:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:6497:x1874392862787584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560586.166985:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1787560586.167025:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3938700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862787584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787560586.167668:0:13183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787560586.167722:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787560586.167739:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787560586.167749:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49600/0x4642c20bf2f33dde lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33de5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560586.167760:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffca49600/0x4642c20bf2f33dde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33de5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560586.167769:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787560586.167772:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cafeab05000 from 7 10000000:01000000:2.0:1787560586.167775:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787560586.167802:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49a00/0x4642c20bf2f33dec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560586.167810:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffca49a00/0x4642c20bf2f33dec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560586.167819:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffca49a00/0x4642c20bf2f33dec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560586.167836:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3938700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862787712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787560586.167882:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560586.167901:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c866c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560586.167917:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862787712 00000100:00100000:2.0:1787560586.167937:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862787712 00000100:00100000:2.0:1787560586.167968:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1787560586.167975:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:6497:x1874392862787712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560586.167986:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560586.167998:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca48000/0x4642c20bf2f33df3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33dec expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560586.168017:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca48000/0x4642c20bf2f33df3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33dec expref: 22 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560586.168027:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca48000/0x4642c20bf2f33df3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33dec expref: 22 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560586.168035:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca48000, rc 0) 00000100:00100000:2.0:1787560586.168067:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:6497:x1874392862787712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560586.168073:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1787560586.168106:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3938700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862787712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560586.168117:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffca49a00/0x4642c20bf2f33dec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33df3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560586.168125:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffca49a00/0x4642c20bf2f33dec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33df3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560586.168167:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3938700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862787840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560586.168198:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560586.168210:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c866c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560586.168221:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862787840 00000100:00100000:2.0:1787560586.168224:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862787840 00000100:00100000:2.0:1787560586.168244:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1787560586.168250:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:6497:x1874392862787840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560586.168357:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:6497:x1874392862787840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560586.168363:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1787560586.168390:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3938700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862787840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560586.168414:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3938700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862787968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560586.168473:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560586.168486:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c866c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560586.168496:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862787968 00000100:00100000:2.0:1787560586.168499:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862787968 00000100:00100000:2.0:1787560586.168518:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1787560586.168524:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5802450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:6497:x1874392862787968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560586.168597:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5802450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:6497:x1874392862787968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560586.168604:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1787560586.168644:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3938700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862787968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787560586.175594:0:13184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000100:00100000:2.0:1787560586.180637:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000020:01000000:2.0:1787560586.180679:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787560586.180721:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787560586.180733:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49a00/0x4642c20bf2f33dec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33df3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560586.180760:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffca49a00/0x4642c20bf2f33dec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33df3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560586.180774:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787560586.180776:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9caffba72800 from 7 10000000:01000000:2.0:1787560586.180780:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787560586.180818:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f33dfa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560586.180827:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f33dfa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560586.180838:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f33dfa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560586.180861:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3938700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862788096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787560586.180906:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560586.180940:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c866c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560586.180962:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853269248 00000100:00100000:2.0:1787560586.180968:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853269248 00000100:00100000:2.0:1787560586.181003:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862788096 00000100:00100000:2.0:1787560586.181005:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862788096 00000100:00100000:2.0:1787560586.181021:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 321 00000100:00100000:2.0:1787560586.181029:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5801450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+12:6179:x1874392853269248:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560586.181042:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560586.181054:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca49800/0x4642c20bf2f33e01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fbcd expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560586.181076:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca49800/0x4642c20bf2f33e01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbcd expref: 13 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560586.181105:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca49800/0x4642c20bf2f33e01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbcd expref: 13 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560586.181115:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca49800, rc 0) 00000100:00100000:2.0:1787560586.181160:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5801450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+13:6179:x1874392853269248:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 Request processed in 131us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560586.181166:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 321 00000100:00100000:2.0:1787560586.181190:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1787560586.181197:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5801850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:6497:x1874392862788096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560586.181203:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560586.181222:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33e08 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33dfa expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560586.181237:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33e08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33dfa expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560586.181245:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33e08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33dfa expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560586.181253:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca48400, rc 0) 00000100:00100000:2.0:1787560586.181281:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5801850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:6497:x1874392862788096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560586.181297:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1787560586.181422:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3938700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862788096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560586.181456:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f33dfa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33e08 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560586.181477:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f33dfa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33e08 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560586.181533:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3938700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862788224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560586.181559:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560586.181572:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c866c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560586.181583:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862788224 00000100:00100000:2.0:1787560586.181587:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862788224 00000100:00100000:2.0:1787560586.181603:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1787560586.181609:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5803450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:6497:x1874392862788224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560586.181705:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5803450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:6497:x1874392862788224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560586.181712:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1787560586.181737:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3938700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862788224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560586.181761:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3938700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862788352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560586.181797:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560586.181808:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c866c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560586.181819:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862788352 00000100:00100000:2.0:1787560586.181822:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862788352 00000100:00100000:2.0:1787560586.181838:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1787560586.181843:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5802850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:6497:x1874392862788352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560586.181911:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5802850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:6497:x1874392862788352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560586.181918:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1787560586.181961:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3938700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862788352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787560586.182632:0:13185:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787560586.182683:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787560586.182697:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787560586.182705:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f33dfa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33e08 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560586.182716:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f33dfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33e08 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560586.182726:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787560586.182728:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cb000817800 from 7 10000000:01000000:2.0:1787560586.182731:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787560586.182755:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49000/0x4642c20bf2f33e0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560586.182763:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffca49000/0x4642c20bf2f33e0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560586.182773:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffca49000/0x4642c20bf2f33e0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560586.182789:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3938700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862788480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787560586.182824:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560586.182839:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c86f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787560586.182856:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862788480 00000100:00100000:2.0:1787560586.182861:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862788480 00000100:00100000:2.0:1787560586.182883:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1787560586.182890:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5800c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:6497:x1874392862788480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560586.182912:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560586.182922:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f33e16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33e0f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560586.182940:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f33e16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33e0f expref: 24 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560586.182950:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f33e16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33e0f expref: 24 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560586.182958:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca49c00, rc 0) 00000100:00100000:2.0:1787560586.182987:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5800c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:6497:x1874392862788480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560586.182993:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1787560586.183024:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3938700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862788480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560586.183035:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffca49000/0x4642c20bf2f33e0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33e16 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560586.183044:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffca49000/0x4642c20bf2f33e0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33e16 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560586.183082:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3938700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862788608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560586.183104:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560586.183115:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd7c29a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787560586.183125:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862788608 00000100:00100000:2.0:1787560586.183128:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862788608 00000100:00100000:2.0:1787560586.183143:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1787560586.183149:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5803850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:6497:x1874392862788608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560586.183233:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5803850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:6497:x1874392862788608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 84us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560586.183240:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1787560586.183272:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3938700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862788608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560586.190494:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3938700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862788736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560586.190591:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560586.190632:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd7c29a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787560586.191115:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862788736 00000100:00100000:3.0:1787560586.191125:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862788736 00000100:00100000:3.0:1787560586.191180:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1787560586.191191:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5800450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:6497:x1874392862788736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787560586.191339:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5800450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:6497:x1874392862788736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560586.191347:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1787560586.191529:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3938700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862788736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787560586.192466:0:13186:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787560586.192701:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787560586.192723:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787560586.192734:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49000/0x4642c20bf2f33e0f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33e16 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560586.192746:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffca49000/0x4642c20bf2f33e0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33e16 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560586.193106:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560586.193834:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853269376 00000100:00100000:2.0:1787560586.193843:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853269376 00000100:00100000:2.0:1787560586.193887:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 328 00000100:00100000:2.0:1787560586.193897:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5800050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+13:6179:x1874392853269376:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560586.194031:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5800050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+13:6179:x1874392853269376:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 Request processed in 135us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560586.194039:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 328 00000100:00100000:2.0:1787560586.228459:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560586.228510:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853269504 00000100:00100000:3.0:1787560586.228521:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853269504 00000100:00100000:3.0:1787560586.228867:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 329 00010000:00010000:0.0:1787560586.228876:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560586.228895:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5802c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+13:6179:x1874392853269504:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787560586.229178:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5802c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+13:6179:x1874392853269504:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 Request processed in 286us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560586.235758:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 329 00000100:00100000:1.0:1787560586.804649:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787560586.804673:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862788864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787560586.804745:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560586.804826:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862788864 00000100:00100000:1.0:1787560586.804833:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862788864 00000100:00100000:1.0:1787560586.804882:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787560586.804892:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862788864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787560586.804917:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787560586.804957:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862788864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560586.804963:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:1.0:1787560586.804999:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcbbb800 x1874392862788864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560602 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560586.805014:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862788864:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787560586.805195:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787560586.805210:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec393a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862788992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787560586.805241:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560586.805292:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862788992 00000100:00100000:2.0:1787560586.805296:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862788992 00000100:00100000:2.0:1787560586.805326:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787560586.805333:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862788992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787560586.805343:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560586.805373:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862788992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560586.805389:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1787560586.805406:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787560586.805423:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec393a300 x1874392862788992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560602 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560586.805456:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec393a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862788992:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787560587.255633:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560587.828542:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2005f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862789120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560587.828611:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560587.828661:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862789632:0@lo:400:kworker.0 00000100:00100000:0.0:1787560587.828686:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560587.828704:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862790144:0@lo:400:kworker.0 00000100:00100000:0.0:1787560587.828727:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560587.828745:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862790656:0@lo:400:kworker.0 00000100:00100000:0.0:1787560587.828765:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560587.828788:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787560587.828795:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862789504:0@lo:400:kworker.0 00000100:00100000:0.0:1787560587.828819:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560587.828847:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862790016:0@lo:400:kworker.0 00000100:00100000:0.0:1787560587.828870:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560587.828887:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874392862790528:0@lo:400:kworker.0 00000100:00100000:0.0:1787560587.828907:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560587.828937:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862789248:0@lo:400:kworker.0 00000100:00100000:0.0:1787560587.828967:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560587.828991:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862789760:0@lo:400:kworker.0 00000100:00100000:0.0:1787560587.829028:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560587.829054:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862790272:0@lo:400:kworker.0 00000100:00100000:0.0:1787560587.829072:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560587.829086:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862790784:0@lo:400:kworker.0 00000100:00100000:0.0:1787560587.829105:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560587.829121:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787560587.829126:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862789376:0@lo:400:kworker.0 00000100:00100000:0.0:1787560587.829143:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560587.829156:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862789888:0@lo:400:kworker.0 00000100:00100000:0.0:1787560587.829175:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560587.829184:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874392862790400:0@lo:400:kworker.0 00000100:00100000:0.0:1787560587.829403:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560587.829473:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862789120 00000100:00100000:0.0:1787560587.829481:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862789120 00000100:00100000:0.0:1787560587.829542:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787560587.829552:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862789120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787560587.829582:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560587.829628:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862789120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560587.829641:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787560587.829664:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862789632 00000100:00100000:0.0:1787560587.829668:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862789632 00000100:00100000:0.0:1787560587.829685:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862790016 00000100:00100000:0.0:1787560587.829688:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862790016 00000100:00100000:0.0:1787560587.829699:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862790528 00000100:00100000:0.0:1787560587.829702:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862790528 00000100:00100000:0.0:1787560587.829713:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862789376 00000100:00100000:0.0:1787560587.829716:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862789376 00000100:00100000:0.0:1787560587.829725:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862789888 00000100:00100000:0.0:1787560587.829727:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862789888 00000100:00100000:0.0:1787560587.829739:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862790400 00000100:00100000:0.0:1787560587.829741:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862790400 00000100:00100000:0.0:1787560587.829753:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787560587.829758:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862789632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560587.829791:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862789632:12345-0@lo:400:kworker.0 Request processed in 33us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560587.829797:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787560587.829808:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787560587.829813:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862790016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560587.829841:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862790016:12345-0@lo:400:kworker.0 Request processed in 28us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560587.829847:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787560587.829858:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787560587.829864:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874392862790528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560587.829890:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874392862790528:12345-0@lo:400:kworker.0 Request processed in 27us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560587.829896:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787560587.829915:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787560587.829921:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862789376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560587.829956:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862789376:12345-0@lo:400:kworker.0 Request processed in 35us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560587.829962:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787560587.829973:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787560587.829978:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862789888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560587.830004:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862789888:12345-0@lo:400:kworker.0 Request processed in 27us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560587.830010:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787560587.830020:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787560587.830026:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874392862790400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560587.830050:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874392862790400:12345-0@lo:400:kworker.0 Request processed in 25us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560587.830055:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787560587.830073:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862790144 00000100:00100000:0.0:1787560587.830077:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862790144 00000100:00100000:0.0:1787560587.830092:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862790656 00000100:00100000:0.0:1787560587.830095:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862790656 00000100:00100000:0.0:1787560587.830103:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862790272 00000100:00100000:0.0:1787560587.830106:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862790272 00000100:00100000:0.0:1787560587.830113:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862790784 00000100:00100000:0.0:1787560587.830115:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862790784 00000100:00100000:0.0:1787560587.830129:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787560587.830147:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862790144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560587.830178:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862790144:12345-0@lo:400:kworker.0 Request processed in 44us (1451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560587.830193:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787560587.830413:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787560587.830423:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862790656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560587.830476:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862790656:12345-0@lo:400:kworker.0 Request processed in 55us (1710us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560587.830481:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787560587.830494:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787560587.830500:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862790272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560587.830526:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862790272:12345-0@lo:400:kworker.0 Request processed in 27us (1454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560587.830532:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787560587.830544:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787560587.830550:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862790784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560587.830575:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862790784:12345-0@lo:400:kworker.0 Request processed in 26us (1469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560587.830580:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787560587.830597:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862789248 00000100:00100000:1.0:1787560587.830601:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862789248 00000100:00100000:1.0:1787560587.830627:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1787560587.830633:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3625:x1874392862789248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560587.830661:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3625:x1874392862789248:12345-0@lo:400:kworker.0 Request processed in 28us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560587.830667:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1787560587.830705:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862789504 00000100:00100000:1.0:1787560587.830709:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862789504 00000100:00100000:1.0:1787560587.830733:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862789760 00000100:00100000:1.0:1787560587.830736:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862789760 00000100:00100000:1.0:1787560587.830759:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787560587.830765:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862789504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560587.830797:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862789504:12345-0@lo:400:kworker.0 Request processed in 33us (1978us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560587.830803:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787560587.830814:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787560587.830820:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862789760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560587.830850:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862789760:12345-0@lo:400:kworker.0 Request processed in 30us (1822us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560587.830856:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:1.0:1787560587.830897:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787560587.830901:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787560587.830904:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787560587.830953:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862789504:0@lo:400:kworker.0 00010000:00080000:1.0:1787560587.830968:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caff4b85f80 x1874392862790016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560587.830978:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862790016:0@lo:400:kworker.0 00010000:00080000:1.0:1787560587.830989:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caff4b87b80 x1874392862790528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560587.830998:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874392862790528:0@lo:400:kworker.0 00010000:00080000:1.0:1787560587.831009:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2005f80 x1874392862789120/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560603 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560587.831022:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2005f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862789120:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787560587.831033:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862789632:0@lo:400:kworker.0 00010000:00080000:1.0:1787560587.831054:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caff4b86a00 x1874392862790144/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560587.831062:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862790144:0@lo:400:kworker.0 00010000:00080000:1.0:1787560587.831071:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caff4b86d80 x1874392862790656/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560587.831077:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862790656:0@lo:400:kworker.0 00000100:00100000:1.0:1787560587.831160:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862789376:0@lo:400:kworker.0 00000100:00100000:1.0:1787560587.831170:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862789888:0@lo:400:kworker.0 00000100:00100000:1.0:1787560587.831178:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874392862790400:0@lo:400:kworker.0 00000100:00100000:1.0:1787560587.831186:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862789248:0@lo:400:kworker.0 00000100:00100000:1.0:1787560587.831194:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862789760:0@lo:400:kworker.0 00010000:00080000:1.0:1787560587.831575:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caff4b86680 x1874392862790272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560587.831585:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862790272:0@lo:400:kworker.0 00010000:00080000:1.0:1787560587.831596:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caff4b85500 x1874392862790784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560587.831604:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862790784:0@lo:400:kworker.0 00000100:00100000:2.0:1787560587.832373:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862790912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560587.832428:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560587.834791:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862790912 00000100:00100000:1.0:1787560587.834806:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862790912 00000100:00100000:1.0:1787560587.834866:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787560587.834877:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec393a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862790912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787560587.834919:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787560587.846459:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec393a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862790912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 11573us (14020us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560587.846474:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:2.0:1787560587.857370:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcbbb800 x1874392862790912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560603 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560587.857400:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862790912:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787560588.276853:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560589.299871:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560589.372166:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787560589.372191:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec393b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862791040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787560589.372273:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560589.372338:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862791040 00000100:00100000:2.0:1787560589.372346:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862791040 00000100:00100000:2.0:1787560589.372391:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787560589.372400:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec393a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862791040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787560589.372449:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787560589.372504:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec393a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862791040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560589.372511:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787560589.372553:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec393b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862791040:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1787560589.506567:0:13364:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787560590.324190:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560590.334733:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560590.334767:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560590.334796:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560590.334842:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560590.334862:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560590.335010:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853269888 00000100:00100000:1.0:1787560590.335019:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853269888 00000100:00100000:1.0:1787560590.335079:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853270144 00000100:00100000:1.0:1787560590.335082:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853270144 00000100:00100000:1.0:1787560590.335095:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853269760 00000100:00100000:1.0:1787560590.335098:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853269760 00000100:00100000:1.0:1787560590.335107:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853270016 00000100:00100000:1.0:1787560590.335109:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853270016 00000100:00100000:1.0:1787560590.335124:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 192 00000100:00100000:1.0:1787560590.335145:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec393ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+5:2402:x1874392853269888:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560590.335227:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec393ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+5:2402:x1874392853269888:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 84us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560590.335235:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 192 00000100:00100000:1.0:1787560590.335253:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 193 00000100:00100000:1.0:1787560590.335269:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2402:x1874392853270144:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560590.335294:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2402:x1874392853270144:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 26us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560590.335300:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 193 00000100:00100000:1.0:1787560590.335312:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 194 00000100:00100000:1.0:1787560590.335318:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec393b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+6:2402:x1874392853269760:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560590.335341:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec393b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+6:2402:x1874392853269760:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 23us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560590.335361:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 194 00000100:00100000:1.0:1787560590.335373:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 195 00000100:00100000:1.0:1787560590.335379:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2402:x1874392853270016:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560590.335402:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2402:x1874392853270016:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 24us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560590.335408:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 195 00000100:00100000:3.0:1787560590.336229:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853269632 00000100:00100000:3.0:1787560590.336237:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853269632 00000100:00100000:3.0:1787560590.336291:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 331 00000100:00100000:3.0:1787560590.336299:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+13:2402:x1874392853269632:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560590.336349:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+13:2402:x1874392853269632:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 52us (1625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560590.336357:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 331 00000100:00080000:2.0:1787560590.336597:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787560590.336602:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787560590.390857:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec393b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862791168:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787560590.390932:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560590.391091:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862791168 00000100:00100000:1.0:1787560590.391101:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862791168 00000100:00100000:1.0:1787560590.391163:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787560590.391174:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862791168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787560590.391204:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787560590.391264:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862791168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560590.391271:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787560590.391787:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec393b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862791168:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787560591.347884:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560591.925069:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862791424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787560591.925147:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560591.925225:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787560591.925233:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862791296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787560591.925268:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560591.925461:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862791424 00000100:00100000:2.0:1787560591.925469:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862791424 00000100:00100000:2.0:1787560591.925528:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862791296 00000100:00100000:2.0:1787560591.925533:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862791296 00000100:00100000:2.0:1787560591.925551:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787560591.925560:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862791424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787560591.925603:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560591.925653:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862791424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560591.925660:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787560591.925676:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787560591.925682:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862791296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787560591.925692:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560591.925716:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862791296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560591.925721:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:2.0:1787560591.925755:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3938700 x1874392862791296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560607 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560591.925775:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862791296:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1787560591.925787:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcbb9c00 x1874392862791424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560607 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560591.925798:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862791424:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787560591.926646:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787560592.371664:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560592.948125:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862791552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787560592.948207:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560592.948415:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862791552 00000100:00100000:2.0:1787560592.948423:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862791552 00000100:00100000:2.0:1787560592.948490:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787560592.948501:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862791552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787560592.948529:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560592.948571:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862791552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560592.948578:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1787560592.948614:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787560592.948714:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862791680:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787560592.948746:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787560592.948930:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcbb9880 x1874392862791552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560608 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560592.948948:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862791552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560592.949005:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862791680 00000100:00100000:2.0:1787560592.949010:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862791680 00000100:00100000:2.0:1787560592.949119:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787560592.949126:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862791680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787560592.949137:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560592.949180:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862791680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560592.949186:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:2.0:1787560592.949211:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3938700 x1874392862791680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560608 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560592.949224:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862791680:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1787560592.949335:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787560592.949781:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862791808:0@lo:400:kworker.0 00000100:00100000:3.0:1787560592.949816:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560592.950196:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec393aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862791936:0@lo:400:kworker.0 00000100:00100000:0.0:1787560592.950233:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560592.950289:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862791936 00000100:00100000:0.0:1787560592.950295:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862791936 00000100:00100000:0.0:1787560592.950328:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787560592.950335:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862791936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560592.950374:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862791936:12345-0@lo:400:kworker.0 Request processed in 40us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560592.950381:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787560592.950409:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec393aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862791936:0@lo:400:kworker.0 00000100:00100000:1.0:1787560592.950567:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862791808 00000100:00100000:1.0:1787560592.950571:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862791808 00000100:00100000:1.0:1787560592.950622:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1787560592.950630:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3625:x1874392862791808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560592.951073:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec393b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862792192:0@lo:400:kworker.0 00000100:00100000:2.0:1787560592.951102:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560592.951120:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff48f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862792704:0@lo:400:kworker.0 00000100:00100000:2.0:1787560592.951141:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560592.951170:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787560592.951187:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec393aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862792064:0@lo:400:kworker.0 00000100:00100000:2.0:1787560592.951210:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560592.951224:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862792576:0@lo:400:kworker.0 00000100:00100000:2.0:1787560592.951251:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560592.951266:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff48fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874392862793088:0@lo:400:kworker.0 00000100:00100000:2.0:1787560592.951283:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560592.951305:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862792192 00000100:00100000:2.0:1787560592.951308:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862792192 00000100:00100000:2.0:1787560592.951329:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862792576 00000100:00100000:2.0:1787560592.951331:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862792576 00000100:00100000:2.0:1787560592.951348:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862793088 00000100:00100000:2.0:1787560592.951350:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862793088 00000100:00100000:2.0:1787560592.951362:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787560592.951367:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862792192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560592.951403:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862792192:12345-0@lo:400:kworker.0 Request processed in 36us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560592.951408:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787560592.951422:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787560592.951428:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862792576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560592.951473:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862792576:12345-0@lo:400:kworker.0 Request processed in 45us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560592.951478:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787560592.951488:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787560592.951495:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874392862793088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560592.951517:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874392862793088:12345-0@lo:400:kworker.0 Request processed in 24us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560592.951532:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787560592.951551:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862792704 00000100:00100000:2.0:1787560592.951555:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862792704 00000100:00100000:2.0:1787560592.951579:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787560592.951598:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862792704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560592.951630:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862792704:12345-0@lo:400:kworker.0 Request processed in 45us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560592.951635:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787560592.951652:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862792064 00000100:00100000:2.0:1787560592.951655:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862792064 00000100:00100000:2.0:1787560592.951677:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787560592.951683:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862792064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560592.951712:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862792064:12345-0@lo:400:kworker.0 Request processed in 29us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560592.951717:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1787560592.951758:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787560592.951772:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862792448:0@lo:400:kworker.0 00000100:00100000:2.0:1787560592.951795:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560592.951811:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff48f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862792960:0@lo:400:kworker.0 00000100:00100000:2.0:1787560592.951829:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560592.951844:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787560592.951850:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862792320:0@lo:400:kworker.0 00000100:00100000:2.0:1787560592.951868:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560592.951882:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff48f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862792832:0@lo:400:kworker.0 00000100:00100000:2.0:1787560592.951898:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560592.951930:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862792320 00000100:00100000:2.0:1787560592.951933:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862792320 00000100:00100000:2.0:1787560592.951955:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787560592.951960:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862792320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560592.951990:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862792320:12345-0@lo:400:kworker.0 Request processed in 30us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560592.951996:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787560592.952009:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862792832 00000100:00100000:2.0:1787560592.952012:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862792832 00000100:00100000:2.0:1787560592.952031:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787560592.952038:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862792832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560592.952064:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862792832:12345-0@lo:400:kworker.0 Request processed in 27us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560592.952070:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787560592.952087:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862792448 00000100:00100000:2.0:1787560592.952090:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862792448 00000100:00100000:2.0:1787560592.952113:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862792960 00000100:00100000:2.0:1787560592.952116:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862792960 00000100:00100000:2.0:1787560592.952134:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787560592.952140:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862792448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560592.952167:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862792448:12345-0@lo:400:kworker.0 Request processed in 27us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560592.952172:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787560592.952184:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787560592.952190:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862792960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560592.952214:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862792960:12345-0@lo:400:kworker.0 Request processed in 25us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560592.952229:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:2.0:1787560592.952256:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560592.952284:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862792320:0@lo:400:kworker.0 00010000:00080000:2.0:1787560592.952295:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caff48f8000 x1874392862792832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560592.952305:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff48f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862792832:0@lo:400:kworker.0 00000100:00100000:2.0:1787560592.952313:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862792448:0@lo:400:kworker.0 00000100:00100000:2.0:1787560592.952320:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff48f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862792960:0@lo:400:kworker.0 00000100:00100000:2.0:1787560592.952345:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec393aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862792064:0@lo:400:kworker.0 00010000:00080000:2.0:1787560592.952355:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcaa8380 x1874392862792576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560592.952363:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862792576:0@lo:400:kworker.0 00010000:00080000:2.0:1787560592.952372:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caff48fb480 x1874392862793088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560592.952380:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff48fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874392862793088:0@lo:400:kworker.0 00000100:00100000:2.0:1787560592.952388:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec393b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862792192:0@lo:400:kworker.0 00010000:00080000:2.0:1787560592.952395:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caff48f8380 x1874392862792704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560592.952403:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff48f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862792704:0@lo:400:kworker.0 00000100:00100000:1.0:1787560592.953543:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3625:x1874392862791808:12345-0@lo:400:kworker.0 Request processed in 2907us (3718us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560592.953556:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1787560592.953828:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862791808:0@lo:400:kworker.0 00010000:00010000:2.0:1787560593.395560:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560594.419661:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560594.484381:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560594.484403:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff48f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862793216:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787560594.484492:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560594.484802:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862793216 00000100:00100000:2.0:1787560594.484825:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862793216 00000100:00100000:2.0:1787560594.484884:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787560594.484893:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862793216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787560594.484928:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787560594.484999:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862793216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560594.485006:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787560594.485090:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff48f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862793216:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1787560595.135280:0:13513:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 04:36:33 (1787560593) === 00010000:00010000:3.0:1787560595.443716:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560595.454809:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560595.454852:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560595.454885:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560595.454913:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560595.454940:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560595.454968:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853270528 00000100:00100000:2.0:1787560595.454976:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853270528 00000100:00100000:2.0:1787560595.455036:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853270784 00000100:00100000:2.0:1787560595.455039:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853270784 00000100:00100000:2.0:1787560595.455054:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853270400 00000100:00100000:2.0:1787560595.455057:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853270400 00000100:00100000:2.0:1787560595.455068:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853270656 00000100:00100000:2.0:1787560595.455070:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853270656 00000100:00100000:2.0:1787560595.455085:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 202 00000100:00100000:2.0:1787560595.455094:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853270528:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560595.455471:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853270528:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 376us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560595.455480:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 202 00000100:00100000:2.0:1787560595.455499:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 203 00000100:00100000:2.0:1787560595.455507:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853270784:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560595.455550:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853270784:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 43us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560595.455556:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 203 00000100:00100000:2.0:1787560595.455568:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 204 00000100:00100000:2.0:1787560595.455574:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+6:2403:x1874392853270400:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560595.455692:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 205 00000100:00100000:3.0:1787560595.455702:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853270656:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560595.455730:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853270656:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 31us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560595.455736:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 205 00000100:00100000:2.0:1787560595.455961:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+6:2403:x1874392853270400:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 385us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560595.455968:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 204 00000100:00080000:2.0:1787560595.455990:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787560595.455994:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787560595.456527:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853270272 00000100:00100000:1.0:1787560595.456534:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853270272 00000100:00100000:1.0:1787560595.456588:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 333 00000100:00100000:1.0:1787560595.456897:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+13:2403:x1874392853270272:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560595.456951:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+13:2403:x1874392853270272:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 355us (2150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560595.456958:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 333 00000100:00100000:0.0:1787560595.509796:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff48f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862793344:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787560595.509875:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560595.510079:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862793344 00000100:00100000:2.0:1787560595.510088:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862793344 00000100:00100000:2.0:1787560595.510144:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787560595.510154:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862793344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787560595.510188:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787560595.510246:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862793344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560595.510253:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787560595.510388:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff48f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862793344:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787560595.610303:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560595.610559:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560595.610678:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853271040 00000100:00100000:3.0:1787560595.610698:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853271040 00000100:00100000:3.0:1787560595.610754:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:3.0:1787560595.610766:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9331bacf-6cfc-4379-8649-925e79b19df1+6:10495:x1874392853271040:12345-192.168.203.29@tcp:700:mkdir.0 00000100:00100000:3.0:1787560595.610858:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9331bacf-6cfc-4379-8649-925e79b19df1+6:10495:x1874392853271040:12345-192.168.203.29@tcp:700:mkdir.0 Request processed in 93us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560595.610866:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:3.0:1787560595.614764:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853270912 00000100:00100000:3.0:1787560595.614781:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853270912 00000100:00100000:3.0:1787560595.614910:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:3.0:1787560595.614922:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:2402:x1874392853270912:12345-192.168.203.29@tcp:41:mkdir.0 00000004:00000024:3.0:1787560595.614960:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787560595.615069:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:2402:x1874392853270912:12345-192.168.203.29@tcp:41:mkdir.0 Request processed in 150us (4509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560595.615076:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:2.0:1787560595.616501:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560595.616602:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853271296 00000100:00100000:0.0:1787560595.616610:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853271296 00000100:00100000:0.0:1787560595.616689:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:0.0:1787560595.616699:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+6:10495:x1874392853271296:12345-192.168.203.29@tcp:36:mkdir.0 00010000:00010000:0.0:1787560595.616770:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560595.616819:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f33cbf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb41 expref: 6 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.616840:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec1e6b800) 00010000:00010000:0.0:1787560595.616865:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787560595.616957:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880600/0x4642c20bf2f33e1d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.616970:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880600/0x4642c20bf2f33e1d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.616981:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880600/0x4642c20bf2f33e1d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.616995:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f33e24 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.617002:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f33e24 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.617023:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f33e24 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.617571:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f33e2b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.617580:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f33e2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.617587:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f33e2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787560595.617602:0:6499:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009fc2d63b reply state 0000000089e772e9 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f33e2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.617612:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f33e2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.617619:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9caec1e6b400) 00010000:00010000:0.0:1787560595.617622:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787560595.617624:0:6499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787560595.617629:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787560595.617635:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880600/0x4642c20bf2f33e1d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.617641:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880600/0x4642c20bf2f33e1d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.617647:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880600/0x4642c20bf2f33e1d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.617653:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560595.617663:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880600/0x4642c20bf2f33e1d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.617671:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880600/0x4642c20bf2f33e1d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.617680:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:0.0:1787560595.617682:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560595.617686:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880600/0x4642c20bf2f33e1d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.617692:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880600/0x4642c20bf2f33e1d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787560595.617707:0:6499:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009fc2d63b reply state 0000000089e772e9 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f33e24 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.617714:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f33e24 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.617721:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9caec1e6b000) 00010000:00010000:0.0:1787560595.617723:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787560595.617725:0:6499:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1787560595.617801:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+7:10495:x1874392853271296:12345-192.168.203.29@tcp:36:mkdir.0 Request processed in 1102us (1303us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787560595.617808:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:0.0:1787560595.632564:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560595.632651:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853271424 00000100:00100000:2.0:1787560595.632660:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853271424 00000100:00100000:2.0:1787560595.632717:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00100000:2.0:1787560595.632727:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+7:10496:x1874392853271424:12345-192.168.203.29@tcp:101:chmod.0 00010000:00010000:2.0:1787560595.632748:0:10172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560595.632778:0:10172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48e00/0x4642c20bf2f33e32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fbd4 expref: -99 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.632843:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49200/0x4642c20bf2f33e39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.632856:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49200/0x4642c20bf2f33e39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.632867:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49200/0x4642c20bf2f33e39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560595.632912:0:10172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787560595.632916:0:10172:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787560595.633022:0:10172:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49200/0x4642c20bf2f33e39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.633049:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48e00/0x4642c20bf2f33e32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbd4 expref: 9 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.633069:0:10172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49200/0x4642c20bf2f33e39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbd4 expref: 8 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.633077:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafef7ced00) 00010000:00010000:2.0:1787560595.633079:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787560595.633083:0:10172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca49200, rc 0) 00000100:00100000:2.0:1787560595.633270:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+8:10496:x1874392853271424:12345-192.168.203.29@tcp:101:chmod.0 Request processed in 543us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560595.633278:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00100000:1.0:1787560595.649756:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560595.649856:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853271680 00000100:00100000:0.0:1787560595.649865:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853271680 00000100:00100000:0.0:1787560595.649927:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 25 00000100:00100000:0.0:1787560595.649948:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+8:10496:x1874392853271680:12345-192.168.203.29@tcp:36:chmod.0 00010000:00010000:0.0:1787560595.650018:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560595.650044:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49200/0x4642c20bf2f33e39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbd4 expref: 8 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.650065:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafef7ced00) 00010000:00010000:0.0:1787560595.650074:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787560595.650105:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880600/0x4642c20bf2f33e40 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.650117:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880600/0x4642c20bf2f33e40 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.650128:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880600/0x4642c20bf2f33e40 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787560595.650318:0:6500:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000421993be reply state 0000000047f498e7 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880600/0x4642c20bf2f33e40 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.650331:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880600/0x4642c20bf2f33e40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.650337:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:0.0:1787560595.650340:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787560595.650342:0:6500:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787560595.650349:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787560595.650456:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+9:10496:x1874392853271680:12345-192.168.203.29@tcp:36:chmod.0 Request processed in 491us (681us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787560595.650463:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 25 00000100:00100000:1.0:1787560595.672830:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560595.672911:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853271808 00000100:00100000:3.0:1787560595.672922:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853271808 00000100:00100000:3.0:1787560595.672981:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 26 00000100:00100000:3.0:1787560595.672991:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+9:10497:x1874392853271808:12345-192.168.203.29@tcp:101:chown.0 00010000:00010000:3.0:1787560595.673027:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560595.673052:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f33e47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fbdb expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.673132:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f33e4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.673146:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f33e4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.673160:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f33e4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560595.673207:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787560595.673210:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787560595.673257:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f33e4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.673283:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f33e47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbdb expref: 11 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.673301:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f33e4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbdb expref: 10 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.673310:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:3.0:1787560595.673313:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787560595.673316:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f7600, rc 0) 00000100:00100000:3.0:1787560595.673378:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+10:10497:x1874392853271808:12345-192.168.203.29@tcp:101:chown.0 Request processed in 388us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560595.673385:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 26 00000100:00100000:3.0:1787560595.677130:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560595.677240:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853271936 00000100:00100000:0.0:1787560595.677250:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853271936 00000100:00100000:0.0:1787560595.677324:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 27 00000100:00100000:0.0:1787560595.677333:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+10:10497:x1874392853271936:12345-192.168.203.29@tcp:101:chown.0 00010000:00010000:0.0:1787560595.677353:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560595.677373:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f33e55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fbe2 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.677476:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881400/0x4642c20bf2f33e5c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.677489:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881400/0x4642c20bf2f33e5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.677500:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881400/0x4642c20bf2f33e5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.677512:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f33e63 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.677519:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f33e63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.677525:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f33e63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.677588:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f33e6a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.677597:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f33e6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.677603:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f33e6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560595.677649:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787560595.677653:0:6500:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787560595.677672:0:6500:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f33e6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.677684:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881400/0x4642c20bf2f33e5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.677690:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881400/0x4642c20bf2f33e5c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.677697:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881400/0x4642c20bf2f33e5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.677702:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881400 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560595.677706:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881400/0x4642c20bf2f33e5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.677714:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881400/0x4642c20bf2f33e5c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.677726:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:0.0:1787560595.677729:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560595.677734:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881400/0x4642c20bf2f33e5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.677739:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881400/0x4642c20bf2f33e5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.677752:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f33e63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.677768:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f33e63 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.677786:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f33e63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.677792:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880c00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560595.677795:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f33e63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.677801:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f33e63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.677810:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9caec1e6b000) 00010000:00010000:0.0:1787560595.677812:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560595.677815:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f33e63 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.677820:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f33e63 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.677847:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f33e55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbe2 expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.677859:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f33e6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbe2 expref: 11 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.677866:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9caec1e6b400) 00010000:00010000:0.0:1787560595.677869:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787560595.677877:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881a00, rc 0) 00000100:00100000:0.0:1787560595.677930:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+11:10497:x1874392853271936:12345-192.168.203.29@tcp:101:chown.0 Request processed in 597us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560595.677937:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 27 00000100:00100000:1.0:1787560595.680119:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560595.680211:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853272064 00000100:00100000:2.0:1787560595.680241:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853272064 00000100:00100000:2.0:1787560595.680292:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:2.0:1787560595.680302:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9331bacf-6cfc-4379-8649-925e79b19df1+11:10497:x1874392853272064:12345-192.168.203.29@tcp:900:chown.0 00000100:00100000:2.0:1787560595.680378:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9331bacf-6cfc-4379-8649-925e79b19df1+11:10497:x1874392853272064:12345-192.168.203.29@tcp:900:chown.0 Request processed in 77us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560595.680386:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:2.0:1787560595.683271:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560595.683373:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853272320 00000100:00100000:3.0:1787560595.683384:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853272320 00000100:00100000:3.0:1787560595.683474:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 28 00000100:00100000:3.0:1787560595.683486:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+11:10497:x1874392853272320:12345-192.168.203.29@tcp:36:chown.0 00010000:00010000:3.0:1787560595.683540:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560595.683567:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f33e6a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbe2 expref: 11 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.683586:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9caec1e6b400) 00010000:00010000:3.0:1787560595.683591:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787560595.683614:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f33e71 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.683628:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f33e71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.683640:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f33e71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787560595.689317:0:6478:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:0.0:1787560595.689427:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f33e24 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.689500:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f33e24 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.689508:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f33e24 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.689514:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560595.689519:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f33e24 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.689526:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f33e24 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787560595.689999:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c5aa4fa reply state 0000000003c5fd66 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f33e71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.690020:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f33e71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.690029:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9caec1e6b400) 00010000:00010000:2.0:1787560595.690031:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787560595.690035:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787560595.690048:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787560595.690062:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9caec1e6b000) 00010000:00010000:0.0:1787560595.690066:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560595.690070:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f33e24 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.690077:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f33e24 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.690098:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f33e2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.690105:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f33e2b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1787560595.690165:0:6498:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00010000:00010000:0.0:1787560595.690198:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f33e2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.690204:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881c00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560595.690207:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f33e2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.690213:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f33e2b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.690236:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9caec1e6b400) 00010000:00010000:0.0:1787560595.690240:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560595.690243:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f33e2b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.690249:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f33e2b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.690264:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880600/0x4642c20bf2f33e40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.690271:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880600/0x4642c20bf2f33e40 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.690277:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880600/0x4642c20bf2f33e40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.690282:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560595.690285:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880600/0x4642c20bf2f33e40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.690301:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880600/0x4642c20bf2f33e40 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.690309:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:0.0:1787560595.690311:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787560595.690314:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880600/0x4642c20bf2f33e40 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.690320:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880600/0x4642c20bf2f33e40 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560595.690371:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+7:10497:x1874392853272320:12345-192.168.203.29@tcp:36:chown.0 Request processed in 6882us (7104us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787560595.690380:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 28 00010000:00010000:3.0:1787560595.694201:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f33e71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.694227:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f33e71 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.694236:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f33e71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.694242:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7c00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560595.694263:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f33e71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.694271:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f33e71 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.694288:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9caec1e6b400) 00010000:00010000:3.0:1787560595.694292:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787560595.694297:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f33e71 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.694303:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f33e71 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560595.704603:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560595.705001:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853272448 00000100:00100000:0.0:1787560595.705012:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853272448 00000100:00100000:0.0:1787560595.705073:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 29 00000100:00100000:0.0:1787560595.705083:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+6:10498:x1874392853272448:12345-192.168.203.29@tcp:101:touch.500 00010000:00010000:0.0:1787560595.705105:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560595.705125:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880600/0x4642c20bf2f33e78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fbe9 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787560595.707364:0:6500:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2179us 00010000:00010000:2.0:1787560595.719695:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48e00/0x4642c20bf2f33e7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.719719:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48e00/0x4642c20bf2f33e7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.719732:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48e00/0x4642c20bf2f33e7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.719748:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49200/0x4642c20bf2f33e86 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.719766:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49200/0x4642c20bf2f33e86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.719772:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49200/0x4642c20bf2f33e86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.720312:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f33e8d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.720322:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f33e8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.720330:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f33e8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560595.720364:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787560595.720368:0:6500:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787560595.720407:0:6500:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f33e8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.720421:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48e00/0x4642c20bf2f33e7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.720427:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48e00/0x4642c20bf2f33e7f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.720693:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48e00/0x4642c20bf2f33e7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.720699:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca48e00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560595.720704:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48e00/0x4642c20bf2f33e7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.720716:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48e00/0x4642c20bf2f33e7f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.720728:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:2.0:1787560595.720731:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560595.720736:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48e00/0x4642c20bf2f33e7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.720742:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48e00/0x4642c20bf2f33e7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.720754:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49200/0x4642c20bf2f33e86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.720760:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49200/0x4642c20bf2f33e86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.720765:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49200/0x4642c20bf2f33e86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.720770:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560595.720772:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49200/0x4642c20bf2f33e86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.720777:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49200/0x4642c20bf2f33e86 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.720784:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9cafef7cef00) 00010000:00010000:2.0:1787560595.720786:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560595.720789:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49200/0x4642c20bf2f33e86 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.720963:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49200/0x4642c20bf2f33e86 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.721008:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880600/0x4642c20bf2f33e78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbe9 expref: 8 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.721022:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f33e8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbe9 expref: 7 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.721030:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9cafef7ce800) 00010000:00010000:2.0:1787560595.721032:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787560595.721035:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2169000, rc 0) 00000100:00100000:2.0:1787560595.721208:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+7:10498:x1874392853272448:12345-192.168.203.29@tcp:101:touch.500 Request processed in 16124us (16613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560595.721230:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 29 00000100:00100000:0.0:1787560595.723842:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560595.725452:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853272704 00000100:00100000:2.0:1787560595.725470:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853272704 00000100:00100000:2.0:1787560595.725556:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 30 00000100:00100000:2.0:1787560595.725568:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+7:10498:x1874392853272704:12345-192.168.203.29@tcp:101:touch.500 00010000:00010000:2.0:1787560595.725588:0:10172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560595.725608:0:10172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f33e94 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fbf0 expref: -99 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.725714:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f33e9b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.725728:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f33e9b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.725752:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f33e9b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.725802:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f33ea2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.725811:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f33ea2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.725817:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f33ea2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787560595.726215:0:10172:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1787560595.726352:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f33ea9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.726362:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f33ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.726370:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f33ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.726397:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f33e9b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.726405:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f33e9b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.726411:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f33e9b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.726418:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560595.726428:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f33e9b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.726456:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f33e9b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.726467:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9cafef7ce800) 00010000:00010000:2.0:1787560595.726470:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560595.726474:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f33e9b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.726480:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f33e9b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787560595.726493:0:10172:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c9bd62e reply state 0000000037279721 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f33ea2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.726502:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f33ea2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.726508:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff9cafef7ced00) 00010000:00010000:2.0:1787560595.726511:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787560595.726513:0:10172:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787560595.726539:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f33e94 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbf0 expref: 10 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.726553:0:10172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f33ea9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbf0 expref: 9 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.726560:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9cafef7ce300) 00010000:00010000:2.0:1787560595.726562:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787560595.726570:0:10172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2168400, rc 0) 00000100:00100000:2.0:1787560595.726633:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+10:10498:x1874392853272704:12345-192.168.203.29@tcp:101:touch.500 Request processed in 1067us (2799us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787560595.726640:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 30 00000100:00100000:2.0:1787560595.731474:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560595.731694:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853272960 00000100:00100000:0.0:1787560595.731704:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853272960 00000100:00100000:0.0:1787560595.731761:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 31 00000100:00100000:0.0:1787560595.731771:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+10:10498:x1874392853272960:12345-192.168.203.29@tcp:36:touch.500 00010000:00010000:0.0:1787560595.731825:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560595.731849:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f33ea9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbf0 expref: 10 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.731882:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9cafef7ce300) 00010000:00010000:0.0:1787560595.731893:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787560595.731964:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f33eb7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.731977:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f33eb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.731986:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f33eb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787560595.732077:0:6499:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f1ee9bc reply state 000000009e8e85b0 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f33eb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.732089:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f33eb7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.732096:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9caec1e6b000) 00010000:00010000:0.0:1787560595.732099:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787560595.732101:0:6499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787560595.732197:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+11:10498:x1874392853272960:12345-192.168.203.29@tcp:36:touch.500 Request processed in 427us (736us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787560595.732204:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 31 00000100:00100000:1.0:1787560595.735606:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560595.735775:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853273088 00000100:00100000:2.0:1787560595.735784:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853273088 00000100:00100000:2.0:1787560595.735840:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 32 00000100:00100000:2.0:1787560595.735851:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+11:10498:x1874392853273088:12345-192.168.203.29@tcp:101:touch.500 00010000:00010000:2.0:1787560595.735873:0:10172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560595.735892:0:10172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f33ebe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fbf7 expref: -99 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.735946:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f33ebe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbf7 expref: 12 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.735961:0:10172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f33ebe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbf7 expref: 12 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.735980:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9caec1e6b000) 00010000:00010000:2.0:1787560595.735984:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787560595.735988:0:10172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2168a00, rc 0) 00000100:00100000:2.0:1787560595.736047:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+12:10498:x1874392853273088:12345-192.168.203.29@tcp:101:touch.500 Request processed in 197us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560595.736054:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 32 00000100:00100000:1.0:1787560595.752475:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560595.752574:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853273216 00000100:00100000:2.0:1787560595.752585:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853273216 00000100:00100000:2.0:1787560595.752635:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00100000:2.0:1787560595.752659:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2401:x1874392853273216:12345-192.168.203.29@tcp:8:touch.500 00010000:00080000:2.0:1787560595.752695:0:8415:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 9331bacf-6cfc-4379-8649-925e79b19df1@192.168.203.29@tcp t0 exp 0000000000000000 cur 315 last 0 00000020:00000080:2.0:1787560595.752732:0:8415:0:(genops.c:1385:class_connect()) connect: client 9331bacf-6cfc-4379-8649-925e79b19df1, cookie 0x4642c20bf2f33ec5 00002000:00100000:2.0:1787560595.752746:0:8415:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9331bacf-6cfc-4379-8649-925e79b19df1/ffff9cafffe2e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787560595.752763:0:8415:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:2.0:1787560595.752834:0:8415:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787560595.752866:0:8415:0:(import.c:65:import_set_state_nolock()) ffff9cafffe2c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787560595.752939:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+6:2401:x1874392853273216:12345-192.168.203.29@tcp:8:touch.500 Request processed in 280us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560595.752947:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00100000:1.0:1787560595.764688:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560595.767784:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853273344 00000100:00100000:2.0:1787560595.767800:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853273344 00000100:00100000:2.0:1787560595.767939:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 25 00000100:00100000:2.0:1787560595.767951:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:0:x1874392853273344:12345-192.168.203.29@tcp:2:touch.500 00000001:00080000:1.0:1787560595.771056:0:9491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:1.0:1787560595.771071:0:9491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9331bacf-6cfc-4379-8649-925e79b19df1 00000100:00100000:2.0:1787560595.771367:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+5:0:x1874392853273344:12345-192.168.203.29@tcp:2:touch.500 Request processed in 3413us (6683us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787560595.771379:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 25 00000100:00080000:3.0:1787560595.773047:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787560595.775078:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560595.775282:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853273600 00000100:00100000:3.0:1787560595.775293:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853273600 00000100:00100000:3.0:1787560595.775352:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:3.0:1787560595.775362:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+12:10498:x1874392853273600:12345-192.168.203.29@tcp:35:touch.500 00000100:00100000:3.0:1787560595.775730:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+13:10498:x1874392853273600:12345-192.168.203.29@tcp:35:touch.500 Request processed in 368us (660us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787560595.775738:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:1.0:1787560595.795950:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560595.796314:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853273728 00000100:00100000:0.0:1787560595.796324:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853273728 00000100:00100000:0.0:1787560595.796390:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 33 00000100:00100000:0.0:1787560595.796400:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+13:10499:x1874392853273728:12345-192.168.203.29@tcp:101:rm.0 00010000:00010000:0.0:1787560595.796483:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560595.796515:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881400/0x4642c20bf2f33ecc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fbfe expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.796596:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f33ed3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.796611:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f33ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.796623:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f33ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560595.796665:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787560595.796669:0:6499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787560595.796719:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f33ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.796747:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881400/0x4642c20bf2f33ecc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbfe expref: 15 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.796765:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f33ed3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbfe expref: 14 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.796775:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9cafef7ce800) 00010000:00010000:0.0:1787560595.796778:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787560595.796782:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881000, rc 0) 00000100:00100000:1.0:1787560595.797714:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+14:10499:x1874392853273728:12345-192.168.203.29@tcp:101:rm.0 Request processed in 1302us (1761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560595.797724:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 33 00000100:00100000:0.0:1787560595.801405:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560595.801779:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853273984 00000100:00100000:2.0:1787560595.801788:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853273984 00000100:00100000:2.0:1787560595.801971:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 34 00000100:00100000:2.0:1787560595.801985:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+14:10499:x1874392853273984:12345-192.168.203.29@tcp:101:rm.0 00010000:00010000:2.0:1787560595.802007:0:10172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560595.802026:0:10172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f33eda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fc05 expref: -99 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560595.802143:0:10172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787560595.802352:0:10172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f33eda lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc05 expref: 16 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.802367:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:2.0:1787560595.802370:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787560595.802375:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f33eda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc05 expref: 16 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.802388:0:10172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2168e00, rc 0) 00000100:00100000:2.0:1787560595.802899:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+15:10499:x1874392853273984:12345-192.168.203.29@tcp:101:rm.0 Request processed in 915us (1501us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1787560595.802907:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 34 00000100:00100000:0.0:1787560595.806085:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560595.806208:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853274112 00000100:00100000:3.0:1787560595.806228:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853274112 00000100:00100000:3.0:1787560595.806290:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:3.0:1787560595.806301:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+15:10499:x1874392853274112:12345-192.168.203.29@tcp:37:rm.0 00000100:00100000:0.0:1787560595.810653:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+15:10499:x1874392853274112:12345-192.168.203.29@tcp:37:rm.0 Request processed in 4343us (4567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560595.810690:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:1.0:1787560595.817253:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560595.820840:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853274368 00000100:00100000:2.0:1787560595.820855:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853274368 00000100:00100000:2.0:1787560595.820924:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:2.0:1787560595.820936:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd7c04450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+15:10499:x1874392853274368:12345-192.168.203.29@tcp:35:rm.0 00000100:00100000:2.0:1787560595.821470:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd7c04450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+16:10499:x1874392853274368:12345-192.168.203.29@tcp:35:rm.0 Request processed in 533us (4223us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787560595.821478:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:1.0:1787560595.828542:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560595.828821:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853274624 00000100:00100000:2.0:1787560595.828831:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853274624 00000100:00100000:2.0:1787560595.828898:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 35 00000100:00100000:2.0:1787560595.828909:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+16:10499:x1874392853274624:12345-192.168.203.29@tcp:101:rm.0 00010000:00010000:2.0:1787560595.828934:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560595.828969:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f33ee8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fc0c expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.829075:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f33eef lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.829089:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f33eef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.829099:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f33eef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560595.829112:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787560595.829271:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f33ee8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc0c expref: 19 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.829290:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f33eef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc0c expref: 18 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.829298:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9cafef7ce800) 00010000:00010000:2.0:1787560595.829307:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787560595.829310:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2169600, rc 0) 00000100:00100000:2.0:1787560595.829374:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+18:10499:x1874392853274624:12345-192.168.203.29@tcp:101:rm.0 Request processed in 466us (841us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787560595.829381:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 35 00000100:00100000:1.0:1787560595.834367:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560595.834595:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853274752 00000100:00100000:3.0:1787560595.834605:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853274752 00000100:00100000:3.0:1787560595.834673:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 36 00000100:00100000:3.0:1787560595.834684:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+18:10499:x1874392853274752:12345-192.168.203.29@tcp:41:rm.0 00000004:00000024:3.0:1787560595.834747:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:3.0:1787560595.834996:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+18:10499:x1874392853274752:12345-192.168.203.29@tcp:41:rm.0 Request processed in 312us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560595.835004:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 36 00000100:00100000:1.0:1787560595.841188:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560595.843254:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853274880 00000100:00100000:2.0:1787560595.843269:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853274880 00000100:00100000:2.0:1787560595.843389:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 37 00000100:00100000:2.0:1787560595.843401:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+18:10499:x1874392853274880:12345-192.168.203.29@tcp:101:rm.0 00010000:00010000:2.0:1787560595.843456:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560595.843477:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f33efd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fc13 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.843553:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f33f04 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.843567:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f33f04 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.843578:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f33f04 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.843588:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f33f0b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.843595:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f33f0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.843602:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f33f0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.843682:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f33f12 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.843691:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f33f12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.843698:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f33f12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560595.843740:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787560595.843749:0:6499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787560595.843768:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f33f12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.843779:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f33f12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.843787:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f33f04 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.843792:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f33f04 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.843798:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f33f04 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.843803:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560595.843807:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f33f04 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.843815:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f33f04 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.843827:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9cafef7ce800) 00010000:00010000:2.0:1787560595.843831:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560595.843836:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f33f04 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.843843:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f33f04 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.843857:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f33f0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.843874:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f33f0b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.843879:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f33f0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.843884:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560595.843887:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f33f0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.843893:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f33f0b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.843900:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff9cafef7ced00) 00010000:00010000:2.0:1787560595.843903:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560595.843906:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f33f0b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.843912:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f33f0b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.843939:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f33efd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc13 expref: 20 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.843953:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f33f12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc13 expref: 19 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.843961:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9caec1e6b000) 00010000:00010000:2.0:1787560595.843964:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787560595.843973:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2168800, rc 0) 00000100:00100000:2.0:1787560595.844042:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+19:10499:x1874392853274880:12345-192.168.203.29@tcp:101:rm.0 Request processed in 643us (2863us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560595.844050:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 37 00000100:00100000:1.0:1787560595.849019:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560595.849117:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853275136 00000100:00100000:3.0:1787560595.849127:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853275136 00000100:00100000:3.0:1787560595.849195:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 38 00000100:00100000:3.0:1787560595.849206:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+19:10499:x1874392853275136:12345-192.168.203.29@tcp:36:rm.0 00010000:00010000:3.0:1787560595.849274:0:10172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787560595.849302:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f33f12 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc13 expref: 19 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.849327:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f33ebe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbf7 expref: 18 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.849339:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9caec1e6b000) 00010000:00010000:3.0:1787560595.849350:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f33ed3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbfe expref: 17 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.849359:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9cafef7ce800) 00010000:00010000:3.0:1787560595.849362:0:10172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787560595.849386:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f33f19 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.849400:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f33f19 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.849423:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f33f19 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.849474:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6200/0x4642c20bf2f33f20 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.849483:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6200/0x4642c20bf2f33f20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.849489:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6200/0x4642c20bf2f33f20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.849588:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f33f27 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.849598:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f33f27 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.849605:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f33f27 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787560595.849975:0:10172:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1787560595.849985:0:10172:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 315189553495ns, next at 316189550938ns, rc = 0 00010000:00010000:3.0:1787560595.850044:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f33f2e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.850054:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f33f2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.850063:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f33f2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.850082:0:10172:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f33f2e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.850088:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f33f2e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.850093:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f33f2e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.850112:0:10172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787560595.850130:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f33f27 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.850137:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f33f27 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.850143:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f33f27 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.850148:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560595.850152:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f33f27 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.850160:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f33f27 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.850169:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9caec1e6b000) 00010000:00010000:3.0:1787560595.850172:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787560595.850175:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f33f27 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.850190:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f33f27 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.850207:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f33f19 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.850213:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f33f19 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.851622:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f33f19 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.851629:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7c00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560595.851634:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f33f19 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.851642:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f33f19 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.851657:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9cafef7ce800) 00010000:00010000:3.0:1787560595.851660:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560595.851664:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f33f19 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.851671:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f33f19 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787560595.851689:0:10172:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b59e594 reply state 000000000ea91f7c transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6200/0x4642c20bf2f33f20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.851709:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6200/0x4642c20bf2f33f20 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.851730:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff9cafef7ced00) 00010000:00010000:3.0:1787560595.851732:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787560595.851738:0:10172:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787560595.851837:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+18:10499:x1874392853275136:12345-192.168.203.29@tcp:36:rm.0 Request processed in 2629us (2824us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787560595.851845:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 38 00010000:00010000:3.0:1787560595.851875:0:6487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560595.851880:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f33f2e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.851885:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6800 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560595.851889:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f33f2e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.851895:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f33f2e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.851904:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9caec1e6b000) 00010000:00010000:3.0:1787560595.851906:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787560595.851909:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f33f2e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.851914:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f33f2e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.851923:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560595.851925:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560595.851926:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560595.855629:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560595.855719:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853275392 00000100:00100000:2.0:1787560595.855729:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853275392 00000100:00100000:2.0:1787560595.855832:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:2.0:1787560595.855843:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+18:10499:x1874392853275392:12345-192.168.203.29@tcp:35:rm.0 00000100:00100000:2.0:1787560595.856053:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+19:10499:x1874392853275392:12345-192.168.203.29@tcp:35:rm.0 Request processed in 212us (434us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787560595.856062:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:3.0:1787560595.858805:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560595.859526:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853275648 00000100:00100000:0.0:1787560595.859537:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853275648 00000100:00100000:0.0:1787560595.859715:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 39 00000100:00100000:0.0:1787560595.859726:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+19:10499:x1874392853275648:12345-192.168.203.29@tcp:36:rm.0 00010000:00010000:0.0:1787560595.859784:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787560595.859821:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f33eef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc0c expref: 19 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.859845:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f33e8d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbe9 expref: 18 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.859855:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9cafef7ce800) 00010000:00010000:0.0:1787560595.859871:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f33e4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbdb expref: 17 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.859879:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:0.0:1787560595.859886:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787560595.859919:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881400/0x4642c20bf2f33f35 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.859931:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881400/0x4642c20bf2f33f35 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.859940:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881400/0x4642c20bf2f33f35 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.859953:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f33f3c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.859986:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f33f3c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.859994:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f33f3c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.860070:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881e00/0x4642c20bf2f33f43 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.860078:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881e00/0x4642c20bf2f33f43 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.860086:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881e00/0x4642c20bf2f33f43 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560595.860600:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787560595.860615:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881e00/0x4642c20bf2f33f43 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.860623:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881e00/0x4642c20bf2f33f43 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.860629:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881e00/0x4642c20bf2f33f43 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.860635:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881e00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560595.860639:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881e00/0x4642c20bf2f33f43 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.860647:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881e00/0x4642c20bf2f33f43 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.860668:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9caec1e6bd00) 00010000:00010000:0.0:1787560595.860671:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787560595.860674:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881e00/0x4642c20bf2f33f43 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.860680:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881e00/0x4642c20bf2f33f43 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.860697:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881400/0x4642c20bf2f33f35 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.860703:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881400/0x4642c20bf2f33f35 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.860708:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881400/0x4642c20bf2f33f35 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.860713:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881400 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560595.860715:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881400/0x4642c20bf2f33f35 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.860721:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881400/0x4642c20bf2f33f35 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.860727:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec1e6b800) 00010000:00010000:0.0:1787560595.860730:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560595.860732:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881400/0x4642c20bf2f33f35 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.860738:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881400/0x4642c20bf2f33f35 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787560595.860757:0:6500:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f1e00a3 reply state 00000000622323f0 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f33f3c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.860767:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f33f3c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.860772:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9caec1e6bc00) 00010000:00010000:0.0:1787560595.860774:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787560595.860777:0:6500:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787560595.860838:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+18:10499:x1874392853275648:12345-192.168.203.29@tcp:36:rm.0 Request processed in 1114us (2289us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787560595.860845:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 39 00010000:00010000:2.0:1787560596.467567:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560597.044891:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787560597.044929:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1c2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862793472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787560597.044997:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560597.045062:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862793472 00000100:00100000:3.0:1787560597.045069:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862793472 00000100:00100000:3.0:1787560597.045133:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787560597.045155:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862793472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787560597.045188:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787560597.045244:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862793472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560597.045251:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1787560597.045273:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787560597.045300:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec1c2ad80 x1874392862793472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560613 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560597.045316:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1c2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862793472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560597.045543:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787560597.045555:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862793600:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787560597.045585:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560597.045651:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862793600 00000100:00100000:0.0:1787560597.045655:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862793600 00000100:00100000:0.0:1787560597.045698:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787560597.045707:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec393b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862793600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787560597.045721:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560597.045758:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec393b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862793600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560597.045763:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:0.0:1787560597.045788:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cafffe19500 x1874392862793600/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560613 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560597.045801:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862793600:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787560597.045842:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787560597.493551:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560598.068303:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1c2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862793856:0@lo:400:kworker.0 00000100:00100000:3.0:1787560598.068378:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560598.068451:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc87ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862794368:0@lo:400:kworker.0 00000100:00100000:3.0:1787560598.068479:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560598.068499:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc87aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862794880:0@lo:400:kworker.0 00000100:00100000:3.0:1787560598.068524:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560598.068541:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec38e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862795392:0@lo:400:kworker.0 00000100:00100000:3.0:1787560598.068561:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560598.068586:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787560598.068592:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1c2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862793984:0@lo:400:kworker.0 00000100:00100000:3.0:1787560598.068615:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560598.068645:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc87ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862794496:0@lo:400:kworker.0 00000100:00100000:3.0:1787560598.068666:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560598.068683:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc87ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874392862795008:0@lo:400:kworker.0 00000100:00100000:3.0:1787560598.068704:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560598.068734:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862793856 00000100:00100000:3.0:1787560598.068741:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862793856 00000100:00100000:3.0:1787560598.068783:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1787560598.068792:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3625:x1874392862793856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560598.068838:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3625:x1874392862793856:12345-0@lo:400:kworker.0 Request processed in 46us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560598.068844:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1787560598.068874:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862794368 00000100:00100000:3.0:1787560598.068877:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862794368 00000100:00100000:3.0:1787560598.068900:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787560598.068907:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862794368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560598.068939:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862794368:12345-0@lo:400:kworker.0 Request processed in 33us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560598.068945:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787560598.068962:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862794880 00000100:00100000:3.0:1787560598.068965:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862794880 00000100:00100000:3.0:1787560598.068987:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862795392 00000100:00100000:3.0:1787560598.068990:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862795392 00000100:00100000:3.0:1787560598.069014:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787560598.069020:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862794880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560598.069047:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862794880:12345-0@lo:400:kworker.0 Request processed in 28us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560598.069053:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787560598.069074:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787560598.069079:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862795392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560598.069123:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862795392:12345-0@lo:400:kworker.0 Request processed in 43us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560598.069129:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787560598.069149:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862793984 00000100:00100000:3.0:1787560598.069152:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862793984 00000100:00100000:3.0:1787560598.069175:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862794496 00000100:00100000:3.0:1787560598.069177:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862794496 00000100:00100000:3.0:1787560598.069189:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862795008 00000100:00100000:3.0:1787560598.069192:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862795008 00000100:00100000:3.0:1787560598.069219:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787560598.069226:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862793984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560598.069256:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862793984:12345-0@lo:400:kworker.0 Request processed in 31us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560598.069262:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787560598.069273:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1787560598.069279:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862794496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560598.069305:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862794496:12345-0@lo:400:kworker.0 Request processed in 26us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560598.069311:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1787560598.069322:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1787560598.069328:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874392862795008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560598.069352:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874392862795008:12345-0@lo:400:kworker.0 Request processed in 25us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560598.069357:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:3.0:1787560598.069386:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787560598.069395:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787560598.069452:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1c2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862793984:0@lo:400:kworker.0 00000100:00100000:3.0:1787560598.069465:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc87ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862794496:0@lo:400:kworker.0 00000100:00100000:3.0:1787560598.069474:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc87ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874392862795008:0@lo:400:kworker.0 00000100:00100000:3.0:1787560598.069483:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1c2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862793856:0@lo:400:kworker.0 00000100:00100000:3.0:1787560598.069492:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc87ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862794368:0@lo:400:kworker.0 00010000:00080000:3.0:1787560598.069503:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cafc87aca80 x1874392862794880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560598.069513:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc87aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862794880:0@lo:400:kworker.0 00010000:00080000:3.0:1787560598.069523:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec38e8a80 x1874392862795392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560598.069532:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec38e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862795392:0@lo:400:kworker.0 00000100:00100000:0.0:1787560598.069649:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec393aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862793728:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560598.069680:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560598.069713:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1c2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862794240:0@lo:400:kworker.0 00000004:00080000:2.0:1787560598.069727:0:9935:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 317409294930ns, next at 318409292992ns, rc = 0 00000100:00100000:0.0:1787560598.069733:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560598.069748:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862794240 00000100:00100000:0.0:1787560598.069749:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc87ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862794752:0@lo:400:kworker.0 00000100:00100000:2.0:1787560598.069751:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862794240 00000100:00100000:0.0:1787560598.069767:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560598.069780:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787560598.069781:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec38ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862795264:0@lo:400:kworker.0 00000100:00100000:2.0:1787560598.069786:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862794240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560598.069798:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560598.069816:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862794240:12345-0@lo:400:kworker.0 Request processed in 30us (81us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560598.069822:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787560598.069822:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1c2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862794240:0@lo:400:kworker.0 00000100:00100000:0.0:1787560598.069830:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787560598.069835:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1c29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862794112:0@lo:400:kworker.0 00000100:00100000:2.0:1787560598.069838:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafe0684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862795520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560598.069858:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560598.069858:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560598.069872:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc87aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862794624:0@lo:400:kworker.0 00000100:00100000:2.0:1787560598.069890:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862793728 00000100:00100000:0.0:1787560598.069891:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560598.069893:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862793728 00000100:00100000:0.0:1787560598.069906:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec38ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874392862795136:0@lo:400:kworker.0 00000100:00100000:2.0:1787560598.069919:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862795520 00000100:00100000:2.0:1787560598.069921:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862795520 00000100:00100000:2.0:1787560598.069933:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787560598.069934:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560598.069939:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862793728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787560598.069958:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560598.069959:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862794624 00000100:00100000:0.0:1787560598.069961:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862794624 00000100:00100000:0.0:1787560598.069979:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862795136 00000100:00100000:0.0:1787560598.069982:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862795136 00000100:00100000:2.0:1787560598.069990:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862793728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560598.069995:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1787560598.069996:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787560598.070000:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862794624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560598.070006:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787560598.070010:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862795520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787560598.070018:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560598.070025:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862794624:12345-0@lo:400:kworker.0 Request processed in 25us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560598.070031:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1787560598.070039:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862795520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 29us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560598.070042:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1787560598.070044:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787560598.070047:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3903800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874392862795136:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787560598.070059:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787560598.070062:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787560598.070076:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cafe0684000 x1874392862795520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560614 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560598.070080:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3903800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874392862795136:12345-0@lo:400:kworker.0 Request processed in 33us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560598.070090:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafe0684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862795520:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787560598.070114:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cafc87aea00 x1874392862794624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560598.070122:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc87aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862794624:0@lo:400:kworker.0 00010000:00080000:2.0:1787560598.070144:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec38ea300 x1874392862795136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560598.070160:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1787560598.070164:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec38ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874392862795136:0@lo:400:kworker.0 00010000:00080000:2.0:1787560598.070176:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec393aa00 x1874392862793728/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560614 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560598.070177:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862794752 00000100:00100000:0.0:1787560598.070179:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862794752 00000100:00100000:2.0:1787560598.070187:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec393aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862793728:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560598.070197:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862795264 00000100:00100000:0.0:1787560598.070200:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862795264 00000100:00100000:0.0:1787560598.070226:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787560598.070232:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862794752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560598.070249:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787560598.070255:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862795264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560598.070265:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862794752:12345-0@lo:400:kworker.0 Request processed in 33us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560598.070270:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787560598.070279:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862795264:12345-0@lo:400:kworker.0 Request processed in 25us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560598.070284:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:2.0:1787560598.070303:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cafc87ac380 x1874392862794752/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560598.070312:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc87ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862794752:0@lo:400:kworker.0 00010000:00080000:2.0:1787560598.070321:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec38ea680 x1874392862795264/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560598.070328:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec38ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862795264:0@lo:400:kworker.0 00000100:00100000:1.0:1787560598.070541:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862794112 00000100:00100000:1.0:1787560598.070547:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862794112 00000100:00100000:1.0:1787560598.070585:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787560598.070593:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862794112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560598.070644:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862794112:12345-0@lo:400:kworker.0 Request processed in 52us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560598.070650:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787560598.070757:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1c29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862794112:0@lo:400:kworker.0 00010000:00010000:0.0:1787560598.516575:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787560599.145470:0:13660:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1787560599.544262:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560599.607736:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec393aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862795648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787560599.607834:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560599.607905:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862795648 00000100:00100000:3.0:1787560599.607916:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862795648 00000100:00100000:3.0:1787560599.607986:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787560599.607998:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862795648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787560599.608045:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787560599.612567:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862795648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4555us (4717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560599.612587:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787560599.613296:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec393aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862795648:0@lo:41:osp-pre-0-1.0 00000020:00000080:0.0:1787560600.090765:0:13708:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe0bca4d30 20000000:00000080:0.0:1787560600.090789:0:13708:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9caec3926400 uarg=0000000000000000 20000000:01000000:0.0:1787560600.090972:0:13708:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787560600.090981:0:13708:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787560600.090988:0:13708:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1787560600.092267:0:13709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1787560600.092505:0:13708:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1787560600.096744:0:13708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1787560600.096798:0:13708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1787560600.096820:0:13708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1787560600.096839:0:13708:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787560600.096983:0:13708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9caec3880c00/0x4642c20bf2f33f4a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560600.097008:0:13708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caffca48c00/0x4642c20bf2f33dd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbc6 expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560600.097037:0:13708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f33de5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33dde expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560600.097045:0:13708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caffca48000/0x4642c20bf2f33df3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33dec expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560600.097053:0:13708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caffca49800/0x4642c20bf2f33e01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbcd expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560600.097061:0:13708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33e08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33dfa expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560600.097068:0:13708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f33e16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33e0f expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560600.097077:0:13708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9caec3880c00/0x4642c20bf2f33f4a lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560600.097729:0:13708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f33e16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f33e0f expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560600.097751:0:13708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f33e16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f33e0f expref: 23 pid: 6494 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560600.097770:0:13708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3901500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1874392862795776:0@lo:104: 00000100:00100000:0.0:1787560600.098024:0:13708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787560600.098155:0:13708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33e08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f33dfa expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560600.098181:0:13708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33e08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f33dfa expref: 23 pid: 6494 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560600.098202:0:13708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3903b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1874392862795904:0@lo:104: 00010000:00010000:0.0:1787560600.098238:0:13708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caffca49800/0x4642c20bf2f33e01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbcd expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560600.098250:0:13708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9caffca49800/0x4642c20bf2f33e01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbcd expref: 12 pid: 6494 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560600.098261:0:13708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3901c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1874392862796032:192.168.203.29@tcp:104: 00010000:00010000:0.0:1787560600.098335:0:13708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caffca48000/0x4642c20bf2f33df3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f33dec expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560600.098343:0:13708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9caffca48000/0x4642c20bf2f33df3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f33dec expref: 23 pid: 6492 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560600.098351:0:13708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3901180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1874392862796160:0@lo:104: 00010000:00010000:0.0:1787560600.098379:0:13708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f33de5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f33dde expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560600.098387:0:13708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f33de5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f33dde expref: 23 pid: 6493 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560600.098394:0:13708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3903100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1874392862796288:0@lo:104: 00010000:00010000:0.0:1787560600.098422:0:13708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caffca48c00/0x4642c20bf2f33dd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbc6 expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560600.098475:0:13708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9caffca48c00/0x4642c20bf2f33dd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbc6 expref: 12 pid: 6493 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560600.098485:0:13708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3900700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1874392862796416:192.168.203.29@tcp:104: 00000100:00100000:0.0:1787560600.098641:0:13708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc890180 going to sleep for 11 seconds 00000100:00100000:0.0:1787560600.100614:0:6482:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787560600.100670:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560600.100719:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560600.100731:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560600.100745:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862795776 00000100:00100000:0.0:1787560600.100756:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862795776 00000100:00100000:0.0:1787560600.100812:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862795904 00000100:00100000:0.0:1787560600.100814:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862795904 00000100:00100000:0.0:1787560600.100826:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862796160 00000100:00100000:0.0:1787560600.100829:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862796160 00000100:00100000:0.0:1787560600.100840:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862796288 00000100:00100000:0.0:1787560600.100843:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862796288 00000100:00100000:3.0:1787560600.101021:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787560600.101037:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec32e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+6:13708:x1874392862795776:12345-0@lo:104: 00010000:00010000:3.0:1787560600.101077:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9caffca49000/0x4642c20bf2f33e0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33e16 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560600.101183:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787560600.101199:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec32e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+6:13708:x1874392862795776:12345-0@lo:104: Request processed in 167us (3175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560600.101207:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787560600.101255:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787560600.101262:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3900a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+5:13708:x1874392862795904:12345-0@lo:104: 00010000:00010000:3.0:1787560600.101271:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f33dfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33e08 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560600.101309:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787560600.101315:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3900a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+5:13708:x1874392862795904:12345-0@lo:104: Request processed in 54us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560600.101321:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787560600.101335:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787560600.101341:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3900380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+4:13708:x1874392862796160:12345-0@lo:104: 00010000:00010000:3.0:1787560600.101349:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9caffca49a00/0x4642c20bf2f33dec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33df3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560600.101388:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787560600.101393:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3900380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+4:13708:x1874392862796160:12345-0@lo:104: Request processed in 53us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560600.101399:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787560600.101418:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787560600.101424:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3900e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:13708:x1874392862796288:12345-0@lo:104: 00010000:00010000:3.0:1787560600.101467:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9caffca49600/0x4642c20bf2f33dde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33de5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560600.101504:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787560600.101509:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3900e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+3:13708:x1874392862796288:12345-0@lo:104: Request processed in 86us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560600.101515:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1787560600.101549:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787560600.101556:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caffca49000/0x4642c20bf2f33e0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33e16 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560600.101564:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49000 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560600.101569:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caffca49000/0x4642c20bf2f33e0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33e16 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560600.101579:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caffca49000/0x4642c20bf2f33e0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33e16 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560600.101588:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caffca49000/0x4642c20bf2f33e0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33e16 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560600.101594:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787560600.101637:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caffca49000/0x4642c20bf2f33e0f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33e16 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560600.101645:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560600.101670:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caffca49000/0x4642c20bf2f33e0f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33e16 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560600.101676:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caffca49000/0x4642c20bf2f33e0f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33e16 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560600.101698:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787560600.101701:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f33dfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33e08 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560600.101706:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49400 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560600.101709:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f33dfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33e08 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560600.101715:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f33dfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33e08 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560600.101721:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f33dfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33e08 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560600.101725:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787560600.101737:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f33dfa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33e08 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560600.101742:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560600.101755:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f33dfa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33e08 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560600.101761:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f33dfa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33e08 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560600.101769:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787560600.101771:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caffca49a00/0x4642c20bf2f33dec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33df3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560600.101784:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49a00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560600.101787:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caffca49a00/0x4642c20bf2f33dec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33df3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560600.101793:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caffca49a00/0x4642c20bf2f33dec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33df3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560600.101799:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caffca49a00/0x4642c20bf2f33dec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33df3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560600.101803:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787560600.101814:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caffca49a00/0x4642c20bf2f33dec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33df3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560600.101818:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560600.101824:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caffca49a00/0x4642c20bf2f33dec lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33df3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560600.101829:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caffca49a00/0x4642c20bf2f33dec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33df3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560600.101836:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560600.101839:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caffca49600/0x4642c20bf2f33dde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f33de5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560600.101845:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49600 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560600.101848:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caffca49600/0x4642c20bf2f33dde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f33de5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560600.101864:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caffca49600/0x4642c20bf2f33dde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f33de5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560600.101881:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caffca49600/0x4642c20bf2f33dde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f33de5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560600.101887:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787560600.101899:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caffca49600/0x4642c20bf2f33dde lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33de5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560600.101905:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560600.101910:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caffca49600/0x4642c20bf2f33dde lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33de5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560600.101917:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caffca49600/0x4642c20bf2f33dde lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f33de5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560600.101931:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560600.101932:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560600.101933:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560600.101941:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560600.101948:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560600.103318:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862796928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560600.103400:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560600.103500:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787560600.103508:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862796544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787560600.103623:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862796928 00000100:00100000:0.0:1787560600.103633:0:9502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862796928 00010000:00010000:0.0:1787560600.103681:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f33de5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33dde expref: 24 pid: 6493 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560600.103720:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787560600.103731:0:9502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3623:x1874392862796928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787560600.103746:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560600.103753:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f33de5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33dde expref: 24 pid: 6493 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560600.103765:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f33de5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f33dde expref: 24 pid: 6493 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560600.103806:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560600.103842:0:9502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3623:x1874392862796928:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560600.103862:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787560600.104016:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560600.104061:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862796928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560600.104231:0:13708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3901500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1874392862795776:0@lo:104: 00000100:00100000:1.0:1787560600.104242:0:13708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3903b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1874392862795904:0@lo:104: 00000100:00100000:1.0:1787560600.104252:0:13708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3901180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1874392862796160:0@lo:104: 00010000:00010000:1.0:1787560600.104261:0:13708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f33de5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f33dde expref: 23 pid: 6493 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560600.104273:0:13708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3903100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1874392862796288:0@lo:104: 00000100:00100000:0.0:1787560600.104320:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862796544 00000100:00100000:0.0:1787560600.104324:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862796544 00010000:00010000:0.0:1787560600.104340:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f33e16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33e0f expref: 23 pid: 6494 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560600.104367:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787560600.104374:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:3623:x1874392862796544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787560600.104381:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560600.104385:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f33e16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33e0f expref: 23 pid: 6494 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560600.104396:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f33e16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f33e0f expref: 23 pid: 6494 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560600.104408:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f33e16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f33e0f expref: 23 pid: 6494 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560600.104419:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560600.104480:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:3623:x1874392862796544:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560600.104485:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787560600.104509:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862796544:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787560600.104840:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560600.104876:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862796672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787560600.104912:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560600.104948:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787560600.104954:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862796800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787560600.104987:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560600.105259:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862796672 00000100:00100000:3.0:1787560600.105264:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862796672 00010000:00010000:3.0:1787560600.105287:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33e08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33dfa expref: 22 pid: 6494 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560600.105314:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862796800 00000100:00100000:3.0:1787560600.105317:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862796800 00010000:00010000:3.0:1787560600.105332:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caffca48000/0x4642c20bf2f33df3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33dec expref: 23 pid: 6492 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560600.105359:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787560600.105366:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec393aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:3625:x1874392862796672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787560600.105376:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560600.105381:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33e08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33dfa expref: 23 pid: 6494 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560600.105392:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33e08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f33dfa expref: 23 pid: 6494 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560600.105406:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca48400/0x4642c20bf2f33e08 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f33dfa expref: 23 pid: 6494 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560600.105418:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560600.105472:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec393aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:3625:x1874392862796672:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560600.105479:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787560600.105495:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787560600.105501:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0684000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:3625:x1874392862796800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787560600.105508:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560600.105512:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caffca48000/0x4642c20bf2f33df3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f33dec expref: 21 pid: 6492 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560600.105529:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caffca48000/0x4642c20bf2f33df3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f33dec expref: 21 pid: 6492 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560600.105540:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca48000/0x4642c20bf2f33df3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f33dec expref: 21 pid: 6492 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560600.105560:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560600.105584:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0684000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:3625:x1874392862796800:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560600.105590:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787560600.105761:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862796800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787560600.105768:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862796672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787560600.107105:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560600.107153:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560600.107222:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853275904 00000100:00100000:2.0:1787560600.107236:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853275904 00010000:00010000:2.0:1787560600.107282:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caffca48c00/0x4642c20bf2f33dd7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbc6 expref: 13 pid: 6493 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560600.107295:0:13708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3901c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1874392862796032:192.168.203.29@tcp:104: 00000100:00100000:1.0:1787560600.107317:0:13708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3900700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1874392862796416:192.168.203.29@tcp:104: 00000100:00100000:2.0:1787560600.107331:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853275776 00000100:00100000:2.0:1787560600.107337:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853275776 00010000:00010000:2.0:1787560600.107357:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caffca49800/0x4642c20bf2f33e01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbcd expref: 14 pid: 6494 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560600.107376:0:13708:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9caec3880c00/0x4642c20bf2f33f4a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560600.107397:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 50 00000100:00100000:2.0:1787560600.107412:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a608f87b-4315-497d-a70e-0ed75a6814da+14:2404:x1874392853275904:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560600.107462:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560600.107471:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caffca48c00/0x4642c20bf2f33dd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbc6 expref: 14 pid: 6493 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560600.107486:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caffca48c00/0x4642c20bf2f33dd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbc6 expref: 14 pid: 6493 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560600.107512:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca48c00/0x4642c20bf2f33dd7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbc6 expref: 14 pid: 6493 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560600.107513:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 51 00010000:00010000:2.0:1787560600.107536:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560600.107547:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a608f87b-4315-497d-a70e-0ed75a6814da+13:2405:x1874392853275776:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560600.107566:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560600.107575:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caffca49800/0x4642c20bf2f33e01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbcd expref: 13 pid: 6494 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560600.107590:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caffca49800/0x4642c20bf2f33e01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbcd expref: 13 pid: 6494 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560600.107605:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a608f87b-4315-497d-a70e-0ed75a6814da+13:2404:x1874392853275904:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 193us (504us total) trans 0 rc 0/0 00010000:00010000:1.0:1787560600.107613:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca49800/0x4642c20bf2f33e01 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fbcd expref: 13 pid: 6494 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560600.107635:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 50 00010000:00010000:1.0:1787560600.107652:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9caec3880c00/0x4642c20bf2f33f4a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560600.107664:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caec3880c00/0x4642c20bf2f33f4a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560600.107682:0:6484:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9caec3880c00/0x4642c20bf2f33f4a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560600.107689:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9caec3880c00/0x4642c20bf2f33f4a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560600.107697:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9caec3880c00/0x4642c20bf2f33f4a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560600.107704:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9caec3880c00/0x4642c20bf2f33f4a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560600.107723:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880c00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560600.107728:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9caec3880c00/0x4642c20bf2f33f4a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560600.107736:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9caec3880c00/0x4642c20bf2f33f4a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560600.107753:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9caec3880c00/0x4642c20bf2f33f4a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560600.107764:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560600.107821:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a608f87b-4315-497d-a70e-0ed75a6814da+11:2405:x1874392853275776:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 292us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560600.107829:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 51 00010000:00010000:1.0:1787560600.107862:0:13708:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9caec3880c00/0x4642c20bf2f33f4a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560600.107870:0:13708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9caec3880c00/0x4642c20bf2f33f4a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560600.107876:0:13708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caec3880c00/0x4642c20bf2f33f4a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560600.568832:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560600.574531:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560600.574594:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560600.574620:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560600.574652:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560600.574670:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560600.574695:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560600.574727:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853276416 00000100:00100000:0.0:1787560600.574739:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853276416 00000100:00100000:0.0:1787560600.574816:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 81 00000100:00100000:0.0:1787560600.574830:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3901880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853276416:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560600.574942:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3901880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853276416:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 114us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560600.574952:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 81 00000100:00100000:0.0:1787560600.574981:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853276160 00000100:00100000:0.0:1787560600.574986:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853276160 00000100:00100000:0.0:1787560600.575008:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853276672 00000100:00100000:0.0:1787560600.575010:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853276672 00000100:00100000:0.0:1787560600.575023:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853276288 00000100:00100000:0.0:1787560600.575026:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853276288 00000100:00100000:0.0:1787560600.575038:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853276544 00000100:00100000:0.0:1787560600.575040:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853276544 00000100:00100000:0.0:1787560600.575055:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 212 00000100:00100000:0.0:1787560600.575061:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3900000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+18:2403:x1874392853276160:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560600.575097:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3900000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+18:2403:x1874392853276160:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 36us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560600.575105:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 212 00000100:00100000:0.0:1787560600.575118:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 213 00000100:00100000:0.0:1787560600.575125:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3902d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853276672:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560600.575161:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3902d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853276672:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 36us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560600.575168:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 213 00000100:00100000:0.0:1787560600.575180:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 214 00000100:00100000:0.0:1787560600.575199:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3901f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853276288:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560600.575223:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3901f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853276288:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 38us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560600.575229:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 214 00000100:00100000:0.0:1787560600.575241:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 215 00000100:00100000:0.0:1787560600.575247:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3902300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853276544:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560600.575269:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3902300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853276544:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 22us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560600.575274:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 215 00000100:00080000:0.0:1787560600.575301:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787560600.575306:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787560600.575309:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787560600.575649:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853276032 00000100:00100000:1.0:1787560600.575655:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853276032 00000100:00100000:1.0:1787560600.575694:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 335 00000100:00100000:1.0:1787560600.575702:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+11:2403:x1874392853276032:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560600.575737:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+11:2403:x1874392853276032:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 36us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560600.575751:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 335 00000100:00100000:2.0:1787560600.628318:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862797056:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787560600.628500:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560600.628604:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862797056 00000100:00100000:2.0:1787560600.628613:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862797056 00000100:00100000:2.0:1787560600.628670:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787560600.628682:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862797056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787560600.628736:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787560600.628795:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862797056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560600.628802:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787560600.628858:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862797056:0@lo:41:osp-pre-1-0.0 00000020:00000080:1.0:1787560601.072101:0:13757:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffddc00c3d0 20000000:00000080:1.0:1787560601.072125:0:13757:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9caec3895800 uarg=0000000000000000 20000000:01000000:1.0:1787560601.072191:0:13757:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1787560601.072199:0:13757:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1787560601.072205:0:13757:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:2.0:1787560601.072918:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1787560601.073106:0:13757:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:1.0:1787560601.073205:0:13757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:1.0:1787560601.075084:0:13757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:1.0:1787560601.075152:0:13757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:1.0:1787560601.075174:0:13757:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787560601.075221:0:13757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9caffcbff200/0x4642c20bf2f33f51 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560601.075242:0:13757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffcbff200/0x4642c20bf2f33f51 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560601.075256:0:13757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9caffcbff200/0x4642c20bf2f33f51 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560601.075264:0:13757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9caffcbff200/0x4642c20bf2f33f51 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560601.075272:0:13757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9caffcbff200/0x4642c20bf2f33f51 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560601.075280:0:13757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9caffcbff200/0x4642c20bf2f33f51 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560601.075287:0:13757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbff200 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560601.075299:0:13757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9caffcbff200/0x4642c20bf2f33f51 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560601.075308:0:13757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9caffcbff200/0x4642c20bf2f33f51 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560601.075324:0:13757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9caffcbff200/0x4642c20bf2f33f51 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560601.075344:0:13757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9caffcbff200/0x4642c20bf2f33f51 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560601.075351:0:13757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffcbff200/0x4642c20bf2f33f51 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787560601.076613:0:6478:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:0.0:1787560601.076689:0:6478:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:0.0:1787560601.076700:0:6478:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:3.0:1787560601.076742:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f33ea2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560601.076755:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f33ea2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560601.076763:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f33ea2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560601.076769:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169e00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560601.076776:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f33ea2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560601.076783:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f33ea2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560601.076806:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff9cafef7ced00) 00010000:00010000:3.0:1787560601.076810:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560601.076816:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f33ea2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560601.076822:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f33ea2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560601.076858:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f33eb7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560601.076865:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f33eb7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560601.076871:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f33eb7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560601.076876:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881c00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560601.076879:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f33eb7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560601.076885:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f33eb7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560601.076893:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9caec1e6b000) 00010000:00010000:3.0:1787560601.076896:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560601.076899:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f33eb7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560601.076904:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f33eb7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560601.076924:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6200/0x4642c20bf2f33f20 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560601.076929:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6200/0x4642c20bf2f33f20 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560601.076936:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6200/0x4642c20bf2f33f20 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560601.076948:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560601.076951:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6200/0x4642c20bf2f33f20 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560601.076958:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6200/0x4642c20bf2f33f20 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560601.076967:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff9cafef7ced00) 00010000:00010000:3.0:1787560601.076969:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560601.076972:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6200/0x4642c20bf2f33f20 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560601.076979:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6200/0x4642c20bf2f33f20 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560601.076998:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f33f3c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560601.077004:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f33f3c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560601.077009:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f33f3c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560601.077013:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560601.077016:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f33f3c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560601.077022:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f33f3c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560601.077040:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9caec1e6bc00) 00010000:00010000:3.0:1787560601.077043:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560601.077046:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f33f3c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560601.077052:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f33f3c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560601.077252:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787560601.077275:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862797184:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787560601.077427:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560601.077529:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862797184 00000100:00100000:1.0:1787560601.077539:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862797184 00000100:00100000:1.0:1787560601.077601:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787560601.077619:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862797184:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787560601.077655:0:8412:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:1.0:1787560601.077694:0:8412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a8c0293, atime: 0x6a8c0293, ctime: 0x6a8c0293, blocks: 0x0 00010000:00010000:1.0:1787560601.077837:0:8412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000deac983/0x4642c20bf2f33f58 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560601.077858:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=320s v=(0 0) 00010000:00010000:1.0:1787560601.077864:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560601.078046:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000deac983/0x4642c20bf2f33f58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560601.078076:0:8412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000deac983/0x4642c20bf2f33f58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560601.078087:0:8412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000deac983/0x4642c20bf2f33f58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560601.078093:0:8412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000deac983/0x4642c20bf2f33f58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560601.078121:0:8412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787560601.078371:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3626:x1874392862797184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 755us (939us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787560601.078381:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1787560601.078413:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1787560601.078473:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9caffcaa8380/2, rc 0, transno 4294967301 00000100:00100000:3.0:1787560601.078482:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862797184:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787560601.078568:0:9500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560601.078577:0:9500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000deac983/0x4642c20bf2f33f58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560601.078586:0:9500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbffe00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:2.0:1787560601.078591:0:9500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000deac983/0x4642c20bf2f33f58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560601.078600:0:9500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000deac983/0x4642c20bf2f33f58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560601.078621:0:9500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000deac983/0x4642c20bf2f33f58 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560601.078635:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000deac983/0x4642c20bf2f33f58 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560601.078668:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560601.078671:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560601.078673:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560601.341419:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560601.343060:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853276800 00000100:00100000:3.0:1787560601.343080:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853276800 00000100:00100000:0.0:1787560601.345205:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 336 00000100:00100000:0.0:1787560601.345224:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+11:6179:x1874392853276800:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787560601.345315:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560601.345344:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caec3880e00/0x4642c20bf2f33f5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fc1a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560601.345408:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caec3880e00/0x4642c20bf2f33f5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc1a expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560601.345422:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caec3880e00/0x4642c20bf2f33f5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc1a expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560601.345468:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3880e00, rc 0) 00000100:00100000:0.0:1787560601.345563:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+12:6179:x1874392853276800:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 Request processed in 342us (4157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560601.345573:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 336 00000100:00100000:2.0:1787560601.351151:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560601.354202:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853276928 00000100:00100000:0.0:1787560601.354224:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853276928 00000100:00100000:0.0:1787560601.354333:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 337 00000100:00100000:0.0:1787560601.354348:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+12:6179:x1874392853276928:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560601.354694:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+12:6179:x1874392853276928:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 Request processed in 349us (3557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560601.354704:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 337 00000100:00100000:2.0:1787560601.362774:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560601.362844:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853277056 00000100:00100000:1.0:1787560601.362856:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853277056 00000100:00100000:1.0:1787560601.362987:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 338 00000100:00100000:1.0:1787560601.363001:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+12:6179:x1874392853277056:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787560601.363311:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+12:6179:x1874392853277056:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 Request processed in 312us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560601.363321:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 338 00000100:00100000:3.0:1787560601.368821:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560601.368946:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853277184 00000100:00100000:2.0:1787560601.368960:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853277184 00000100:00100000:2.0:1787560601.369031:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 339 00000100:00100000:2.0:1787560601.369281:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+12:10784:x1874392853277184:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787560601.369858:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+12:10784:x1874392853277184:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 813us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560601.369869:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 339 00000100:00100000:2.0:1787560601.381867:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560601.382248:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853277312 00000100:00100000:1.0:1787560601.382263:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853277312 00000100:00100000:1.0:1787560601.382338:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 340 00000100:00100000:1.0:1787560601.382351:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+12:10784:x1874392853277312:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787560601.382613:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+12:10784:x1874392853277312:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 264us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560601.382623:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 340 00000100:00100000:0.0:1787560601.395664:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560601.395937:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853277440 00000100:00100000:2.0:1787560601.395951:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853277440 00000100:00100000:2.0:1787560601.396022:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 341 00000100:00100000:2.0:1787560601.396034:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+12:6179:x1874392853277440:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560601.396128:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560601.396156:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caec2168c00/0x4642c20bf2f33f66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fc21 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560601.396211:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caec2168c00/0x4642c20bf2f33f66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc21 expref: 13 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560601.396313:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caec2168c00/0x4642c20bf2f33f66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc21 expref: 13 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560601.396325:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2168c00, rc 0) 00000100:00100000:2.0:1787560601.396418:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+13:6179:x1874392853277440:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 Request processed in 385us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560601.396426:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 341 00000100:00100000:3.0:1787560601.399370:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560601.399953:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853277568 00000100:00100000:0.0:1787560601.399967:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853277568 00000100:00100000:0.0:1787560601.400127:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 342 00000100:00100000:0.0:1787560601.400140:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+13:6179:x1874392853277568:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560601.400831:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+13:6179:x1874392853277568:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 Request processed in 681us (1464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560601.400842:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 342 00000100:00100000:2.0:1787560601.409285:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560601.419736:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853277696 00000100:00100000:0.0:1787560601.419761:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853277696 00000100:00100000:0.0:1787560601.419849:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 343 00000100:00100000:0.0:1787560601.419862:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+13:6179:x1874392853277696:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787560601.420080:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+13:6179:x1874392853277696:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 Request processed in 219us (10808us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560601.420090:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 343 00000100:00100000:2.0:1787560601.429960:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560601.430523:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853277824 00000100:00100000:0.0:1787560601.430538:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853277824 00000100:00100000:0.0:1787560601.430618:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 344 00000100:00100000:0.0:1787560601.430632:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+13:10788:x1874392853277824:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787560601.430841:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+13:10788:x1874392853277824:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 210us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560601.430850:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 344 00000100:00100000:3.0:1787560601.433960:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560601.439048:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853277952 00000100:00100000:1.0:1787560601.439069:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853277952 00000100:00100000:1.0:1787560601.439210:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 345 00000100:00100000:1.0:1787560601.439224:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+13:10788:x1874392853277952:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787560601.443449:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+13:10788:x1874392853277952:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 515us (5789us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560601.443497:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 345 00010000:00010000:3.0:1787560601.589655:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787560601.715758:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787560601.715770:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9caec1ef6000 from 7 10000000:01000000:3.0:1787560601.715777:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787560601.715848:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33f6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560601.715864:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33f6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560601.715878:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33f6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560601.715910:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f47100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862797312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787560601.716043:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560601.716146:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c866c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560601.718358:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862797312 00000100:00100000:2.0:1787560601.718377:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862797312 00000100:00100000:2.0:1787560601.718478:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1787560601.718490:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd8e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:6497:x1874392862797312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560601.718511:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560601.718535:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caec2169800/0x4642c20bf2f33f74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33f6d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560601.718568:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caec2169800/0x4642c20bf2f33f74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33f6d expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560601.718580:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caec2169800/0x4642c20bf2f33f74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33f6d expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560601.718592:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2169800, rc 0) 00000100:00100000:2.0:1787560601.718688:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd8e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:6497:x1874392862797312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (2644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560601.718696:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1787560601.720756:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f47100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862797312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787560601.720796:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33f6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33f74 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560601.720812:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33f6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33f74 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560601.720939:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f47100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862797440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560601.721007:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560601.721067:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c866c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560601.721097:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862797440 00000100:00100000:3.0:1787560601.721104:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862797440 00000100:00100000:3.0:1787560601.721156:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1787560601.721167:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd86eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:6497:x1874392862797440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560601.721348:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd86eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:6497:x1874392862797440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 181us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560601.721356:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1787560601.722316:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f47100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862797440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560601.722371:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3903480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862797568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787560601.722486:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560601.722537:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8900c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560601.722574:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862797568 00000100:00100000:1.0:1787560601.722582:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862797568 00000100:00100000:1.0:1787560601.722636:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1787560601.722645:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd86e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:6497:x1874392862797568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787560601.722773:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd86e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:6497:x1874392862797568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560601.722780:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1787560601.722877:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3903480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862797568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787560601.723406:0:13771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3903480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:13771:1874392862797696:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787560601.723486:0:13771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560601.723610:0:13771:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc890300 going to sleep for 11 seconds 00000100:00100000:2.0:1787560601.725029:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862797696 00000100:00100000:2.0:1787560601.725046:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862797696 00000100:00100000:2.0:1787560601.725130:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1787560601.725142:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd86e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:13771:x1874392862797696:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787560601.725587:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd86e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:13771:x1874392862797696:12345-0@lo:502:llog_process_th.0 Request processed in 446us (2099us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560601.725596:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1787560601.725731:0:13771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3903480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:13771:1874392862797696:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787560601.725773:0:13771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560601.725792:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560601.725796:0:13771:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787560601.725804:0:13771:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9caec1ef6000 00000020:00000080:0.0:1787560601.725807:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787560601.725887:0:13771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560601.725891:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560601.730451:0:13771:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787560601.730478:0:13771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560601.730492:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560601.730494:0:13771:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787560601.730500:0:13771:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9caec1ef6000 00000020:00000080:0.0:1787560601.730504:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787560601.730657:0:13771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3903480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:13771:1874392862797824:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787560601.730770:0:13771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560601.730828:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862797824 00000100:00100000:0.0:1787560601.730838:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862797824 00000100:00100000:0.0:1787560601.730910:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1787560601.730922:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:13771:x1874392862797824:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787560601.731068:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:13771:x1874392862797824:12345-0@lo:502:llog_process_th.0 Request processed in 147us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560601.731076:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1787560601.731135:0:13771:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc890300 going to sleep for 11 seconds 00000100:00100000:0.0:1787560601.731162:0:13771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3903480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:13771:1874392862797824:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787560601.731199:0:13771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560601.731204:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560601.731206:0:13771:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787560601.731211:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787560601.732530:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1787560601.732571:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787560601.732596:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33f6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33f74 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560601.732611:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33f6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33f74 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560601.732623:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787560601.732626:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cafeab05000 from 7 10000000:01000000:0.0:1787560601.732629:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787560601.732668:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3881400/0x4642c20bf2f33f7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560601.732677:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caec3881400/0x4642c20bf2f33f7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560601.732689:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caec3881400/0x4642c20bf2f33f7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560601.732734:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3903480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862797952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787560601.732802:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560601.732845:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc890300 going to sleep for 11 seconds 00000100:00100000:0.0:1787560601.732866:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862797952 00000100:00100000:0.0:1787560601.732874:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862797952 00000100:00100000:0.0:1787560601.733513:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1787560601.733527:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:6497:x1874392862797952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787560601.733544:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560601.733562:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caec3881e00/0x4642c20bf2f33f82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33f7b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560601.733592:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caec3881e00/0x4642c20bf2f33f82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33f7b expref: 22 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560601.733617:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caec3881e00/0x4642c20bf2f33f82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33f7b expref: 22 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560601.733629:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881e00, rc 0) 00000100:00100000:0.0:1787560601.733692:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:6497:x1874392862797952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560601.733699:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1787560601.733769:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3903480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862797952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787560601.733786:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caec3881400/0x4642c20bf2f33f7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33f82 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560601.733797:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caec3881400/0x4642c20bf2f33f7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33f82 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560601.733867:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3903480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862798080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560601.734738:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560601.734793:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc890300 going to sleep for 11 seconds 00000100:00100000:0.0:1787560601.734819:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862798080 00000100:00100000:0.0:1787560601.734828:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862798080 00000100:00100000:0.0:1787560601.734866:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1787560601.734874:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:6497:x1874392862798080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560601.736018:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:6497:x1874392862798080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1138us (1278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560601.736032:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1787560601.743027:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3903480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862798080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560601.743119:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f44380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862798208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787560601.743228:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560601.744563:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c86240 going to sleep for 11 seconds 00000100:00100000:0.0:1787560601.745050:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862798208 00000100:00100000:0.0:1787560601.745062:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862798208 00000100:00100000:0.0:1787560601.745154:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1787560601.745169:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:6497:x1874392862798208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787560601.745367:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:6497:x1874392862798208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 202us (2138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560601.745376:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1787560601.746165:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f44380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862798208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560601.751560:0:13774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:13774:1874392862798336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787560601.751668:0:13774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560601.751721:0:13774:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2000 going to sleep for 11 seconds 00000100:00100000:0.0:1787560601.753223:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862798336 00000100:00100000:0.0:1787560601.753243:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862798336 00000100:00100000:0.0:1787560601.753322:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1787560601.753334:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:13774:x1874392862798336:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787560601.753565:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:13774:x1874392862798336:12345-0@lo:502:llog_process_th.0 Request processed in 232us (1896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560601.753575:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1787560601.753683:0:13774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:13774:1874392862798336:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787560601.753738:0:13774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787560601.753750:0:13774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560601.753754:0:13774:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787560601.753761:0:13774:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cafeab05000 00000020:00000080:2.0:1787560601.753764:0:13774:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787560601.753841:0:13774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560601.753845:0:13774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560601.753846:0:13774:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787560601.753849:0:13774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787560601.753851:0:13774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560601.753853:0:13774:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787560601.753856:0:13774:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cafeab05000 00000020:00000080:2.0:1787560601.753858:0:13774:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787560601.753903:0:13774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:13774:1874392862798464:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787560601.753951:0:13774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560601.753999:0:13774:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2000 going to sleep for 11 seconds 00000100:00100000:0.0:1787560601.754776:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862798464 00000100:00100000:0.0:1787560601.754786:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862798464 00000100:00100000:0.0:1787560601.754836:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1787560601.754846:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:13774:x1874392862798464:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787560601.754982:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:13774:x1874392862798464:12345-0@lo:502:llog_process_th.0 Request processed in 137us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560601.754989:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000040:00080000:3.0:1787560601.755014:0:13775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787560601.755045:0:13774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:13774:1874392862798464:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787560601.755078:0:13774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560601.755085:0:13774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560601.755094:0:13774:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787560601.755098:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787560601.755156:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1787560601.755188:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787560601.755207:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3881400/0x4642c20bf2f33f7b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33f82 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560601.755220:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caec3881400/0x4642c20bf2f33f7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33f82 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560601.755232:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787560601.755235:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9caffba72800 from 7 10000000:01000000:0.0:1787560601.755239:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787560601.755269:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3880400/0x4642c20bf2f33f89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560601.755280:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caec3880400/0x4642c20bf2f33f89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560601.755291:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caec3880400/0x4642c20bf2f33f89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560601.755309:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3902680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862798592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787560601.755360:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560601.755391:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc890900 going to sleep for 11 seconds 00000100:00100000:0.0:1787560601.755406:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862798592 00000100:00100000:0.0:1787560601.755410:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862798592 00000100:00100000:0.0:1787560601.755456:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1787560601.755464:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:6497:x1874392862798592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787560601.755474:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560601.755488:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caec3880a00/0x4642c20bf2f33f90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33f89 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560601.755513:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caec3880a00/0x4642c20bf2f33f90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33f89 expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560601.755534:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caec3880a00/0x4642c20bf2f33f90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33f89 expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560601.755545:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3880a00, rc 0) 00000100:00100000:0.0:1787560601.755580:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:6497:x1874392862798592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560601.755587:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1787560601.755594:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3902680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862798592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787560601.755621:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caec3880400/0x4642c20bf2f33f89 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33f90 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560601.755633:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caec3880400/0x4642c20bf2f33f89 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33f90 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560601.755808:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f47480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862798720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560601.755839:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560601.755871:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c866c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560601.755956:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862798720 00000100:00100000:0.0:1787560601.755961:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862798720 00000100:00100000:0.0:1787560601.755992:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1787560601.755999:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:6497:x1874392862798720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560601.756117:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:6497:x1874392862798720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560601.756124:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1787560601.756220:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f47480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862798720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560601.756248:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f47480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862798848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787560601.756288:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560601.756312:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c866c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560601.756535:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862798848 00000100:00100000:1.0:1787560601.756541:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862798848 00000100:00100000:1.0:1787560601.756579:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1787560601.756588:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:6497:x1874392862798848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787560601.756682:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:6497:x1874392862798848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560601.756690:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1787560601.756733:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f47480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862798848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787560601.757332:0:13776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f47480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:13776:1874392862798976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560601.757380:0:13776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560601.757419:0:13776:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec322de40 going to sleep for 11 seconds 00000100:00100000:0.0:1787560601.757477:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862798976 00000100:00100000:0.0:1787560601.757484:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862798976 00000100:00100000:0.0:1787560601.757518:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1787560601.757527:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:13776:x1874392862798976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787560601.757632:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:13776:x1874392862798976:12345-0@lo:502:llog_process_th.0 Request processed in 104us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560601.757640:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1787560601.757677:0:13776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f47480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:13776:1874392862798976:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787560601.757712:0:13776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560601.757724:0:13776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560601.757728:0:13776:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787560601.757735:0:13776:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9caffba72800 00000020:00000080:3.0:1787560601.757738:0:13776:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787560601.757813:0:13776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560601.757817:0:13776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560601.757819:0:13776:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787560601.757822:0:13776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560601.757824:0:13776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560601.757831:0:13776:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787560601.757835:0:13776:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9caffba72800 00000020:00000080:3.0:1787560601.757838:0:13776:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787560601.757876:0:13776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f47480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:13776:1874392862799104:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560601.757911:0:13776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560601.757929:0:13776:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec322de40 going to sleep for 11 seconds 00000100:00100000:0.0:1787560601.758501:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862799104 00000100:00100000:0.0:1787560601.758512:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862799104 00000100:00100000:0.0:1787560601.758556:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1787560601.758565:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:13776:x1874392862799104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787560601.758689:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:13776:x1874392862799104:12345-0@lo:502:llog_process_th.0 Request processed in 125us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560601.758696:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1787560601.758792:0:13776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f47480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:13776:1874392862799104:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787560601.758821:0:13776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560601.758827:0:13776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560601.758829:0:13776:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787560601.758834:0:13776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787560601.759138:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1787560601.759168:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787560601.759190:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3880400/0x4642c20bf2f33f89 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33f90 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560601.759204:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caec3880400/0x4642c20bf2f33f89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33f90 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560601.759215:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787560601.759219:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cb000817800 from 7 10000000:01000000:0.0:1787560601.759222:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787560601.759257:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3881200/0x4642c20bf2f33f97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560601.759266:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caec3881200/0x4642c20bf2f33f97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560601.759276:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caec3881200/0x4642c20bf2f33f97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560601.759297:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3902a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862799232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787560601.760005:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560601.760057:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc890900 going to sleep for 11 seconds 00000100:00100000:2.0:1787560601.760204:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862799232 00000100:00100000:2.0:1787560601.760213:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862799232 00000100:00100000:2.0:1787560601.760265:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1787560601.760275:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:6497:x1874392862799232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560601.760291:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560601.760310:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caec2168000/0x4642c20bf2f33f9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f33f97 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560601.760356:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caec2168000/0x4642c20bf2f33f9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f33f97 expref: 24 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560601.760370:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caec2168000/0x4642c20bf2f33f9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f33f97 expref: 24 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560601.760382:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2168000, rc 0) 00000100:00100000:2.0:1787560601.760976:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:6497:x1874392862799232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 699us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560601.760985:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1787560601.766490:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3902a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862799232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787560601.766532:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caec3881200/0x4642c20bf2f33f97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33f9e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560601.766558:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caec3881200/0x4642c20bf2f33f97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33f9e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560601.766671:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3902a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862799360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560601.766746:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560601.766804:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc890900 going to sleep for 11 seconds 00000100:00100000:1.0:1787560601.766809:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862799360 00000100:00100000:1.0:1787560601.766819:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862799360 00000100:00100000:1.0:1787560601.766883:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1787560601.766895:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:6497:x1874392862799360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787560601.767047:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:6497:x1874392862799360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560601.767064:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3902a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862799360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560601.767096:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3902a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862799488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787560601.767145:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560601.767163:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc890900 going to sleep for 11 seconds 00000100:00100000:1.0:1787560601.767201:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1787560601.767234:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862799488 00000100:00100000:1.0:1787560601.767238:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862799488 00000100:00100000:1.0:1787560601.767263:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1787560601.767270:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:6497:x1874392862799488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787560601.767353:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:6497:x1874392862799488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560601.767360:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1787560601.768005:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3902a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f30da5a7-84ca-46bc-bf14-dc2a954107e6:6497:1874392862799488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787560601.769193:0:13778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3902a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:13778:1874392862799616:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787560601.769272:0:13778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560601.769322:0:13778:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc890900 going to sleep for 11 seconds 00000100:00100000:1.0:1787560601.769553:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862799616 00000100:00100000:1.0:1787560601.769563:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862799616 00000100:00100000:1.0:1787560601.769623:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1787560601.769634:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:13778:x1874392862799616:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560601.769779:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:13778:x1874392862799616:12345-0@lo:502:llog_process_th.0 Request processed in 146us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560601.769786:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1787560601.769888:0:13778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3902a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:13778:1874392862799616:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787560601.769932:0:13778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560601.769944:0:13778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560601.769948:0:13778:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787560601.769956:0:13778:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cb000817800 00000020:00000080:0.0:1787560601.769959:0:13778:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787560601.770035:0:13778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560601.770040:0:13778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560601.770042:0:13778:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787560601.770045:0:13778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560601.770048:0:13778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560601.770056:0:13778:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787560601.770061:0:13778:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cb000817800 00000020:00000080:0.0:1787560601.770063:0:13778:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787560601.770105:0:13778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3902a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:13778:1874392862799744:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787560601.770146:0:13778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560601.770167:0:13778:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe0bae840 going to sleep for 11 seconds 00000100:00100000:2.0:1787560601.770573:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862799744 00000100:00100000:2.0:1787560601.770580:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862799744 00000100:00100000:2.0:1787560601.773406:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1787560601.773447:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:13778:x1874392862799744:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787560601.774018:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:13778:x1874392862799744:12345-0@lo:502:llog_process_th.0 Request processed in 593us (3869us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560601.774034:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1787560601.776606:0:13778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3902a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f30da5a7-84ca-46bc-bf14-dc2a954107e6:13778:1874392862799744:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787560601.777250:0:13778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560601.777265:0:13778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560601.777268:0:13778:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787560601.777274:0:13778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787560601.782333:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1787560601.782387:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787560601.782403:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3881200/0x4642c20bf2f33f97 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33f9e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560601.782418:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caec3881200/0x4642c20bf2f33f97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33f9e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787560601.788664:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787560602.164019:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787560602.164054:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3902a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862799872:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787560602.164151:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560602.164350:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862799872 00000100:00100000:0.0:1787560602.164361:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862799872 00000100:00100000:0.0:1787560602.164491:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787560602.164505:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862799872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787560602.164543:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560602.164653:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862800000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560602.164715:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560602.164831:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862800000 00000100:00100000:3.0:1787560602.164838:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862800000 00000100:00100000:0.0:1787560602.164901:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862799872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 399us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560602.164909:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1787560602.164973:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787560602.165026:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3902a00 x1874392862799872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560618 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560602.165047:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3902a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862799872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787560602.166337:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787560602.166355:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862800000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787560602.166394:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787560602.166506:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862800000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (1790us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560602.166515:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:0.0:1787560602.166889:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2f44380 x1874392862800000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560618 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560602.166913:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862800000:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787560602.613059:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787560602.807027:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787560602.807535:0:13775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787560603.188141:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560603.188186:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862800128:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560603.188283:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560603.188379:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862800128 00000100:00100000:0.0:1787560603.188389:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862800128 00000100:00100000:0.0:1787560603.188482:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787560603.188493:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3902680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862800128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787560603.188533:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560603.188586:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3902680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862800128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560603.188614:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787560603.188673:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862800128:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787560603.188715:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787560603.189636:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862800640:0@lo:400:kworker.0 00000100:00100000:3.0:1787560603.189693:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560603.189739:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862801152:0@lo:400:kworker.0 00000100:00100000:3.0:1787560603.189771:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560603.189805:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862801664:0@lo:400:kworker.0 00000100:00100000:3.0:1787560603.189837:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560603.189861:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787560603.189867:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862800512:0@lo:400:kworker.0 00000100:00100000:3.0:1787560603.189893:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560603.189911:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862801024:0@lo:400:kworker.0 00000100:00100000:3.0:1787560603.189934:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560603.189968:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3317100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874392862801536:0@lo:400:kworker.0 00000100:00100000:3.0:1787560603.189993:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560603.190026:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862801152 00000100:00100000:3.0:1787560603.190034:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862801152 00000100:00100000:3.0:1787560603.190269:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862801664 00000100:00100000:3.0:1787560603.190274:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862801664 00000100:00100000:3.0:1787560603.190311:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787560603.190319:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862801152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560603.190380:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862801152:12345-0@lo:400:kworker.0 Request processed in 61us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560603.190388:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787560603.190405:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787560603.190412:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3624:x1874392862801664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560603.190469:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3624:x1874392862801664:12345-0@lo:400:kworker.0 Request processed in 57us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560603.190475:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787560603.190499:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862800512 00000100:00100000:3.0:1787560603.190503:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862800512 00000100:00100000:3.0:1787560603.190530:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787560603.190536:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862800512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560603.190572:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862800512:12345-0@lo:400:kworker.0 Request processed in 36us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560603.190578:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787560603.190596:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862800640 00000100:00100000:3.0:1787560603.190600:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862800640 00000100:00100000:3.0:1787560603.190626:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862801024 00000100:00100000:3.0:1787560603.190629:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862801024 00000100:00100000:3.0:1787560603.190642:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862801536 00000100:00100000:3.0:1787560603.190653:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862801536 00000100:00100000:3.0:1787560603.190672:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1787560603.190679:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862800640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560603.190712:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862800640:12345-0@lo:400:kworker.0 Request processed in 34us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560603.190718:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1787560603.190729:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787560603.190735:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862801024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560603.190762:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862801024:12345-0@lo:400:kworker.0 Request processed in 28us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560603.190768:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787560603.190778:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787560603.190783:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874392862801536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560603.190808:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874392862801536:12345-0@lo:400:kworker.0 Request processed in 25us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560603.190814:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1787560603.191160:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3316300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862800384:0@lo:400:kworker.0 00000100:00100000:0.0:1787560603.191212:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787560603.197154:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787560603.197163:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787560603.197197:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3315f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862800256:0@lo:400:kworker.0 00000100:00100000:1.0:1787560603.197298:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560603.197360:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862800768:0@lo:400:kworker.0 00000100:00100000:1.0:1787560603.197392:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560603.197420:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862801280:0@lo:400:kworker.0 00000100:00100000:1.0:1787560603.197462:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560603.197480:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862801792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787560603.197502:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560603.197544:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862800256 00000100:00100000:1.0:1787560603.197552:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862800256 00000100:00100000:1.0:1787560603.197610:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1787560603.197620:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc8c2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3625:x1874392862800256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560603.197675:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc8c2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3625:x1874392862800256:12345-0@lo:400:kworker.0 Request processed in 56us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560603.197684:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1787560603.197734:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3315f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862800256:0@lo:400:kworker.0 00000100:00100000:0.0:1787560603.197870:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3317800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862800896:0@lo:400:kworker.0 00000100:00100000:0.0:1787560603.197904:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560603.203670:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862801408:0@lo:400:kworker.0 00000100:00100000:0.0:1787560603.203769:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560603.207443:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862800384 00000100:00100000:2.0:1787560603.207463:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862800384 00000100:00100000:2.0:1787560603.207510:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862800768 00000100:00100000:2.0:1787560603.207513:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862800768 00000100:00100000:2.0:1787560603.207605:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787560603.207616:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862800768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560603.207748:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862800768:12345-0@lo:400:kworker.0 Request processed in 134us (10355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560603.207756:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787560603.207783:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862801792 00000100:00100000:2.0:1787560603.207786:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862801792 00000100:00100000:2.0:1787560603.207842:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787560603.207849:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1874392862801792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787560603.207869:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560603.207910:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1874392862801792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (10406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560603.207916:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787560603.207971:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862800768:0@lo:400:kworker.0 00000100:00100000:2.0:1787560603.207997:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862801792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560603.208062:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862800896 00000100:00100000:2.0:1787560603.208066:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862800896 00000100:00080000:2.0:1787560603.208089:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560603.208108:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1787560603.208213:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3903480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862800384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560603.208266:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3903480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862800384:12345-0@lo:400:kworker.0 Request processed in 152us (17054us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560603.208273:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1787560603.208286:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1787560603.208291:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3900700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862800896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560603.208336:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3900700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862800896:12345-0@lo:400:kworker.0 Request processed in 45us (10431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560603.208342:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1787560603.208386:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862801280 00000100:00100000:2.0:1787560603.208390:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862801280 00000100:00100000:2.0:1787560603.208416:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787560603.208422:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862801280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560603.208492:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862801280:12345-0@lo:400:kworker.0 Request processed in 70us (11029us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560603.208513:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:2.0:1787560603.208543:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3315c00 x1874392862801280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560603.208556:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862801280:0@lo:400:kworker.0 00000100:00100000:2.0:1787560603.208619:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862800512:0@lo:400:kworker.0 00010000:00080000:2.0:1787560603.208633:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3315500 x1874392862801024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560603.208642:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862801024:0@lo:400:kworker.0 00010000:00080000:2.0:1787560603.208654:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3317100 x1874392862801536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560603.208662:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3317100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874392862801536:0@lo:400:kworker.0 00000100:00100000:2.0:1787560603.208675:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862800640:0@lo:400:kworker.0 00010000:00080000:2.0:1787560603.208686:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3317b80 x1874392862801152/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560603.208694:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862801152:0@lo:400:kworker.0 00000100:00100000:2.0:1787560603.208707:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862801664:0@lo:400:kworker.0 00000100:00100000:2.0:1787560603.209666:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862801408 00000100:00100000:2.0:1787560603.209677:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862801408 00000100:00100000:0.0:1787560603.209697:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3316300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862800384:0@lo:400:kworker.0 00000100:00100000:0.0:1787560603.209718:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3317800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862800896:0@lo:400:kworker.0 00000100:00100000:2.0:1787560603.209746:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787560603.209756:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3901c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862801408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560603.209820:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3901c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862801408:12345-0@lo:400:kworker.0 Request processed in 67us (6052us total) trans 0 rc 0/0 00000100:00080000:1.0:1787560603.209907:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560603.209984:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1787560603.212011:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862801408:0@lo:400:kworker.0 00010000:00010000:0.0:1787560603.637646:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560604.660422:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560604.725009:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3903100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862801920:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787560604.725109:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560604.725780:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862801920 00000100:00100000:0.0:1787560604.725793:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862801920 00000100:00100000:0.0:1787560604.725961:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787560604.725976:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862801920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787560604.726024:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787560604.726107:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862801920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560604.726125:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787560604.726219:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3903100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862801920:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787560605.684669:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560605.693800:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560605.693855:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560605.694327:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560605.694394:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853278080 00000100:00100000:2.0:1787560605.694407:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853278080 00000100:00100000:2.0:1787560605.694521:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 367 00000100:00100000:2.0:1787560605.694532:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc8c2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+13:2405:x1874392853278080:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560605.694620:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc8c2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+13:2405:x1874392853278080:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 89us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560605.694628:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 367 00000100:00100000:3.0:1787560605.698949:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560605.706453:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853278336 00000100:00100000:1.0:1787560605.706484:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853278336 00000100:00100000:1.0:1787560605.706612:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853278592 00000100:00100000:1.0:1787560605.706636:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853278592 00000100:00100000:1.0:1787560605.706674:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 222 00000100:00100000:1.0:1787560605.706691:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+5:2405:x1874392853278336:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560605.706802:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+5:2405:x1874392853278336:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 117us (12944us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560605.706810:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 222 00000100:00100000:1.0:1787560605.706833:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 223 00000100:00100000:1.0:1787560605.706840:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc87af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2405:x1874392853278592:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560605.706866:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc87af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2405:x1874392853278592:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 27us (12540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560605.706872:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 223 00000100:00080000:2.0:1787560605.709360:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787560605.709376:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787560605.711055:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560605.711244:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853278208 00000100:00100000:1.0:1787560605.711257:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853278208 00000100:00100000:1.0:1787560605.711344:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 224 00000100:00100000:1.0:1787560605.711356:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc87ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+5:2405:x1874392853278208:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560605.711466:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc87ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+5:2405:x1874392853278208:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 112us (12532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560605.711483:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 224 00000100:00080000:1.0:1787560605.711520:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560605.713457:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560605.713882:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853278720 00000100:00100000:1.0:1787560605.713895:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853278720 00000100:00100000:1.0:1787560605.713985:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 225 00000100:00100000:1.0:1787560605.713996:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc87ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2405:x1874392853278720:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560605.714102:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc87ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2405:x1874392853278720:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 107us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560605.714124:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 225 00000100:00080000:3.0:1787560605.714891:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787560605.714953:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853278464 00000100:00100000:2.0:1787560605.714962:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853278464 00000100:00100000:2.0:1787560605.715060:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 85 00000100:00100000:2.0:1787560605.715071:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc87ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+5:2405:x1874392853278464:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560605.715146:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc87ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+5:2405:x1874392853278464:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 78us (4106us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560605.715162:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 85 00000100:00080000:3.0:1787560605.716008:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787560605.748297:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787560605.748533:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862802048:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787560605.748632:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560605.749025:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862802048 00000100:00100000:2.0:1787560605.749036:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862802048 00000100:00100000:2.0:1787560605.749128:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787560605.749141:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc87aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862802048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787560605.749195:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787560605.749274:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc87aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862802048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560605.749282:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787560605.749521:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862802048:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787560606.708655:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787560606.776338:0:9491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:1.0:1787560607.283772:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787560607.283797:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc87aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862802176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787560607.283875:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560607.284167:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862802176 00000100:00100000:3.0:1787560607.284186:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862802176 00000100:00100000:3.0:1787560607.284253:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787560607.284264:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2005f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862802176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787560607.284293:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787560607.284355:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2005f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862802176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560607.284363:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:0.0:1787560607.284507:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cafc87aca80 x1874392862802176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560623 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560607.284537:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc87aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862802176:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787560607.284595:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787560607.286675:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3901180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862802304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787560607.286743:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560607.286858:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862802304 00000100:00100000:0.0:1787560607.286866:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862802304 00000100:00100000:0.0:1787560607.286939:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787560607.286957:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3317b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862802304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787560607.286976:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560607.287035:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3317b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862802304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560607.287041:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:0.0:1787560607.287077:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3901180 x1874392862802304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560623 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560607.287095:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3901180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862802304:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787560607.287303:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787560607.731626:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560608.307756:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc87aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862802816:0@lo:400:kworker.0 00000100:00100000:2.0:1787560608.307832:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560608.307854:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc87ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862802560:0@lo:400:kworker.0 00000100:00100000:0.0:1787560608.307884:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560608.307898:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1c2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862803328:0@lo:400:kworker.0 00000100:00100000:0.0:1787560608.307899:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1c29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874392862803072:0@lo:400:kworker.0 00000100:00100000:0.0:1787560608.307917:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560608.307919:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560608.307931:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874392862803584:0@lo:400:kworker.0 00000100:00100000:2.0:1787560608.307933:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862803840:0@lo:400:kworker.0 00000100:00100000:2.0:1787560608.307949:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560608.307949:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560608.307977:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1787560608.307978:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787560608.307983:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc87ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862802432:0@lo:400:kworker.0 00000100:00100000:0.0:1787560608.307984:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc87ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862802688:0@lo:400:kworker.0 00000100:00100000:2.0:1787560608.308008:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560608.308008:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560608.308025:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1c2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862803200:0@lo:400:kworker.0 00000100:00100000:2.0:1787560608.308026:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1c29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862802944:0@lo:400:kworker.0 00000100:00100000:2.0:1787560608.308046:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560608.308060:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1c2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862803456:0@lo:400:kworker.0 00000100:00100000:0.0:1787560608.308061:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560608.308070:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3240a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862803712:0@lo:400:kworker.0 00000100:00100000:2.0:1787560608.308079:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560608.308253:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862803328 00000100:00100000:3.0:1787560608.308260:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862803328 00000100:00100000:3.0:1787560608.308302:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862803840 00000100:00100000:3.0:1787560608.308305:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862803840 00000100:00100000:3.0:1787560608.308325:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862803456 00000100:00100000:3.0:1787560608.308328:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862803456 00000100:00100000:3.0:1787560608.308342:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787560608.308352:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3317100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862803328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560608.308479:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862802432 00000100:00100000:1.0:1787560608.308483:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862802432 00000100:00100000:1.0:1787560608.308515:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1787560608.308522:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd840bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3625:x1874392862802432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560608.312717:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560608.312773:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3243100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862804096:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560608.312826:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560608.312861:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560608.312869:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862804224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787560608.312890:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560608.312935:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862802816 00000100:00100000:0.0:1787560608.312942:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862802816 00000100:00100000:0.0:1787560608.312981:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862802560 00000100:00100000:0.0:1787560608.312983:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862802560 00000100:00100000:0.0:1787560608.312993:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862803072 00000100:00100000:0.0:1787560608.312996:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862803072 00000100:00100000:0.0:1787560608.313010:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862803584 00000100:00100000:0.0:1787560608.313013:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862803584 00000100:00100000:0.0:1787560608.313025:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862803200 00000100:00100000:0.0:1787560608.313028:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862803200 00000100:00100000:0.0:1787560608.313039:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862803712 00000100:00100000:0.0:1787560608.313042:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862803712 00000100:00100000:0.0:1787560608.313057:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787560608.313066:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862802816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560608.313113:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862802816:12345-0@lo:400:kworker.0 Request processed in 47us (5281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560608.313120:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787560608.313154:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787560608.313288:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3901180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862802560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560608.313330:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3901180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862802560:12345-0@lo:400:kworker.0 Request processed in 169us (5444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560608.313344:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787560608.313358:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787560608.313364:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3903b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874392862803072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560608.313395:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3903b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874392862803072:12345-0@lo:400:kworker.0 Request processed in 32us (5477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560608.313401:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787560608.313413:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787560608.313419:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3901500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874392862803584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560608.313467:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3901500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874392862803584:12345-0@lo:400:kworker.0 Request processed in 48us (5517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560608.313473:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787560608.313485:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787560608.313491:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3902a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862803200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560608.313519:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3902a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862803200:12345-0@lo:400:kworker.0 Request processed in 28us (5456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560608.313525:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787560608.313535:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787560608.313541:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874392862803712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560608.313564:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874392862803712:12345-0@lo:400:kworker.0 Request processed in 23us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560608.313570:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787560608.313588:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862802688 00000100:00100000:0.0:1787560608.313592:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862802688 00000100:00100000:0.0:1787560608.313626:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862802944 00000100:00100000:0.0:1787560608.313630:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862802944 00000100:00100000:0.0:1787560608.313653:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787560608.313659:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3903100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862802688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560608.313691:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3903100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862802688:12345-0@lo:400:kworker.0 Request processed in 32us (5682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560608.313697:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787560608.313709:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787560608.313715:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862802944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560608.313742:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862802944:12345-0@lo:400:kworker.0 Request processed in 27us (5695us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560608.313747:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787560608.313765:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862804096 00000100:00100000:0.0:1787560608.313768:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862804096 00000100:00100000:0.0:1787560608.313796:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862804224 00000100:00100000:0.0:1787560608.313799:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862804224 00000100:00100000:0.0:1787560608.313814:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787560608.313820:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3623:x1874392862804096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787560608.313841:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560608.313874:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3623:x1874392862804096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560608.313880:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787560608.313892:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787560608.313898:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862804224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787560608.313907:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560608.313928:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862804224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 30us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560608.313934:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787560608.313981:0:3623:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1787560608.313987:0:3623:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9caffcaa8380, transno 4294967301 00000100:00100000:0.0:1787560608.314004:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862804224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787560608.314019:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3243100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862804096:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560608.314030:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc87ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862802688:0@lo:400:kworker.0 00010000:00080000:0.0:1787560608.314051:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec1c2b800 x1874392862803200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560608.314061:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1c2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862803200:0@lo:400:kworker.0 00010000:00080000:0.0:1787560608.314072:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3240a80 x1874392862803712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560608.314082:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3240a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862803712:0@lo:400:kworker.0 00000100:00100000:0.0:1787560608.314093:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc87ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862802560:0@lo:400:kworker.0 00000100:00100000:0.0:1787560608.314104:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1c29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874392862803072:0@lo:400:kworker.0 00000100:00100000:0.0:1787560608.314113:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874392862803584:0@lo:400:kworker.0 00000100:00080000:0.0:1787560608.315527:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787560608.315533:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787560608.315536:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787560608.315554:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787560608.315567:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3315500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862803840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560608.315638:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3315500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862803840:12345-0@lo:400:kworker.0 Request processed in 75us (7688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560608.315646:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787560608.315675:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787560608.315683:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4aa7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862803456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560608.315713:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4aa7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862803456:12345-0@lo:400:kworker.0 Request processed in 31us (7632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560608.315719:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:2.0:1787560608.318554:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec1c2b480 x1874392862803456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560608.318573:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1c2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862803456:0@lo:400:kworker.0 00000100:00100000:2.0:1787560608.318585:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3241500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862803968:0@lo:400:kworker.0 00000100:00100000:2.0:1787560608.318649:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560608.318681:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc87aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862802816:0@lo:400:kworker.0 00000100:00100000:2.0:1787560608.318693:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862803840:0@lo:400:kworker.0 00000100:00100000:2.0:1787560608.318736:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1c29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862802944:0@lo:400:kworker.0 00000100:00100000:3.0:1787560608.318907:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3317100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862803328:12345-0@lo:400:kworker.0 Request processed in 10554us (10983us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560608.318918:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787560608.319099:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862803968 00000100:00100000:3.0:1787560608.319106:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862803968 00000100:00100000:3.0:1787560608.319180:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787560608.319190:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3315c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862803968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560608.319236:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3315c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862803968:12345-0@lo:400:kworker.0 Request processed in 47us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560608.319249:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787560608.319470:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3241500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862803968:0@lo:400:kworker.0 00010000:00080000:2.0:1787560608.319482:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec1c2ad80 x1874392862803328/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560608.319490:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1c2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862803328:0@lo:400:kworker.0 00000100:00100000:1.0:1787560608.327068:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd840bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3625:x1874392862802432:12345-0@lo:400:kworker.0 Request processed in 18536us (19048us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560608.327083:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1787560608.327243:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc87ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862802432:0@lo:400:kworker.0 00010000:00010000:2.0:1787560608.755673:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560609.779744:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560609.844466:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787560609.844489:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862804352:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787560609.844565:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560609.844729:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862804352 00000100:00100000:0.0:1787560609.844738:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862804352 00000100:00100000:0.0:1787560609.844785:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787560609.844795:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862804352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787560609.844827:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787560609.844993:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862804352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 199us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560609.845000:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787560609.850054:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862804352:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787560610.803576:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560610.816903:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560610.816959:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560610.816995:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560610.817022:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560610.817043:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560610.817066:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560610.817173:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853279232 00000100:00100000:2.0:1787560610.817183:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853279232 00000100:00100000:0.0:1787560610.817225:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853278976 00000100:00100000:0.0:1787560610.817229:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853278976 00000100:00100000:0.0:1787560610.817250:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853279488 00000100:00100000:2.0:1787560610.817251:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 90 00000100:00100000:0.0:1787560610.817252:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853279488 00000100:00100000:2.0:1787560610.817260:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853279232:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560610.817263:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853279104 00000100:00100000:0.0:1787560610.817265:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853279104 00000100:00100000:0.0:1787560610.817274:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853279360 00000100:00100000:0.0:1787560610.817276:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853279360 00000100:00100000:0.0:1787560610.817289:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 232 00000100:00100000:0.0:1787560610.817294:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853278976:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560610.817373:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 233 00000100:00100000:1.0:1787560610.817382:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853279488:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560610.817427:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853279232:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 68us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560610.817460:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 90 00000100:00100000:2.0:1787560610.817501:0:10172:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1787560610.817509:0:10172:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1787560610.817524:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853278848 00000100:00100000:2.0:1787560610.817528:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853278848 00000100:00100000:2.0:1787560610.817552:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 369 00000100:00100000:2.0:1787560610.817559:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd8409850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+13:2403:x1874392853278848:12345-192.168.203.29@tcp:400:kworker.0 00000100:00080000:3.0:1787560610.817621:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787560610.817625:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787560610.817628:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787560610.817682:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787560610.817693:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 234 00000100:00100000:3.0:1787560610.817700:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853279104:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560610.824320:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853278976:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 7012us (7415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560610.824337:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 232 00000100:00100000:0.0:1787560610.824378:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787560610.824394:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 235 00000100:00100000:0.0:1787560610.824424:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853279360:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560610.824583:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853279360:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 166us (7515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560610.824590:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 235 00000100:00100000:1.0:1787560610.825174:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853279488:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 7791us (8176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560610.825184:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 233 00000100:00100000:2.0:1787560610.826732:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd8409850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+13:2403:x1874392853278848:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 9163us (9700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560610.826747:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 369 00000100:00100000:3.0:1787560610.828687:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853279104:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 10977us (11633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560610.828702:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 234 00000100:00100000:0.0:1787560610.869897:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787560610.869921:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862804480:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787560610.869994:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560610.870162:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862804480 00000100:00100000:1.0:1787560610.870171:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862804480 00000100:00100000:1.0:1787560610.870216:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787560610.870230:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862804480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787560610.870261:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787560610.870321:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862804480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560610.870343:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787560610.870743:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862804480:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787560611.830103:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787560612.020346:0:13775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787560612.021381:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787560612.403965:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862804608:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787560612.404039:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560612.404169:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862804608 00000100:00100000:2.0:1787560612.404177:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862804608 00000100:00100000:2.0:1787560612.404250:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787560612.404261:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862804608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787560612.404291:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1787560612.404679:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560612.404699:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862804736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787560612.404733:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560612.404773:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862804736 00000100:00100000:0.0:1787560612.404777:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862804736 00000100:00100000:0.0:1787560612.404806:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787560612.404813:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862804736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787560612.404824:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560612.404855:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862804736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560612.404861:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:0.0:1787560612.404878:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787560612.404903:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3243480 x1874392862804736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560628 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560612.404921:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862804736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560612.410074:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862804608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5805us (6024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560612.410091:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:1.0:1787560612.410340:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2f4e680 x1874392862804608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560628 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560612.410365:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862804608:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787560612.851582:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560613.429677:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862804864:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787560613.429752:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560613.429796:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862805376:0@lo:400:kworker.0 00000100:00100000:2.0:1787560613.429820:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560613.429850:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862805888:0@lo:400:kworker.0 00000100:00100000:2.0:1787560613.429875:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560613.429893:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2cce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874392862806400:0@lo:400:kworker.0 00000100:00100000:2.0:1787560613.429913:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560613.429938:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1787560613.429944:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862804992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560613.429965:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560613.429980:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1fac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862805504:0@lo:400:kworker.0 00000100:00100000:2.0:1787560613.429996:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560613.430537:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862806016:0@lo:400:kworker.0 00000100:00100000:2.0:1787560613.430575:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560613.430599:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862806528:0@lo:400:kworker.0 00000100:00100000:2.0:1787560613.430633:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560613.430675:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862804864 00000100:00100000:2.0:1787560613.430684:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862804864 00000100:00100000:2.0:1787560613.430732:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862804992 00000100:00100000:2.0:1787560613.430736:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862804992 00000100:00100000:2.0:1787560613.430754:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787560613.430763:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3314380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862804864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787560613.430794:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560613.430914:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3314380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862804864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 151us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560613.430921:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787560613.430937:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787560613.430943:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3315500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862804992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787560613.430953:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560613.430975:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3315500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862804992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560613.430980:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787560613.430997:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862805376 00000100:00100000:2.0:1787560613.431001:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862805376 00000100:00100000:2.0:1787560613.431225:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787560613.431233:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862805376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560613.431271:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862805376:12345-0@lo:400:kworker.0 Request processed in 39us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560613.431277:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787560613.431658:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862804992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560613.431675:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862804864:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787560613.431697:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862805376:0@lo:400:kworker.0 00000100:00100000:2.0:1787560613.431976:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3243100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862805248:0@lo:400:kworker.0 00000100:00100000:2.0:1787560613.432010:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560613.432267:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec390aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862805760:0@lo:400:kworker.0 00000100:00100000:2.0:1787560613.432293:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560613.432312:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874392862806272:0@lo:400:kworker.0 00000100:00100000:2.0:1787560613.432333:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560613.432349:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1787560613.432355:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3240a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862805120:0@lo:400:kworker.0 00000100:00100000:2.0:1787560613.432381:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560613.432408:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec390a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862805632:0@lo:400:kworker.0 00000100:00100000:2.0:1787560613.432456:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560613.432655:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862805888 00000100:00100000:0.0:1787560613.432670:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862805888 00000100:00100000:0.0:1787560613.432708:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862806400 00000100:00100000:0.0:1787560613.432711:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862806400 00000100:00100000:0.0:1787560613.432724:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862805504 00000100:00100000:0.0:1787560613.432727:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862805504 00000100:00100000:0.0:1787560613.432738:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862805248 00000100:00100000:0.0:1787560613.432740:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862805248 00000100:00100000:0.0:1787560613.432749:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862805760 00000100:00100000:0.0:1787560613.432752:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862805760 00000100:00100000:0.0:1787560613.432762:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862806272 00000100:00100000:0.0:1787560613.432764:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862806272 00000100:00100000:0.0:1787560613.432779:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787560613.432786:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862805888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560613.432859:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862806144:0@lo:400:kworker.0 00000100:00100000:1.0:1787560613.433686:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787560613.433698:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874392862806400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560613.434460:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862806016 00000100:00100000:3.0:1787560613.434469:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862806016 00000100:00100000:3.0:1787560613.434513:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862806528 00000100:00100000:3.0:1787560613.434516:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862806528 00000100:00100000:3.0:1787560613.434537:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787560613.434561:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862806016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560613.435171:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862805888:12345-0@lo:400:kworker.0 Request processed in 2381us (5291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560613.435182:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787560613.435782:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787560613.435798:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862805504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560613.436013:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862805504:12345-0@lo:400:kworker.0 Request processed in 222us (6014us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560613.436021:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787560613.436039:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787560613.436046:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862805248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560613.436335:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862805248:12345-0@lo:400:kworker.0 Request processed in 288us (4324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560613.436342:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787560613.436355:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787560613.436362:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862805760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560613.436405:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862805760:12345-0@lo:400:kworker.0 Request processed in 45us (4111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560613.436411:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787560613.436421:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787560613.436427:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874392862806272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560613.436473:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874392862806272:12345-0@lo:400:kworker.0 Request processed in 46us (4139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560613.436478:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787560613.436507:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787560613.436513:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3315180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862806528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560613.436542:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3315180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862806528:12345-0@lo:400:kworker.0 Request processed in 31us (5909us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560613.436548:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1787560613.436565:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787560613.436569:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787560613.436572:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787560613.436608:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1fac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862805504:0@lo:400:kworker.0 00000100:00100000:0.0:1787560613.436621:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862806528:0@lo:400:kworker.0 00010000:00080000:0.0:1787560613.436636:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3908e00 x1874392862805888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560613.436647:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862805888:0@lo:400:kworker.0 00000100:00100000:0.0:1787560613.437578:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862805632 00000100:00100000:0.0:1787560613.437588:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862805632 00000100:00100000:0.0:1787560613.437641:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787560613.437649:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862805632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560613.437720:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862805632:12345-0@lo:400:kworker.0 Request processed in 72us (5263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560613.437726:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787560613.437749:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862805120 00000100:00100000:0.0:1787560613.437753:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862805120 00000100:00100000:0.0:1787560613.437781:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1787560613.437787:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd8408050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3624:x1874392862805120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560613.437819:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd8408050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3624:x1874392862805120:12345-0@lo:400:kworker.0 Request processed in 33us (5437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560613.437825:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1787560613.441670:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560613.441718:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3853100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862806656:0@lo:400:kworker.0 00000100:00100000:2.0:1787560613.441749:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560613.441778:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862806144 00000100:00100000:2.0:1787560613.441787:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862806144 00000100:00100000:2.0:1787560613.442572:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862806656 00000100:00100000:2.0:1787560613.442580:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862806656 00000100:00100000:1.0:1787560613.442693:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874392862806400:12345-0@lo:400:kworker.0 Request processed in 8996us (12775us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560613.442704:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00010000:00080000:1.0:1787560613.442758:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2cce680 x1874392862806400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560613.442772:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2cce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874392862806400:0@lo:400:kworker.0 00000100:00100000:3.0:1787560613.444171:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862806016:12345-0@lo:400:kworker.0 Request processed in 9506us (13488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560613.444183:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787560613.444212:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787560613.444223:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3316d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862806144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560613.444342:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3316d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862806144:12345-0@lo:400:kworker.0 Request processed in 122us (2680us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560613.444348:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787560613.444362:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787560613.444369:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862806656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560613.444399:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862806656:12345-0@lo:400:kworker.0 Request processed in 31us (2650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560613.444405:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787560613.449567:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3853100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862806656:0@lo:400:kworker.0 00000100:00100000:0.0:1787560613.449589:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3243100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862805248:0@lo:400:kworker.0 00000100:00100000:0.0:1787560613.450203:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec390aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862805760:0@lo:400:kworker.0 00000100:00100000:0.0:1787560613.450221:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874392862806272:0@lo:400:kworker.0 00000100:00100000:0.0:1787560613.450253:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3240a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862805120:0@lo:400:kworker.0 00000100:00100000:0.0:1787560613.450264:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec390a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862805632:0@lo:400:kworker.0 00010000:00080000:0.0:1787560613.450279:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2ccc000 x1874392862806144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560613.450290:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862806144:0@lo:400:kworker.0 00010000:00080000:0.0:1787560613.450351:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3938e00 x1874392862806016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560613.450463:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862806016:0@lo:400:kworker.0 00010000:00010000:3.0:1787560613.877799:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560614.899559:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560614.963716:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862806784:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787560614.963789:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560614.964424:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862806784 00000100:00100000:3.0:1787560614.964455:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862806784 00000100:00100000:3.0:1787560614.964500:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787560614.964509:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862806784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787560614.964540:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787560614.964601:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862806784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560614.964607:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787560614.964839:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862806784:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787560615.923909:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560615.940417:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560615.940496:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560615.940585:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853279616 00000100:00100000:0.0:1787560615.940596:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853279616 00000100:00100000:2.0:1787560615.940655:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560615.940660:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 371 00000100:00100000:0.0:1787560615.940737:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd087b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+13:2402:x1874392853279616:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560615.940817:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd087b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+13:2402:x1874392853279616:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 146us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560615.940824:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 371 00000100:00100000:1.0:1787560615.941333:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853279744 00000100:00100000:1.0:1787560615.941339:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853279744 00000100:00100000:1.0:1787560615.941398:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853279872 00000100:00100000:1.0:1787560615.941401:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853279872 00000100:00100000:3.0:1787560615.941483:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 242 00000100:00100000:3.0:1787560615.941495:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:2402:x1874392853279744:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560615.941504:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 243 00000100:00100000:1.0:1787560615.941518:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+5:2402:x1874392853279872:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560615.941563:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:2402:x1874392853279744:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 70us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560615.941570:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 242 00000100:00080000:2.0:1787560615.941595:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787560615.941612:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560615.945210:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+5:2402:x1874392853279872:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 3685us (4543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560615.945226:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 243 00000100:00100000:3.0:1787560615.964981:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560615.965033:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560615.965060:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560615.965125:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853280000 00000100:00100000:2.0:1787560615.965135:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853280000 00000100:00100000:2.0:1787560615.965211:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 27 00000100:00100000:2.0:1787560615.965222:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+5:2401:x1874392853280000:12345-192.168.203.29@tcp:9:kworker.0 00000020:00000080:2.0:1787560615.965253:0:8415:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33ec5 00000100:00080000:2.0:1787560615.965263:0:8415:0:(import.c:65:import_set_state_nolock()) ffff9cafffe2c800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787560615.965311:0:8415:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:2.0:1787560615.965487:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+2:2401:x1874392853280000:12345-192.168.203.29@tcp:9:kworker.0 Request processed in 266us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560615.965495:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 27 00010000:00010000:2.0:1787560615.965515:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560615.965861:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853280128 00000100:00100000:0.0:1787560615.965867:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853280128 00000100:00100000:0.0:1787560615.965906:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853280256 00000100:00100000:0.0:1787560615.965910:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853280256 00000100:00100000:0.0:1787560615.965933:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 244 00000100:00100000:0.0:1787560615.965940:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853280128:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560615.965979:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853280128:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 39us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560615.965986:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 244 00000100:00100000:0.0:1787560615.965999:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 245 00000100:00100000:0.0:1787560615.966016:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853280256:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560615.966042:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853280256:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 37us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560615.966048:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 245 00000100:00080000:0.0:1787560615.966090:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787560615.966093:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787560615.966096:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787560615.987892:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862806912:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787560615.987981:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560615.996198:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862806912 00000100:00100000:2.0:1787560615.996213:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862806912 00000100:00100000:2.0:1787560615.996277:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787560615.996288:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862806912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787560615.996325:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787560615.996408:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862806912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (8427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560615.996415:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787560615.996581:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862806912:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787560616.948756:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560617.523798:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862807040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560617.523874:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560617.524138:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862807040 00000100:00100000:0.0:1787560617.524147:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862807040 00000100:00100000:0.0:1787560617.524208:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787560617.524218:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862807040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787560617.524252:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560617.524297:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862807040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560617.524304:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:2.0:1787560617.524363:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787560617.524407:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2f4fb80 x1874392862807040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560617.524425:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862807040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787560617.525293:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862807168:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787560617.525331:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560617.525456:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862807168 00000100:00100000:0.0:1787560617.525462:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862807168 00000100:00100000:0.0:1787560617.525515:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787560617.525524:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862807168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787560617.525540:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560617.525572:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862807168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560617.525578:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:1.0:1787560617.525650:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2f4dc00 x1874392862807168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560617.525665:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862807168:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787560617.525721:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787560617.971700:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560618.548038:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862807296:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560618.548134:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560618.548353:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787560618.548363:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862807424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787560618.548398:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560618.548484:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862807296 00000100:00100000:0.0:1787560618.548491:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862807296 00000100:00100000:0.0:1787560618.548566:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862807424 00000100:00100000:0.0:1787560618.548569:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862807424 00000100:00100000:0.0:1787560618.548588:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787560618.548607:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862807296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787560618.548649:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560618.548691:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862807296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560618.548699:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787560618.548715:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787560618.548722:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862807424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787560618.548731:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560618.548754:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862807424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560618.548760:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787560618.548793:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862807296:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787560618.549272:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787560618.549299:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862807424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787560618.549787:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2cce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862807680:0@lo:400:kworker.0 00000100:00100000:1.0:1787560618.549826:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560618.549847:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874392862808192:0@lo:400:kworker.0 00000100:00100000:1.0:1787560618.549866:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560618.549885:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafe0687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874392862808704:0@lo:400:kworker.0 00000100:00100000:1.0:1787560618.549904:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560618.549932:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787560618.549938:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862807808:0@lo:400:kworker.0 00000100:00100000:1.0:1787560618.549961:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560618.549975:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862808320:0@lo:400:kworker.0 00000100:00100000:1.0:1787560618.549992:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560618.550006:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff48f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862808832:0@lo:400:kworker.0 00000100:00100000:2.0:1787560618.550160:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862807552:0@lo:400:kworker.0 00000100:00100000:2.0:1787560618.550193:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560618.550212:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862808064:0@lo:400:kworker.0 00000100:00100000:2.0:1787560618.550233:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560618.550250:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafe0686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862808576:0@lo:400:kworker.0 00000100:00100000:2.0:1787560618.550272:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560618.550290:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787560618.550295:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874392862807936:0@lo:400:kworker.0 00000100:00100000:2.0:1787560618.550316:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560618.550332:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862808448:0@lo:400:kworker.0 00000100:00100000:2.0:1787560618.550349:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560618.550373:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862807680 00000100:00100000:2.0:1787560618.550378:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862807680 00000100:00100000:2.0:1787560618.550408:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862808192 00000100:00100000:2.0:1787560618.550411:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862808192 00000100:00100000:2.0:1787560618.550449:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862808704 00000100:00100000:2.0:1787560618.550452:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862808704 00000100:00100000:2.0:1787560618.550464:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862808320 00000100:00100000:2.0:1787560618.550467:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862808320 00000100:00100000:2.0:1787560618.550478:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862807936 00000100:00100000:2.0:1787560618.550481:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862807936 00000100:00100000:2.0:1787560618.550495:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787560618.550502:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862807680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560618.550566:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862807680:12345-0@lo:400:kworker.0 Request processed in 63us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560618.550574:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787560618.550589:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787560618.550659:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862808576 00000100:00100000:3.0:1787560618.550665:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862808576 00000100:00100000:2.0:1787560618.550674:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874392862808192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560618.550695:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862808448 00000100:00100000:3.0:1787560618.550700:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862808448 00000100:00100000:2.0:1787560618.550712:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874392862808192:12345-0@lo:400:kworker.0 Request processed in 116us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560618.550720:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787560618.550724:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787560618.550739:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1787560618.550747:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874392862808704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560618.550772:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874392862808704:12345-0@lo:400:kworker.0 Request processed in 27us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560618.550779:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1787560618.550790:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1787560618.550795:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862808320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560618.550800:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862808576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560618.550823:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862808320:12345-0@lo:400:kworker.0 Request processed in 27us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560618.550829:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1787560618.550844:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787560618.550853:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874392862807936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560618.550859:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862808576:12345-0@lo:400:kworker.0 Request processed in 126us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560618.550867:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787560618.550884:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787560618.550889:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874392862807936:12345-0@lo:400:kworker.0 Request processed in 38us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560618.550895:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862808448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560618.550900:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00080000:2.0:1787560618.550933:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787560618.550934:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862808448:12345-0@lo:400:kworker.0 Request processed in 41us (582us total) trans 0 rc 0/0 00000100:00080000:2.0:1787560618.550939:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560618.550943:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787560618.551043:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560618.551085:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2cce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862807680:0@lo:400:kworker.0 00000100:00100000:1.0:1787560618.551144:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874392862808192:0@lo:400:kworker.0 00000100:00100000:1.0:1787560618.551158:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafe0687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874392862808704:0@lo:400:kworker.0 00010000:00080000:1.0:1787560618.551181:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcb08e00 x1874392862808320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560618.551191:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862808320:0@lo:400:kworker.0 00000100:00100000:1.0:1787560618.551212:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862808832 00000100:00100000:1.0:1787560618.551215:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862808832 00000100:00100000:1.0:1787560618.551241:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787560618.551246:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874392862808832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560618.551325:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862807808 00000100:00100000:0.0:1787560618.551330:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862807808 00000100:00100000:0.0:1787560618.551354:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862808064 00000100:00100000:0.0:1787560618.551356:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862808064 00000100:00100000:0.0:1787560618.551368:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787560618.551374:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862807808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560618.551412:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862807808:12345-0@lo:400:kworker.0 Request processed in 38us (1450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560618.551418:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787560618.551444:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787560618.551451:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862808064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560618.551479:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862808064:12345-0@lo:400:kworker.0 Request processed in 29us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560618.551485:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787560618.551677:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874392862808832:12345-0@lo:400:kworker.0 Request processed in 429us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560618.551683:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787560618.551712:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862807808:0@lo:400:kworker.0 00010000:00080000:1.0:1787560618.551722:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caff48f8a80 x1874392862808832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560618.551730:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff48f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862808832:0@lo:400:kworker.0 00000100:00100000:1.0:1787560618.551769:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862807552 00000100:00100000:1.0:1787560618.551773:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862807552 00000100:00080000:2.0:1787560618.552117:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787560618.552128:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874392862807936:0@lo:400:kworker.0 00010000:00080000:3.0:1787560618.552143:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcb0a680 x1874392862808448/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560618.552153:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862808448:0@lo:400:kworker.0 00000100:00100000:1.0:1787560618.552179:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1787560618.552190:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd0878450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3626:x1874392862807552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560618.552229:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd0878450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3626:x1874392862807552:12345-0@lo:400:kworker.0 Request processed in 42us (2035us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560618.552235:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1787560618.552530:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862808064:0@lo:400:kworker.0 00010000:00080000:3.0:1787560618.552545:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cafe0686300 x1874392862808576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560618.552553:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafe0686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862808576:0@lo:400:kworker.0 00000100:00100000:3.0:1787560618.552571:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862807552:0@lo:400:kworker.0 00010000:00010000:0.0:1787560618.995677:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560620.019574:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560620.084298:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787560620.084320:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862808960:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787560620.084405:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560620.084670:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862808960 00000100:00100000:0.0:1787560620.084678:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862808960 00000100:00100000:0.0:1787560620.084735:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787560620.084745:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862808960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787560620.084777:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787560620.084831:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862808960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560620.084838:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787560620.084953:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862808960:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787560621.043710:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560621.076113:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560621.076160:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560621.076200:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560621.076286:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853280384 00000100:00100000:0.0:1787560621.076297:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853280384 00000100:00100000:0.0:1787560621.076358:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 373 00000100:00100000:0.0:1787560621.076369:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd3219c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+13:2404:x1874392853280384:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560621.076465:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd3219c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+13:2404:x1874392853280384:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 97us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560621.076473:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 373 00000100:00100000:3.0:1787560621.076646:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853280512 00000100:00100000:3.0:1787560621.076651:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853280512 00000100:00100000:3.0:1787560621.076705:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853280640 00000100:00100000:3.0:1787560621.076709:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853280640 00000100:00100000:3.0:1787560621.076729:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 252 00000100:00100000:3.0:1787560621.076736:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+5:2405:x1874392853280512:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560621.076770:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+5:2405:x1874392853280512:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 34us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560621.076776:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 252 00000100:00100000:3.0:1787560621.076790:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 253 00000100:00100000:3.0:1787560621.076796:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+5:2404:x1874392853280640:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560621.076820:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+5:2404:x1874392853280640:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 25us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560621.076826:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 253 00000100:00080000:1.0:1787560621.076896:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787560621.076900:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560621.090216:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560621.090251:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560621.090454:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853280896 00000100:00100000:0.0:1787560621.090465:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853280896 00000100:00100000:0.0:1787560621.090539:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853280768 00000100:00100000:0.0:1787560621.090543:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853280768 00000100:00100000:0.0:1787560621.090568:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 254 00000100:00100000:0.0:1787560621.090577:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2402:x1874392853280896:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560621.090661:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2402:x1874392853280896:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 85us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560621.090669:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 254 00000100:00100000:0.0:1787560621.090685:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 255 00000100:00100000:0.0:1787560621.090692:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853280768:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560621.090734:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853280768:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 43us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560621.090742:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 255 00000100:00080000:1.0:1787560621.090853:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787560621.090858:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787560621.108023:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec38e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862809088:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787560621.108107:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560621.108349:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862809088 00000100:00100000:2.0:1787560621.108357:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862809088 00000100:00100000:2.0:1787560621.108408:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787560621.108418:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862809088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787560621.108474:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787560621.108527:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862809088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560621.108534:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787560621.108703:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec38e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862809088:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1787560621.627570:0:9491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9331bacf-6cfc-4379-8649-925e79b19df1 00000020:00000080:1.0:1787560621.627581:0:9491:0:(genops.c:885:class_export_put()) final put ffff9cafffe2e000/9331bacf-6cfc-4379-8649-925e79b19df1 00000020:00000080:2.0:1787560621.628127:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafffe2e000/9331bacf-6cfc-4379-8649-925e79b19df1 for lustre-OST0001 00000020:00000080:2.0:1787560621.633869:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cafffe2c800 for lustre-OST0001 00010000:00010000:0.0:1787560622.070458:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787560622.260353:0:13775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787560622.261072:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787560622.645121:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787560622.645161:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafe0687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862809216:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787560622.645258:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560622.645516:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862809216 00000100:00100000:1.0:1787560622.645527:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862809216 00000100:00100000:1.0:1787560622.645617:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787560622.645630:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862809216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787560622.645668:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787560622.645732:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862809216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560622.645739:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:2.0:1787560622.645835:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787560622.647135:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862809344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787560622.647198:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787560622.647269:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cafe0687800 x1874392862809216/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560638 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560622.647293:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafe0687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862809216:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787560622.647338:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862809344 00000100:00100000:3.0:1787560622.647345:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862809344 00000100:00100000:3.0:1787560622.647398:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787560622.647407:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862809344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787560622.647451:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787560622.647492:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862809344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560622.647500:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:3.0:1787560622.647531:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec33c0380 x1874392862809344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560638 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560622.647544:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862809344:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787560622.647576:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787560623.092732:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560623.667940:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafe0687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862809472:0@lo:400:kworker.0 00000100:00100000:0.0:1787560623.668057:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560623.668131:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787560623.668137:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862809600:0@lo:400:kworker.0 00000100:00100000:0.0:1787560623.668168:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560623.668188:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862809984:0@lo:400:kworker.0 00000100:00100000:1.0:1787560623.668212:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862810112:0@lo:400:kworker.0 00000100:00100000:0.0:1787560623.668212:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560623.668227:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2cce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862810496:0@lo:400:kworker.0 00000100:00100000:1.0:1787560623.668243:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560623.668249:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560623.668262:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862810624:0@lo:400:kworker.0 00000100:00100000:0.0:1787560623.668265:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862811008:0@lo:400:kworker.0 00000100:00100000:1.0:1787560623.668282:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560623.668282:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560623.668310:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862809728:0@lo:400:kworker.0 00000100:00100000:0.0:1787560623.668326:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862809472 00000100:00100000:1.0:1787560623.668336:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560623.668336:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862809472 00000100:00100000:1.0:1787560623.668361:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862810240:0@lo:400:kworker.0 00000100:00100000:1.0:1787560623.668383:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560623.668389:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1787560623.668396:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862810752:0@lo:400:kworker.0 00000100:00100000:0.0:1787560623.668399:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3625:x1874392862809472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560623.668489:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3625:x1874392862809472:12345-0@lo:400:kworker.0 Request processed in 90us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560623.668496:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1787560623.668531:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862809600 00000100:00100000:0.0:1787560623.668535:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862809600 00000100:00100000:1.0:1787560623.668563:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560623.671150:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787560623.671170:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862809856:0@lo:400:kworker.0 00000100:00100000:1.0:1787560623.671237:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560623.671569:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862810112 00000100:00100000:3.0:1787560623.671570:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862810624 00000100:00100000:3.0:1787560623.671580:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862810624 00000100:00100000:0.0:1787560623.671580:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862810112 00000100:00100000:2.0:1787560623.671608:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862810240 00000100:00100000:2.0:1787560623.671613:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862810240 00000100:00100000:2.0:1787560623.671648:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862810752 00000100:00100000:2.0:1787560623.671651:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862810752 00000100:00100000:2.0:1787560623.671671:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787560623.671710:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787560623.671722:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862810624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560623.671725:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862809600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560623.671792:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862809600:12345-0@lo:400:kworker.0 Request processed in 112us (3621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560623.671883:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862810624:12345-0@lo:400:kworker.0 Request processed in 165us (3600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560623.672062:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787560623.672072:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862810240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560623.672118:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862810240:12345-0@lo:400:kworker.0 Request processed in 49us (3733us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560623.672125:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787560623.672145:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787560623.672151:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874392862810752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560623.672181:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874392862810752:12345-0@lo:400:kworker.0 Request processed in 30us (3618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560623.672187:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787560623.672198:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787560623.672215:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787560623.672223:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787560623.672232:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862809856 00000100:00100000:2.0:1787560623.672237:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862809856 00000100:00100000:1.0:1787560623.672250:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862810368:0@lo:400:kworker.0 00000100:00100000:3.0:1787560623.672263:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862809984 00000100:00100000:3.0:1787560623.672269:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862809984 00000100:00100000:2.0:1787560623.672270:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787560623.672280:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862809856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560623.672283:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560623.672306:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862810880:0@lo:400:kworker.0 00000100:00100000:1.0:1787560623.672327:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560623.672371:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862810112:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1787560623.672379:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcb09500 x1874392862810240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560623.672395:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862810240:0@lo:400:kworker.0 00000100:00100000:0.0:1787560623.672400:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862810112:12345-0@lo:400:kworker.0 Request processed in 197us (4157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560623.672406:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787560623.672463:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862810496 00000100:00100000:0.0:1787560623.672467:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862810496 00000100:00100000:0.0:1787560623.672487:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862811008 00000100:00100000:0.0:1787560623.672490:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862811008 00000100:00100000:0.0:1787560623.672504:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862810368 00000100:00100000:0.0:1787560623.672506:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862810368 00000100:00100000:0.0:1787560623.672516:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862810880 00000100:00100000:0.0:1787560623.672518:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862810880 00000100:00100000:0.0:1787560623.672533:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787560623.672540:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862810496:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1787560623.672547:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2f44a80 x1874392862810752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560623.672559:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862810752:0@lo:400:kworker.0 00000100:00100000:3.0:1787560623.672561:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862809728 00000100:00100000:3.0:1787560623.672567:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862809728 00000100:00100000:0.0:1787560623.672574:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862810496:12345-0@lo:400:kworker.0 Request processed in 34us (4322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560623.672594:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787560623.672604:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787560623.672608:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862809984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560623.672612:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787560623.672620:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787560623.672623:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862811008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560623.672626:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862810368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560623.672663:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862811008:12345-0@lo:400:kworker.0 Request processed in 43us (4380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560623.672664:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862810368:12345-0@lo:400:kworker.0 Request processed in 39us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560623.672670:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787560623.672733:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862809984:12345-0@lo:400:kworker.0 Request processed in 128us (4518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560623.672735:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862809856:12345-0@lo:400:kworker.0 Request processed in 456us (1495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560623.672749:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787560623.672760:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787560623.672772:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787560623.672781:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862809728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560623.672813:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862809728:12345-0@lo:400:kworker.0 Request processed in 35us (4477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560623.672819:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787560623.672910:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787560623.672922:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec38e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862811264:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787560623.672957:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560623.673258:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862811264 00000100:00100000:2.0:1787560623.673262:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862811264 00000100:00100000:2.0:1787560623.673305:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787560623.673313:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3901880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3624:x1874392862811264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787560623.673357:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560623.673399:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3901880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3624:x1874392862811264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560623.673405:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787560623.673449:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec38e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862811136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560623.673479:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560623.673511:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862810112:0@lo:400:kworker.0 00000100:00100000:2.0:1787560623.673526:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862810624:0@lo:400:kworker.0 00000100:00100000:2.0:1787560623.673562:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec38e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862811264:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560623.674009:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787560623.674040:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787560623.674049:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862810880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560623.674088:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862810880:12345-0@lo:400:kworker.0 Request processed in 43us (1760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560623.674095:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787560623.674146:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862811008:0@lo:400:kworker.0 00000100:00100000:0.0:1787560623.674160:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862809984:0@lo:400:kworker.0 00010000:00080000:0.0:1787560623.674177:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2cce680 x1874392862810496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560623.674188:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2cce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862810496:0@lo:400:kworker.0 00000100:00100000:0.0:1787560623.674200:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862809600:0@lo:400:kworker.0 00000100:00100000:0.0:1787560623.674212:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafe0687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862809472:0@lo:400:kworker.0 00000100:00100000:0.0:1787560623.674254:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862809856:0@lo:400:kworker.0 00010000:00080000:0.0:1787560623.674267:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2ccc000 x1874392862810368/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560623.674275:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862810368:0@lo:400:kworker.0 00000100:00100000:0.0:1787560623.674299:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862810880:0@lo:400:kworker.0 00000100:00100000:0.0:1787560623.674312:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862809728:0@lo:400:kworker.0 00000100:00080000:3.0:1787560623.675816:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787560623.675830:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787560623.675834:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560623.675858:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862811136 00000100:00100000:3.0:1787560623.675869:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862811136 00000100:00100000:3.0:1787560623.675928:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787560623.676343:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862811136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787560623.676377:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787560623.676634:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862811136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 685us (3150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560623.676692:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec38e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862811136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787560623.676707:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00010000:2.0:1787560624.115577:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560625.142601:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560625.206365:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862811392:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787560625.206482:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560625.210604:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862811392 00000100:00100000:3.0:1787560625.210625:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862811392 00000100:00100000:3.0:1787560625.210700:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787560625.210712:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862811392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787560625.210764:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787560625.211315:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862811392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 601us (4829us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560625.211326:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787560625.211488:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862811392:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787560626.164605:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560626.185222:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560626.185270:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560626.185311:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560626.185333:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560626.185372:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560626.185397:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853281280 00000100:00100000:3.0:1787560626.185398:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853281536 00000100:00100000:3.0:1787560626.185408:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853281536 00000100:00100000:2.0:1787560626.185408:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853281280 00000100:00100000:0.0:1787560626.185492:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853281024 00000100:00100000:0.0:1787560626.185497:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853281024 00000100:00100000:0.0:1787560626.185554:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 375 00000100:00100000:0.0:1787560626.185566:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+13:2403:x1874392853281024:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560626.185653:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+13:2403:x1874392853281024:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 89us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560626.185661:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 375 00000100:00100000:0.0:1787560626.185706:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853281152 00000100:00100000:0.0:1787560626.185710:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853281152 00000100:00100000:2.0:1787560626.185777:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853281408 00000100:00100000:2.0:1787560626.185780:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853281408 00000100:00100000:0.0:1787560626.188562:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 262 00000100:00100000:0.0:1787560626.188581:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853281280:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560626.188676:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853281280:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 102us (3405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560626.196628:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 263 00000100:00100000:2.0:1787560626.197031:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853281152:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560626.198498:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 262 00000100:00100000:0.0:1787560626.198559:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 264 00000100:00100000:0.0:1787560626.198575:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853281408:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560626.198589:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853281152:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 1945us (13254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560626.198597:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 263 00000100:00100000:0.0:1787560626.198623:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853281408:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 55us (13251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560626.198629:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 264 00000100:00080000:2.0:1787560626.198872:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787560626.198878:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787560626.205280:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 265 00000100:00100000:3.0:1787560626.205308:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853281536:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560626.205427:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853281536:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 131us (20114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560626.205457:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 265 00000100:00100000:2.0:1787560626.234021:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787560626.234374:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862811520:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787560626.235363:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560626.235871:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862811520 00000100:00100000:0.0:1787560626.235895:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862811520 00000100:00100000:1.0:1787560626.238835:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787560626.238851:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862811520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787560626.238899:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787560626.239452:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862811520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 579us (4070us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560626.239462:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787560626.239783:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862811520:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1787560626.861665:0:14040:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 04:37:05 (1787560625) 00010000:00010000:0.0:1787560627.187805:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560627.763683:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787560627.763709:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862811648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787560627.763782:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560627.764081:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862811648 00000100:00100000:3.0:1787560627.764089:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862811648 00000100:00100000:3.0:1787560627.764156:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787560627.764167:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862811648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787560627.764197:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787560627.764261:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862811648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560627.764269:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:0.0:1787560627.764334:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787560627.764464:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec33c0380 x1874392862811648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560643 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560627.764483:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862811648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560627.765077:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787560627.765089:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862811776:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787560627.765125:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560627.765238:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862811776 00000100:00100000:0.0:1787560627.765243:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862811776 00000100:00100000:0.0:1787560627.765293:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787560627.765301:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862811776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787560627.765315:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1787560627.765542:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560627.767531:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862811776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2220us (2394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560627.767545:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:2.0:1787560627.768925:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2f44380 x1874392862811776/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560643 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560627.768952:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862811776:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787560628.211580:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560628.354496:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560628.354578:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853281664 00000100:00100000:0.0:1787560628.354589:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853281664 00000100:00100000:0.0:1787560628.354667:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 40 00000100:00100000:0.0:1787560628.354679:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+5:11079:x1874392853281664:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787560628.354697:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560628.354721:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f33fa5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fc28 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560628.354785:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f33fac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560628.354812:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f33fac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560628.354826:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f33fac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560628.354873:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787560628.354877:0:6500:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787560628.354917:0:6500:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f33fac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560628.354943:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f33fa5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc28 expref: 7 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560628.354980:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f33fac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc28 expref: 6 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560628.355001:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec1e6b400) 00010000:00010000:0.0:1787560628.355005:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787560628.355009:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881c00, rc 0) 00000100:00100000:0.0:1787560628.355087:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+6:11079:x1874392853281664:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 411us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560628.355094:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 40 00000100:00080000:2.0:1787560628.355384:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560628.362589:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560628.362718:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853281792 00000100:00100000:2.0:1787560628.362760:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853281792 00000100:00100000:2.0:1787560628.362836:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 41 00000100:00100000:2.0:1787560628.362848:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+6:11080:x1874392853281792:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787560628.362868:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560628.362890:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f33fb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fc2f expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560628.362968:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f33fba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560628.362982:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f33fba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560628.363006:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f33fba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560628.363024:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f33fc1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560628.363031:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f33fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560628.363039:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f33fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560628.363489:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169c00/0x4642c20bf2f33fc8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560628.363499:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169c00/0x4642c20bf2f33fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560628.363507:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169c00/0x4642c20bf2f33fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560628.363557:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787560628.363561:0:6499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787560628.363583:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169c00/0x4642c20bf2f33fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560628.363594:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f33fba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560628.363600:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f33fba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560628.363607:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f33fba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560628.363614:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169a00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560628.363619:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f33fba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560628.363626:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f33fba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560628.363638:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec1e6b400) 00010000:00010000:2.0:1787560628.363641:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560628.363645:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f33fba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560628.363651:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f33fba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560628.363666:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f33fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560628.363683:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f33fc1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560628.363689:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f33fc1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560628.363695:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560628.363698:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f33fc1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560628.363704:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f33fc1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560628.363713:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9cafef7ce600) 00010000:00010000:2.0:1787560628.363716:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560628.363719:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f33fc1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560628.363836:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f33fc1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560628.363873:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f33fb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc2f expref: 8 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560628.363887:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169c00/0x4642c20bf2f33fc8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc2f expref: 7 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560628.363894:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cafef7ce000) 00010000:00010000:2.0:1787560628.363896:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787560628.363904:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2169c00, rc 0) 00000100:00100000:2.0:1787560628.364240:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+7:11080:x1874392853281792:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 1393us (1663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560628.364249:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 41 00000100:00100000:1.0:1787560628.368890:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560628.369167:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853281920 00000100:00100000:0.0:1787560628.369178:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853281920 00000100:00100000:0.0:1787560628.369281:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:0.0:1787560628.369291:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9331bacf-6cfc-4379-8649-925e79b19df1+7:11080:x1874392853281920:12345-192.168.203.29@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787560628.369371:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9331bacf-6cfc-4379-8649-925e79b19df1+7:11080:x1874392853281920:12345-192.168.203.29@tcp:900:lhsmtool_posix.0 Request processed in 82us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560628.369394:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:2.0:1787560628.375181:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560628.376074:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853282176 00000100:00100000:1.0:1787560628.376087:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853282176 00000100:00100000:1.0:1787560628.376156:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 42 00000100:00100000:1.0:1787560628.376166:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+7:11080:x1874392853282176:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787560628.376186:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560628.376208:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f33fcf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fc36 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560628.376274:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f33fd6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560628.376288:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f33fd6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560628.376300:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f33fd6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560628.376333:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f33fdd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560628.376339:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f33fdd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560628.376345:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f33fdd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560628.376482:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff400/0x4642c20bf2f33fe4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560628.376504:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff400/0x4642c20bf2f33fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560628.376511:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff400/0x4642c20bf2f33fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560628.376522:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1787560628.376602:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f33fd6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560628.376609:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f33fd6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560628.376616:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f33fd6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560628.376621:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbfec00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560628.376626:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f33fd6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560628.376632:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f33fd6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560628.376644:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cafef7ce000) 00010000:00010000:1.0:1787560628.376647:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560628.376652:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f33fd6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560628.376657:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f33fd6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560628.376669:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f33fdd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560628.376695:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f33fdd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560628.376702:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f33fdd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560628.376707:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbff000 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560628.376710:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f33fdd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560628.376717:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f33fdd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560628.376725:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9caec3207700) 00010000:00010000:1.0:1787560628.376728:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560628.376731:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f33fdd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560628.376737:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f33fdd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560628.377014:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f33fcf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc36 expref: 10 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560628.377029:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff400/0x4642c20bf2f33fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc36 expref: 9 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560628.377036:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9caec3207900) 00010000:00010000:1.0:1787560628.377039:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560628.377047:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbff400, rc 0) 00000100:00100000:1.0:1787560628.377122:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+9:11080:x1874392853282176:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 957us (1952us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787560628.377129:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 42 00000100:00100000:3.0:1787560628.390598:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560628.390956:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853282304 00000100:00100000:2.0:1787560628.390973:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853282304 00000100:00100000:2.0:1787560628.391072:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 43 00000100:00100000:2.0:1787560628.391084:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+9:11080:x1874392853282304:12345-192.168.203.29@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787560628.391209:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+9:11080:x1874392853282304:12345-192.168.203.29@tcp:59:lhsmtool_posix.0 Request processed in 127us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560628.391216:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 43 00000100:00100000:3.0:1787560628.397564:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560628.398312:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853282432 00000100:00100000:2.0:1787560628.398329:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853282432 00000100:00080000:0.0:1787560628.398570:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787560628.398651:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 44 00000100:00100000:2.0:1787560628.398666:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:11080:x1874392853282432:12345-192.168.203.29@tcp:59:lhsmtool_posix.0 00000040:00080000:3.0:1787560628.404834:0:13775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000004:00080000:0.0:1787560628.408145:0:6499:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 9419us 00000100:00100000:0.0:1787560628.464341:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:11080:x1874392853282432:12345-192.168.203.29@tcp:59:lhsmtool_posix.0 Request processed in 65668us (66779us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560628.464356:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 44 00000100:00100000:0.0:1787560628.787889:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862811904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787560628.787994:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560628.788274:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862811904 00000100:00100000:1.0:1787560628.788285:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862811904 00000100:00100000:1.0:1787560628.788370:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787560628.788384:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862811904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787560628.788424:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787560628.788552:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffb886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862812160:0@lo:400:kworker.0 00000100:00100000:3.0:1787560628.788596:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560628.788618:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862812672:0@lo:400:kworker.0 00000100:00100000:3.0:1787560628.788637:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560628.788654:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862813184:0@lo:400:kworker.0 00000100:00100000:3.0:1787560628.788673:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560628.788688:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787560628.788694:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffb885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862812032:0@lo:400:kworker.0 00000100:00100000:3.0:1787560628.788719:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560628.788737:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2351c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862812544:0@lo:400:kworker.0 00000100:00100000:3.0:1787560628.788761:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560628.788778:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862813056:0@lo:400:kworker.0 00000100:00100000:3.0:1787560628.788800:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560628.788824:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffb886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862812288:0@lo:400:kworker.0 00000100:00100000:3.0:1787560628.788849:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787560628.788875:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787560628.788885:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862812800:0@lo:400:kworker.0 00000100:00100000:3.0:1787560628.788908:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560628.788926:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862813312:0@lo:400:kworker.0 00000100:00100000:1.0:1787560628.788951:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862811904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 570us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560628.788961:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787560628.788967:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560628.789003:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787560628.789009:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2350700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862812416:0@lo:400:kworker.0 00000100:00100000:3.0:1787560628.789037:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560628.789038:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862812160 00000100:00100000:1.0:1787560628.789044:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862812160 00000100:00100000:3.0:1787560628.789050:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862812928:0@lo:400:kworker.0 00000100:00100000:1.0:1787560628.789071:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862812672 00000100:00100000:1.0:1787560628.789076:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862812672 00000100:00100000:3.0:1787560628.789089:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560628.789097:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862813184 00000100:00100000:1.0:1787560628.789101:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862813184 00000100:00100000:3.0:1787560628.789112:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862813440:0@lo:400:kworker.0 00000100:00100000:1.0:1787560628.789118:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862812800 00000100:00100000:1.0:1787560628.789122:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862812800 00000100:00100000:3.0:1787560628.789138:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560628.789142:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862813312 00000100:00100000:1.0:1787560628.789147:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862813312 00000100:00100000:1.0:1787560628.789165:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862812416 00000100:00100000:1.0:1787560628.789168:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862812416 00000100:00100000:3.0:1787560628.789174:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787560628.789187:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862812160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560628.789190:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787560628.789216:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862812672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560628.789237:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862812160:12345-0@lo:400:kworker.0 Request processed in 54us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560628.789246:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787560628.789262:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862812672:12345-0@lo:400:kworker.0 Request processed in 47us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560628.789268:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787560628.789276:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787560628.789279:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862813184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560628.789303:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787560628.789311:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862812800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560628.789326:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862813184:12345-0@lo:400:kworker.0 Request processed in 49us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560628.789333:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787560628.789347:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787560628.789354:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874392862813312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560628.789369:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862812800:12345-0@lo:400:kworker.0 Request processed in 59us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560628.789377:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787560628.789393:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874392862813312:12345-0@lo:400:kworker.0 Request processed in 38us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560628.789396:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787560628.789407:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787560628.789408:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862812416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560628.789461:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862812544 00000100:00100000:3.0:1787560628.789466:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862812544 00000100:00100000:1.0:1787560628.789480:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862812416:12345-0@lo:400:kworker.0 Request processed in 74us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560628.789488:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787560628.789507:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862812288 00000100:00100000:3.0:1787560628.789512:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862812288 00000100:00100000:3.0:1787560628.789532:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787560628.789539:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862812544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560628.789552:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862811904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787560628.789581:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862812544:12345-0@lo:400:kworker.0 Request processed in 42us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560628.789589:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787560628.789600:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862813056 00000100:00100000:1.0:1787560628.789604:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862813056 00000100:00100000:3.0:1787560628.789607:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787560628.789617:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862812288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560628.789649:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862812288:12345-0@lo:400:kworker.0 Request processed in 34us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560628.789656:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787560628.789660:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862812928 00000100:00100000:1.0:1787560628.789665:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862812928 00000100:00100000:1.0:1787560628.789681:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862813440 00000100:00100000:1.0:1787560628.789684:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862813440 00000100:00100000:3.0:1787560628.789692:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00080000:0.0:1787560628.790210:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787560628.790216:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560628.790688:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862813056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560628.790750:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862813056:12345-0@lo:400:kworker.0 Request processed in 70us (1949us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560628.792168:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787560628.792192:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862812928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560628.792281:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862812928:12345-0@lo:400:kworker.0 Request processed in 101us (3193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560628.792289:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:0.0:1787560628.792333:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787560628.792398:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862812032 00000100:00100000:0.0:1787560628.792409:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862812032 00000100:00100000:0.0:1787560628.792470:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1787560628.792479:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3626:x1874392862812032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560628.792521:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3626:x1874392862812032:12345-0@lo:400:kworker.0 Request processed in 43us (3800us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560628.792528:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1787560628.792588:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862813568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560628.792640:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560628.792701:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862813568 00000100:00100000:0.0:1787560628.792706:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862813568 00000100:00100000:0.0:1787560628.792734:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787560628.792742:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3625:x1874392862813568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787560628.792761:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560628.792812:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3625:x1874392862813568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560628.792818:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787560628.792864:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862813568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787560628.792963:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787560628.792999:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787560628.793007:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeabab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862813440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560628.793050:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeabab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862813440:12345-0@lo:400:kworker.0 Request processed in 44us (3912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560628.793964:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787560628.794042:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffb885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862812032:0@lo:400:kworker.0 00000100:00100000:3.0:1787560628.794126:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2351c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862812544:0@lo:400:kworker.0 00010000:00080000:3.0:1787560628.794147:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cafeab10380 x1874392862813056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560628.794167:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862813056:0@lo:400:kworker.0 00000100:00100000:3.0:1787560628.794183:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffb886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862812160:0@lo:400:kworker.0 00000100:00100000:3.0:1787560628.794196:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862812672:0@lo:400:kworker.0 00000100:00100000:3.0:1787560628.794209:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862813184:0@lo:400:kworker.0 00000100:00100000:3.0:1787560628.794265:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2350700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862812416:0@lo:400:kworker.0 00010000:00080000:3.0:1787560628.794280:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2353480 x1874392862812928/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560628.795023:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862812928:0@lo:400:kworker.0 00000100:00100000:3.0:1787560628.795049:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862813440:0@lo:400:kworker.0 00000100:00100000:3.0:1787560628.795210:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffb886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862812288:0@lo:400:kworker.0 00010000:00080000:3.0:1787560628.795229:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2353b80 x1874392862812800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560628.795240:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862812800:0@lo:400:kworker.0 00010000:00080000:3.0:1787560628.795254:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cafeab13b80 x1874392862813312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560628.795262:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862813312:0@lo:400:kworker.0 00010000:00010000:0.0:1787560629.235977:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787560629.429241:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787560630.278970:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560630.327505:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560630.327544:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853282560 00000100:00100000:3.0:1787560630.327554:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853282560 00000100:00100000:3.0:1787560630.327633:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 45 00000100:00100000:3.0:1787560630.327644:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+9:11122:x1874392853282560:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1787560630.327663:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560630.327682:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f33ff2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fc3d expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.327744:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f33ff9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.327757:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f33ff9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.327768:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f33ff9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.327781:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34000 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.327788:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34000 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.327794:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34000 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.327833:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f33ff9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.327840:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f33ff9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.327845:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f33ff9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.327862:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560630.327866:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f33ff9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.327873:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f33ff9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.327885:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec1e6b400) 00010000:00010000:3.0:1787560630.327888:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560630.327893:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f33ff9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.327899:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f33ff9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.327918:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34000 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.327924:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34000 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.327929:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34000 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.327933:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560630.327936:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34000 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.327941:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34000 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.327959:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9cafe1537a00) 00010000:00010000:3.0:1787560630.327962:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560630.327965:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34000 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.327971:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34000 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.328011:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f33ff2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc3d expref: 10 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.328021:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec1e6b400) 00010000:00010000:3.0:1787560630.328023:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560630.328026:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f33ff2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc3d expref: 10 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.328035:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f7c00, rc 0) 00000100:00100000:3.0:1787560630.328087:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+9:11122:x1874392853282560:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 445us (591us total) trans 0 rc 301/301 00000100:00100000:3.0:1787560630.328095:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 45 00000100:00080000:3.0:1787560630.328115:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560630.329231:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862813696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787560630.329291:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560630.329390:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862813696 00000100:00100000:2.0:1787560630.329397:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862813696 00000100:00100000:2.0:1787560630.329472:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787560630.329481:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeabab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862813696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787560630.329506:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787560630.329563:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeabab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862813696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560630.329570:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787560630.329781:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862813696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787560630.337455:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560630.337532:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853282816 00000100:00100000:2.0:1787560630.337552:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853282816 00000100:00100000:2.0:1787560630.337616:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 46 00000100:00100000:2.0:1787560630.337627:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+9:11122:x1874392853282816:12345-192.168.203.29@tcp:36:lfs.0 00010000:00010000:2.0:1787560630.337678:0:10172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560630.337702:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f33fac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc28 expref: 9 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560630.337718:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec1e6b400) 00010000:00010000:2.0:1787560630.337728:0:10172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787560630.337785:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34007 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560630.337796:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34007 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560630.337805:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34007 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560630.337815:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f3400e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560630.337822:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f3400e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560630.337828:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f3400e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560630.339120:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34015 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560630.339135:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34015 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560630.339156:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34015 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787560630.339174:0:10172:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000087f927d9 reply state 000000008d149132 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34015 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560630.339185:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34015 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560630.339192:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:2.0:1787560630.339195:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787560630.339198:0:10172:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787560630.339203:0:10172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787560630.339209:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34007 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560630.339216:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34007 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560630.339222:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34007 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560630.339228:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560630.339232:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34007 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560630.339239:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34007 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560630.339250:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafda3d1200) 00010000:00010000:2.0:1787560630.339252:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560630.339262:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34007 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560630.339269:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34007 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787560630.339284:0:10172:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000087f927d9 reply state 000000008d149132 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f3400e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560630.339293:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f3400e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560630.339299:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9cafda3d1700) 00010000:00010000:2.0:1787560630.339301:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787560630.339303:0:10172:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787560630.339407:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+10:11122:x1874392853282816:12345-192.168.203.29@tcp:36:lfs.0 Request processed in 1780us (1984us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787560630.340243:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 46 00000100:00100000:3.0:1787560630.406272:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560630.406548:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853282944 00000100:00100000:0.0:1787560630.406559:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853282944 00000100:00100000:0.0:1787560630.406623:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 47 00000100:00100000:0.0:1787560630.406635:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+10:11130:x1874392853282944:12345-192.168.203.29@tcp:101:lctl.0 00010000:00010000:0.0:1787560630.406671:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560630.406697:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f3401c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fc44 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.406765:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34023 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.406779:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34023 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.406789:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34023 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560630.406854:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787560630.406859:0:6499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787560630.406899:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34023 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.406923:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f3401c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc44 expref: 12 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.406940:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34023 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc44 expref: 11 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.406948:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec2028000) 00010000:00010000:0.0:1787560630.406951:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787560630.406954:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3880c00, rc 0) 00000100:00100000:0.0:1787560630.407162:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+11:11130:x1874392853282944:12345-192.168.203.29@tcp:101:lctl.0 Request processed in 528us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560630.407170:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 47 00000100:00100000:3.0:1787560630.450264:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560630.450341:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853283072 00000100:00100000:0.0:1787560630.450350:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853283072 00000100:00100000:0.0:1787560630.450819:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 48 00000100:00100000:0.0:1787560630.450832:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+11:11136:x1874392853283072:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:0.0:1787560630.450851:0:13787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560630.450870:0:13787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f3402a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fc4b expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.451147:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34031 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.451173:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34031 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.451184:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34031 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.451195:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34038 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.451202:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34038 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.451208:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34038 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.451284:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880600/0x4642c20bf2f3403f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.451293:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880600/0x4642c20bf2f3403f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.451300:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880600/0x4642c20bf2f3403f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560630.451335:0:13787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787560630.451338:0:13787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787560630.451377:0:13787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880600/0x4642c20bf2f3403f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.451391:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34031 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.451408:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34031 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.451415:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34031 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.451421:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560630.451425:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34031 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.451655:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34031 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.451669:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec2028000) 00010000:00010000:0.0:1787560630.451672:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560630.451676:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34031 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.451683:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34031 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.451692:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34038 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.451698:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34038 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.451704:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34038 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.451708:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880000 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560630.451717:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34038 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.451723:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34038 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.451731:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9cafda3d1700) 00010000:00010000:0.0:1787560630.451733:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560630.451736:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34038 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.451742:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34038 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.451772:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f3402a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc4b expref: 13 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.451786:0:13787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880600/0x4642c20bf2f3403f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc4b expref: 12 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.451793:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:0.0:1787560630.451795:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787560630.451798:0:13787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3880600, rc 0) 00000100:00100000:0.0:1787560630.451899:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+12:11136:x1874392853283072:12345-192.168.203.29@tcp:101:bash.0 Request processed in 1069us (1642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560630.451917:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 48 00000100:00100000:3.0:1787560630.456598:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560630.456679:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853283328 00000100:00100000:1.0:1787560630.456692:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853283328 00000100:00100000:1.0:1787560630.457199:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 49 00000100:00100000:1.0:1787560630.457212:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+12:11136:x1874392853283328:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:1.0:1787560630.457256:0:10172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560630.457275:0:10172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f34046 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fc52 expref: -99 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.457378:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f3404d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.457401:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f3404d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.457413:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f3404d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.457464:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f34054 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.457473:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f34054 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.457480:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f34054 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787560630.457809:0:10172:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1787560630.457945:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f3405b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.457955:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f3405b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.457963:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f3405b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.458019:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f3404d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.458026:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f3404d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.458032:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f3404d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.458046:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbff200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560630.458051:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f3404d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.458058:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f3404d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.458069:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:1.0:1787560630.458073:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560630.458076:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f3404d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.458082:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f3404d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787560630.458095:0:10172:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003ea323bf reply state 00000000dcc2dd7f transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f34054 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.458105:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f34054 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.458111:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9caec3203200) 00010000:00010000:1.0:1787560630.458114:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787560630.458116:0:10172:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787560630.458146:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f34046 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc52 expref: 15 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.458160:0:10172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f3405b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc52 expref: 14 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.458180:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9caec3203100) 00010000:00010000:1.0:1787560630.458182:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787560630.458185:0:10172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbfe200, rc 0) 00000100:00100000:1.0:1787560630.458259:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+15:11136:x1874392853283328:12345-192.168.203.29@tcp:101:bash.0 Request processed in 1049us (1673us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1787560630.458266:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 49 00000100:00100000:3.0:1787560630.467948:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560630.468557:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853283456 00000100:00100000:0.0:1787560630.468570:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853283456 00000100:00100000:0.0:1787560630.469095:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 28 00000100:00100000:0.0:1787560630.469104:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeabaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1874392853283456:12345-192.168.203.29@tcp:8:bash.0 00010000:00080000:0.0:1787560630.469145:0:10171:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 9331bacf-6cfc-4379-8649-925e79b19df1@192.168.203.29@tcp t0 exp 0000000000000000 cur 349 last 0 00000020:00000080:0.0:1787560630.469199:0:10171:0:(genops.c:1385:class_connect()) connect: client 9331bacf-6cfc-4379-8649-925e79b19df1, cookie 0x4642c20bf2f34069 00002000:00100000:0.0:1787560630.469210:0:10171:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9331bacf-6cfc-4379-8649-925e79b19df1/ffff9cafffe71800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787560630.469228:0:10171:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00002000:00080000:0.0:1787560630.469294:0:10171:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787560630.469323:0:10171:0:(import.c:65:import_set_state_nolock()) ffff9cafffe72000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787560630.469392:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeabaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+6:2401:x1874392853283456:12345-192.168.203.29@tcp:8:bash.0 Request processed in 287us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560630.469401:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 28 00000100:00100000:0.0:1787560630.478093:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560630.478196:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853283584 00000100:00100000:1.0:1787560630.478207:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853283584 00000100:00100000:1.0:1787560630.478291:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 29 00000100:00100000:1.0:1787560630.478303:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+6:0:x1874392853283584:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:1.0:1787560630.478322:0:8414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1787560630.478361:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787560630.478458:0:8414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000092a86a9/0x4642c20bf2f34070 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fc59 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787560630.478484:0:8414:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560630.478501:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=349s v=(0 0) 00010000:00010000:1.0:1787560630.478506:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560630.478515:0:8414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000092a86a9/0x4642c20bf2f34070 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc59 expref: 7 pid: 8414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.478535:0:8414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000092a86a9/0x4642c20bf2f34070 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc59 expref: 7 pid: 8414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.478548:0:8414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbff800, rc 0) 00000100:00100000:1.0:1787560630.478611:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+7:0:x1874392853283584:12345-192.168.203.29@tcp:101:bash.0 Request processed in 310us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560630.478630:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 29 00000100:00100000:3.0:1787560630.486750:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560630.489225:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853283712 00000100:00100000:1.0:1787560630.489238:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853283712 00000100:00100000:0.0:1787560630.489482:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 30 00000100:00100000:0.0:1787560630.489494:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+7:11136:x1874392853283712:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:0.0:1787560630.489512:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560630.489535:0:8412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad6ba2a1/0x4642c20bf2f34077 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fc60 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.489565:0:8412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000092a86a9/0x4642c20bf2f34070 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc59 expref: 8 pid: 8414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.489574:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560630.489578:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560630.489596:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad6ba2a1/0x4642c20bf2f34077 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc60 expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.489633:0:8412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000092a86a9/0x4642c20bf2f34070 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc59 expref: 8 pid: 8414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.489659:0:8412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000092a86a9/0x4642c20bf2f34070 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc59 expref: 8 pid: 8414 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560630.489673:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f4e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1874392862813824:192.168.203.29@tcp:104: 00000100:00100000:0.0:1787560630.489798:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec21fb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560630.497475:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560630.497494:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f4e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1874392862813824:192.168.203.29@tcp:104: 00010000:00010000:0.0:1787560630.497529:0:8412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ad6ba2a1/0x4642c20bf2f34077 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc60 expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.497550:0:8412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881000, rc 0) 00000100:00100000:0.0:1787560630.497614:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+8:11136:x1874392853283712:12345-192.168.203.29@tcp:101:bash.0 Request processed in 8122us (10874us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560630.497625:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 30 00000100:00100000:1.0:1787560630.498035:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853283840 00000100:00100000:1.0:1787560630.498044:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853283840 00010000:00010000:1.0:1787560630.498079:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000092a86a9/0x4642c20bf2f34070 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc59 expref: 8 pid: 8414 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560630.498117:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 52 00000100:00100000:1.0:1787560630.498126:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd7cb7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+8:2404:x1874392853283840:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560630.498140:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560630.498160:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000092a86a9/0x4642c20bf2f34070 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc59 expref: 8 pid: 8414 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.498173:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000092a86a9/0x4642c20bf2f34070 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc59 expref: 8 pid: 8414 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.498196:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000092a86a9/0x4642c20bf2f34070 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc59 expref: 8 pid: 8414 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.498210:0:6484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560630.498215:0:6484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560630.498224:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad6ba2a1/0x4642c20bf2f34077 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc60 expref: 7 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.498234:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad6ba2a1/0x4642c20bf2f34077 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc60 expref: 7 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.498280:0:6484:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ad6ba2a1/0x4642c20bf2f34077 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc60 expref: 7 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560630.498294:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f44a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6484:1874392862813952:192.168.203.29@tcp:105: 00000100:00100000:1.0:1787560630.498357:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec322d600 going to sleep for 11 seconds 00000100:00100000:1.0:1787560630.504452:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f44a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6484:1874392862813952:192.168.203.29@tcp:105: 00010000:00010000:1.0:1787560630.504481:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560630.504539:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd7cb7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+7:2404:x1874392853283840:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 6413us (7114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560630.504550:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 52 00000100:00100000:3.0:1787560630.505623:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560630.505691:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853284096 00000100:00100000:2.0:1787560630.505700:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853284096 00000100:00100000:2.0:1787560630.505756:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:2.0:1787560630.505766:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+15:11136:x1874392853284096:12345-192.168.203.29@tcp:35:bash.0 00000100:00100000:2.0:1787560630.506266:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+16:11136:x1874392853284096:12345-192.168.203.29@tcp:35:bash.0 Request processed in 499us (898us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787560630.506274:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:0.0:1787560630.588380:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560630.591782:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853284352 00000100:00100000:2.0:1787560630.591796:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853284352 00000100:00100000:2.0:1787560630.591867:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 50 00000100:00100000:2.0:1787560630.591877:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+16:11146:x1874392853284352:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1787560630.591917:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560630.591938:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f3407e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fc67 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560630.592059:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787560630.592177:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f3407e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc67 expref: 18 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560630.592192:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec2028000) 00010000:00010000:2.0:1787560630.592195:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787560630.592199:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f3407e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc67 expref: 18 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560630.592211:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2168200, rc 0) 00000100:00100000:2.0:1787560630.592297:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+17:11146:x1874392853284352:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 421us (3925us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1787560630.592305:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 50 00000100:00100000:3.0:1787560630.598325:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560630.598498:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853284608 00000100:00100000:0.0:1787560630.598508:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853284608 00000100:00100000:0.0:1787560630.598566:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:0.0:1787560630.598576:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+17:11146:x1874392853284608:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:0.0:1787560630.598789:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+18:11146:x1874392853284608:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 213us (472us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787560630.598797:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:1.0:1787560630.660798:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560630.660899:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853284736 00000100:00100000:0.0:1787560630.660909:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853284736 00000100:00100000:0.0:1787560630.660989:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 51 00000100:00100000:0.0:1787560630.660999:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+18:11152:x1874392853284736:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:0.0:1787560630.661022:0:13787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560630.661043:0:13787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f3408c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fc6e expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.661107:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34093 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.661122:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34093 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.661133:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34093 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560630.661171:0:13787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787560630.661174:0:13787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787560630.661191:0:13787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34093 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.661215:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f3408c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc6e expref: 20 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.661233:0:13787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34093 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc6e expref: 19 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.661241:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:0.0:1787560630.661244:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787560630.661247:0:13787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881600, rc 0) 00000100:00100000:0.0:1787560630.661312:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+19:11152:x1874392853284736:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 314us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560630.661324:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 51 00000100:00100000:3.0:1787560630.670870:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560630.671038:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853284992 00000100:00100000:1.0:1787560630.671047:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853284992 00000100:00100000:1.0:1787560630.671111:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 52 00000100:00100000:1.0:1787560630.671122:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+19:11152:x1874392853284992:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:1.0:1787560630.671142:0:10172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560630.671163:0:10172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f3409a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fc75 expref: -99 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.671275:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f340a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.671289:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f340a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.671302:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f340a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560630.671326:0:10172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787560630.671424:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f3409a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc75 expref: 22 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.671471:0:10172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f340a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc75 expref: 21 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.671480:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9caec3203100) 00010000:00010000:1.0:1787560630.671483:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787560630.671486:0:10172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbff000, rc 0) 00000100:00100000:1.0:1787560630.671546:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+21:11152:x1874392853284992:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 427us (686us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787560630.671554:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 52 00000100:00100000:1.0:1787560630.674226:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560630.674588:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853285248 00000100:00100000:3.0:1787560630.674602:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853285248 00000100:00100000:3.0:1787560630.674680:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 53 00000100:00100000:3.0:1787560630.674693:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+21:11152:x1874392853285248:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1787560630.674726:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560630.674752:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f340af lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fc7c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.674894:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f340b6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.674929:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f340b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.674942:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f340b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560630.674956:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787560630.675116:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f340af lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc7c expref: 24 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.675138:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f340b6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc7c expref: 23 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.675168:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9caec3203100) 00010000:00010000:3.0:1787560630.675172:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787560630.675176:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f7800, rc 0) 00000100:00100000:3.0:1787560630.675533:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+23:11152:x1874392853285248:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 841us (1319us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1787560630.675541:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 53 00000100:00100000:3.0:1787560630.677092:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560630.678484:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853285376 00000100:00100000:1.0:1787560630.678503:0:9502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853285376 00000100:00100000:1.0:1787560630.678809:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:1.0:1787560630.678878:0:9502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2353b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+23:2405:x1874392853285376:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560630.678907:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560630.678940:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f340a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc75 expref: 23 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.678962:0:9502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9caec3203100) 00010000:00010000:1.0:1787560630.678967:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560630.679061:0:9502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2353b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+22:2405:x1874392853285376:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 189us (1979us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560630.679092:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:0.0:1787560630.681019:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560630.681130:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853285504 00000100:00100000:3.0:1787560630.681142:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853285504 00000100:00100000:3.0:1787560630.681207:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 31 00000100:00100000:3.0:1787560630.681218:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+7:2402:x1874392853285504:12345-192.168.203.29@tcp:1:lfs.0 00010000:00010000:3.0:1787560630.681274:0:8415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f340c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.681569:0:8415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad6ba2a1/0x4642c20bf2f34077 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc60 expref: 7 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.681581:0:8415:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787560630.681586:0:8415:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787560630.681591:0:8415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f340c4 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.681638:0:8415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ad6ba2a1/0x4642c20bf2f34077 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc60 expref: 7 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.681677:0:8415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ad6ba2a1/0x4642c20bf2f34077 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc60 expref: 7 pid: 8412 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560630.681695:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2353480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8415:1874392862814080:192.168.203.29@tcp:104: 00000100:00100000:3.0:1787560630.681855:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560630.684795:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2353480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8415:1874392862814080:192.168.203.29@tcp:104: 00000100:00100000:3.0:1787560630.684815:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00010000:00010000:0.0:1787560630.684838:0:8415:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f340c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560630.685239:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853285632 00000100:00100000:2.0:1787560630.685251:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853285632 00002000:00100000:2.0:1787560630.685301:0:8418:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9caec2350700 x1874392853285632/t0(0) o4->9331bacf-6cfc-4379-8649-925e79b19df1@192.168.203.29@tcp:746/0 lens 504/0 e 0 to 0 dl 1787560641 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787560630.685311:0:8418:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9caec2350700 with x1874392853285632 ext(0->12) 00010000:00010000:2.0:1787560630.685321:0:8418:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ad6ba2a1/0x4642c20bf2f34077 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc60 expref: 8 pid: 8412 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560630.685336:0:8418:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ad6ba2a1/0x4642c20bf2f34077 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc60 expref: 8 pid: 8412 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787560630.685361:0:8418:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9caec2350700 00000100:00100000:2.0:1787560630.685394:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:2.0:1787560630.685403:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9331bacf-6cfc-4379-8649-925e79b19df1+8:2404:x1874392853285632:12345-192.168.203.29@tcp:4:lfs.0 00000001:00100000:0.0:1787560630.687121:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9331bacf-6cfc-4379-8649-925e79b19df1 00000100:00100000:2.0:1787560630.688212:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9331bacf-6cfc-4379-8649-925e79b19df1+9:2404:x1874392853285632:12345-192.168.203.29@tcp:4:lfs.0 Request processed in 2798us (3396us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787560630.688229:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 0 00002000:00100000:2.0:1787560630.688257:0:8418:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9caec2350700 x1874392853285632/t4294967300(0) o4->9331bacf-6cfc-4379-8649-925e79b19df1@192.168.203.29@tcp:746/0 lens 504/448 e 0 to 0 dl 1787560641 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787560630.688269:0:8418:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9caec2350700 with x1874392853285632 ext(0->12) 00010000:00010000:2.0:1787560630.688282:0:8418:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ad6ba2a1/0x4642c20bf2f34077 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc60 expref: 9 pid: 8412 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560630.688304:0:8418:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ad6ba2a1/0x4642c20bf2f34077 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc60 expref: 9 pid: 8412 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787560630.688313:0:8418:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9caec2350700 00000100:00100000:1.0:1787560630.691262:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560630.691369:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853285760 00000100:00100000:0.0:1787560630.691383:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853285760 00010000:00010000:0.0:1787560630.691488:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ad6ba2a1/0x4642c20bf2f34077 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc60 expref: 9 pid: 8412 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560630.691531:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 53 00000100:00100000:0.0:1787560630.691543:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+9:2403:x1874392853285760:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787560630.691561:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787560630.691584:0:6486:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787560630.691588:0:6486:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1787560630 00002000:00010000:0.0:1787560630.691591:0:6486:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1787560630 00002000:00010000:0.0:1787560630.691593:0:6486:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1787560630 00002000:00010000:0.0:1787560630.691595:0:6486:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1787560630.691602:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ad6ba2a1/0x4642c20bf2f34077 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc60 expref: 9 pid: 8412 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.691629:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ad6ba2a1/0x4642c20bf2f34077 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc60 expref: 9 pid: 8412 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.692826:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad6ba2a1/0x4642c20bf2f34077 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc60 expref: 9 pid: 8412 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.692848:0:6486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787560630.692853:0:6486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787560630.692860:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f340c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.692871:0:6486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f340c4 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.692915:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560630.693001:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+8:2403:x1874392853285760:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 1459us (1751us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560630.693012:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 53 00010000:00010000:3.0:1787560630.693070:0:8415:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f340c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.693091:0:8415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f340c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.693126:0:8415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f340c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.693136:0:8415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f340c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.693146:0:8415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f340c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.693153:0:8415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6800 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560630.693158:0:8415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f340c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.693189:0:8415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f340c4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.693212:0:8415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f340c4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.693221:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f340c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560630.693341:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+7:2402:x1874392853285504:12345-192.168.203.29@tcp:1:lfs.0 Request processed in 12121us (12440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560630.693351:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 31 00000100:00100000:1.0:1787560630.696119:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560630.696229:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853286016 00000100:00100000:0.0:1787560630.696243:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853286016 00000100:00100000:0.0:1787560630.696321:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:0.0:1787560630.696334:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+22:11152:x1874392853286016:12345-192.168.203.29@tcp:35:lfs.0 00000004:00010000:0.0:1787560630.696418:0:6502:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f340b6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc7c expref: 22 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787560630.697299:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1787560630.697352:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1787560630.699290:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:0.0:1787560630.699363:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f340cb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.699405:0:6502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f3405b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc52 expref: 26 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.699415:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f340cb lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.699504:0:6502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f3405b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc52 expref: 26 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.699526:0:6502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f3405b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc52 expref: 26 pid: 10172 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560630.699543:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f4c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6502:1874392862814208:192.168.203.29@tcp:104: 00000100:00100000:0.0:1787560630.699669:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec21fb180 going to sleep for 11 seconds 00000100:00100000:0.0:1787560630.702123:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560630.702233:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853286144 00000100:00100000:1.0:1787560630.702245:0:9502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853286144 00010000:00010000:1.0:1787560630.702296:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f3405b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc52 expref: 27 pid: 10172 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560630.702347:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 54 00000100:00100000:1.0:1787560630.702359:0:9502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0684000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+27:2405:x1874392853286144:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560630.702376:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560630.702384:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f3405b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc52 expref: 27 pid: 10172 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.702399:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f3405b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc52 expref: 27 pid: 10172 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.702423:0:9502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9caec3203100) 00010000:00010000:1.0:1787560630.702471:0:9502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f340cb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.702484:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f340cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.702491:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f340cb lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.702514:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560630.702592:0:9502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0684000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+27:2405:x1874392853286144:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 234us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560630.702601:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 54 00010000:00010000:3.0:1787560630.702778:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f3405b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc52 expref: 26 pid: 10172 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560630.702866:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f4c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6502:1874392862814208:192.168.203.29@tcp:104: 00010000:00010000:3.0:1787560630.702897:0:6502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f340cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.702908:0:6502:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f340cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.702914:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f340cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787560630.703031:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1787560630.703171:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1787560630.703294:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2352a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6502:1874392862814336:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787560630.703368:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560630.703407:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560630.704150:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862814336 00000100:00100000:1.0:1787560630.704163:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862814336 00000100:00100000:1.0:1787560630.704248:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787560630.704260:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6502:x1874392862814336:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787560630.704404:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6502:x1874392862814336:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 146us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560630.704412:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:3.0:1787560630.704633:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560630.704724:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2352a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6502:1874392862814336:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787560630.704949:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:0.0:1787560630.705300:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafe0687800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6502:1874392862814464:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787560630.705353:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560630.705391:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec21fb540 going to sleep for 11 seconds 00000100:00100000:3.0:1787560630.705478:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862814464 00000100:00100000:3.0:1787560630.705485:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862814464 00000100:00100000:3.0:1787560630.705534:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787560630.705544:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6502:x1874392862814464:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787560630.705755:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6502:x1874392862814464:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 212us (401us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787560630.705763:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787560630.708294:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafe0687800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6502:1874392862814464:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787560630.708413:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1787560630.708595:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f340cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.708610:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f340cb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.708636:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f340cb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.708644:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880000 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560630.708649:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f340cb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.708658:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f340cb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.708679:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9caec3203100) 00010000:00010000:0.0:1787560630.708683:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787560630.708689:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f340cb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.708696:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f340cb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787560630.708836:0:6502:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787560630.708928:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1787560630.708941:0:6502:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 350048509134ns, next at 351048506002ns, rc = 0 00000001:00080000:0.0:1787560630.708949:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1787560630.708985:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9caec3203100) 00010000:00010000:0.0:1787560630.708988:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787560630.708997:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f340b6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc7c expref: 30 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560630.710350:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+29:11152:x1874392853286016:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 14007us (14232us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1787560630.710382:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 8 00000020:00080000:0.0:1787560630.710390:0:6502:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787560630.720935:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560630.721207:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853286272 00000100:00100000:3.0:1787560630.721220:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853286272 00000100:00100000:3.0:1787560630.721334:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 54 00000100:00100000:3.0:1787560630.721348:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+29:11152:x1874392853286272:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1787560630.721380:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560630.721410:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f340d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fc83 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.721513:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f340d2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc83 expref: 30 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.721532:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f340d2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc83 expref: 30 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.721556:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:3.0:1787560630.721559:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787560630.721581:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f6800, rc 0) 00000100:00100000:3.0:1787560630.721664:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+30:11152:x1874392853286272:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 319us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560630.721672:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 54 00000100:00100000:1.0:1787560630.742749:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560630.743506:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853286528 00000100:00100000:2.0:1787560630.743517:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853286528 00000100:00100000:2.0:1787560630.743580:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:2.0:1787560630.743589:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd7c04050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+30:11152:x1874392853286528:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:2.0:1787560630.745142:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd7c04050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+31:11152:x1874392853286528:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 1543us (2393us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1787560630.745179:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:0.0:1787560630.833401:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560630.833574:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853286784 00000100:00100000:2.0:1787560630.833585:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853286784 00000100:00100000:2.0:1787560630.833646:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 55 00000100:00100000:2.0:1787560630.833657:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2cce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+31:11162:x1874392853286784:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1787560630.833684:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560630.833705:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f340d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fc8a expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560630.833797:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787560630.833905:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f340d9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc8a expref: 33 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560630.833920:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec2028000) 00010000:00010000:2.0:1787560630.833923:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787560630.833927:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f340d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc8a expref: 33 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560630.833941:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2168200, rc 0) 00000100:00100000:2.0:1787560630.834015:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2cce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+32:11162:x1874392853286784:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 360us (625us total) trans 4294967329 rc 301/301 00000100:00100000:2.0:1787560630.834023:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 55 00000100:00100000:3.0:1787560630.837470:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560630.837582:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853286912 00000100:00100000:1.0:1787560630.837593:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853286912 00000100:00100000:1.0:1787560630.837650:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 56 00000100:00100000:1.0:1787560630.837660:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+32:11162:x1874392853286912:12345-192.168.203.29@tcp:34:lfs.0 00010000:00010000:1.0:1787560630.837733:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f340e7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.837749:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f340e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.837760:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f340e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.837771:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f340ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.837778:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f340ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.837804:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f340ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.837875:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f340f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.837883:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f340f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.837891:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f340f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787560630.837936:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f340f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.837949:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f340e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.837955:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f340e7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.837961:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f340e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.837967:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbff000 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560630.837981:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f340e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.837988:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f340e7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.838001:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:1.0:1787560630.838010:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560630.838015:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f340e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.838021:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f340e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.838035:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f340ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.838041:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f340ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.838047:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f340ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.838052:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbff600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560630.838055:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f340ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.838061:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f340ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.838068:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9caec3203200) 00010000:00010000:1.0:1787560630.838071:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560630.838074:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f340ee lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.838080:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f340ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.838088:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f340f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.838100:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f340f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.838106:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f340f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.838111:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbff200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560630.838114:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f340f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.838119:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f340f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.838126:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:1.0:1787560630.838128:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560630.838131:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f340f5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560630.838135:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f340f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560630.838208:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+32:11162:x1874392853286912:12345-192.168.203.29@tcp:34:lfs.0 Request processed in 548us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560630.838226:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 56 00000100:00100000:1.0:1787560630.841989:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560630.842075:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853287168 00000100:00100000:0.0:1787560630.842085:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853287168 00000100:00100000:0.0:1787560630.842142:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:0.0:1787560630.842152:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+32:11162:x1874392853287168:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:0.0:1787560630.842382:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+33:11162:x1874392853287168:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 230us (411us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1787560630.842389:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:0.0:1787560630.894636:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560630.895466:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853287424 00000100:00100000:3.0:1787560630.895478:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853287424 00000100:00100000:3.0:1787560630.895540:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 57 00000100:00100000:3.0:1787560630.895551:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec393aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+33:11165:x1874392853287424:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1787560630.895584:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560630.895604:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f340fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fc91 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.895676:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34103 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.895763:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34103 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.895776:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34103 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.895925:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f3410a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.895934:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f3410a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.895941:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f3410a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.896345:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34111 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.896356:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34111 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.896363:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34111 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560630.896374:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787560630.896495:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34103 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.896504:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34103 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.896510:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34103 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.896517:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7000 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560630.896521:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34103 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.896528:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34103 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.896540:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:3.0:1787560630.896543:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560630.896547:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34103 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.896564:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34103 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.896579:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f3410a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.896585:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f3410a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.896591:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f3410a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.896596:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560630.896600:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f3410a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.896605:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f3410a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.896614:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9caec3203200) 00010000:00010000:3.0:1787560630.896616:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560630.896619:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f3410a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.896625:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f3410a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.896666:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f340fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc91 expref: 36 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.896680:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34111 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc91 expref: 35 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560630.896768:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:3.0:1787560630.896770:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787560630.896773:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f7800, rc 0) 00000100:00100000:3.0:1787560630.897197:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec393aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+35:11165:x1874392853287424:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 1646us (2570us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1787560630.897206:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 57 00000100:00100000:3.0:1787560630.904053:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560630.904143:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853287552 00000100:00100000:0.0:1787560630.904154:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853287552 00000100:00100000:0.0:1787560630.904216:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 58 00000100:00100000:0.0:1787560630.904228:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+35:11165:x1874392853287552:12345-192.168.203.29@tcp:54:lfs.0 00010000:00010000:0.0:1787560630.904295:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f3411f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.904312:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f3411f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.904324:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f3411f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.904361:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f3411f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.904368:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f3411f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.904392:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f3411f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.904397:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881c00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560630.904401:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f3411f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.904408:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f3411f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.904420:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:0.0:1787560630.904423:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787560630.904428:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f3411f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560630.904456:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f3411f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560630.904536:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+35:11165:x1874392853287552:12345-192.168.203.29@tcp:54:lfs.0 Request processed in 311us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560630.904544:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 58 00000100:00100000:1.0:1787560630.907059:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560630.908150:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853287808 00000100:00100000:0.0:1787560630.908160:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853287808 00000100:00100000:0.0:1787560630.908220:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:0.0:1787560630.908230:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+35:11165:x1874392853287808:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:0.0:1787560630.908448:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+36:11165:x1874392853287808:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 219us (1396us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1787560630.908456:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:2.0:1787560631.224115:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560631.224235:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853288064 00000100:00100000:1.0:1787560631.224245:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853288064 00000100:00100000:1.0:1787560631.224340:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 59 00000100:00100000:1.0:1787560631.224352:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+36:11196:x1874392853288064:12345-192.168.203.29@tcp:101:cat.0 00010000:00010000:1.0:1787560631.224387:0:10172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560631.224408:0:10172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f34126 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fc98 expref: -99 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.224540:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f3412d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.224556:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f3412d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.224568:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f3412d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560631.224578:0:10172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787560631.224703:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f34126 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc98 expref: 39 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.224724:0:10172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f3412d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc98 expref: 38 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.224741:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:1.0:1787560631.224744:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787560631.224748:0:10172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbff000, rc 0) 00000100:00100000:1.0:1787560631.224811:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+38:11196:x1874392853288064:12345-192.168.203.29@tcp:101:cat.0 Request processed in 462us (704us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1787560631.224818:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 59 00000100:00100000:3.0:1787560631.227311:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560631.227397:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560631.227701:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853288448 00000100:00100000:0.0:1787560631.227710:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853288448 00000100:00100000:1.0:1787560631.228044:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853288192 00000100:00100000:1.0:1787560631.228049:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853288192 00000100:00100000:1.0:1787560631.228260:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:1.0:1787560631.228302:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+39:2404:x1874392853288192:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560631.228318:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560631.228344:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f3412d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc98 expref: 39 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.228363:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:1.0:1787560631.228378:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560631.228460:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+38:2404:x1874392853288192:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 176us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560631.228468:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:0.0:1787560631.228550:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:0.0:1787560631.228559:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+37:11196:x1874392853288448:12345-192.168.203.29@tcp:35:cat.0 00000100:00100000:0.0:1787560631.228769:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+38:11196:x1874392853288448:12345-192.168.203.29@tcp:35:cat.0 Request processed in 211us (1370us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1787560631.228776:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 12 00010000:00010000:0.0:1787560631.283648:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560631.301922:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560631.302064:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560631.302103:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560631.302141:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560631.302166:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853288832 00000100:00100000:3.0:1787560631.302174:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853288832 00000100:00100000:3.0:1787560631.302217:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853288704 00000100:00100000:3.0:1787560631.302219:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853288704 00000100:00100000:3.0:1787560631.302231:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853288960 00000100:00100000:3.0:1787560631.302233:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853288960 00000100:00100000:3.0:1787560631.302244:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 272 00000100:00100000:3.0:1787560631.302251:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2404:x1874392853288832:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560631.302330:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2404:x1874392853288832:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 78us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560631.302342:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 272 00000100:00100000:3.0:1787560631.302362:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 273 00000100:00100000:3.0:1787560631.302369:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+5:2404:x1874392853288704:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560631.302410:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+5:2404:x1874392853288704:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 42us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560631.302417:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 273 00000100:00100000:3.0:1787560631.302451:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 274 00000100:00100000:3.0:1787560631.302459:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec32c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2404:x1874392853288960:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560631.302497:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec32c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2404:x1874392853288960:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 39us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560631.302504:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 274 00000100:00080000:3.0:1787560631.302522:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787560631.302526:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560631.303846:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853288576 00000100:00100000:1.0:1787560631.303856:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853288576 00000100:00100000:1.0:1787560631.303949:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 377 00000100:00100000:1.0:1787560631.303959:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+13:2404:x1874392853288576:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560631.304026:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+13:2404:x1874392853288576:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 68us (2113us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560631.304033:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 377 00000100:00100000:3.0:1787560631.314080:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560631.314197:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853289216 00000100:00100000:1.0:1787560631.314207:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853289216 00000100:00100000:1.0:1787560631.314271:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 60 00000100:00100000:1.0:1787560631.314290:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec32c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+38:11202:x1874392853289216:12345-192.168.203.29@tcp:101:dd.0 00010000:00010000:1.0:1787560631.314315:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560631.314318:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787560631.314344:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34093 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc6e expref: 38 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.314382:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:1.0:1787560631.314388:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787560631.314401:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f3413b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fc9f expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.315017:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f34142 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.315034:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34111 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc91 expref: 38 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.315042:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f34142 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.315075:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34111 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc91 expref: 38 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.315089:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34111 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc91 expref: 38 pid: 6500 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560631.315103:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b87100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6498:1874392862814592:192.168.203.29@tcp:104: 00000100:00100000:1.0:1787560631.315207:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec322d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560631.320090:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560631.320197:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b87100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6498:1874392862814592:192.168.203.29@tcp:104: 00010000:00010000:1.0:1787560631.320223:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f34142 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560631.320291:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853289344 00000100:00100000:3.0:1787560631.320299:0:9502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853289344 00010000:00010000:3.0:1787560631.320332:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34111 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc91 expref: 39 pid: 6500 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560631.320371:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 55 00000100:00100000:3.0:1787560631.320382:0:9502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3884a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+39:2403:x1874392853289344:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560631.320397:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560631.320404:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34111 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc91 expref: 39 pid: 6500 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560631.320418:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34111 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc91 expref: 39 pid: 6500 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560631.320477:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34111 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc91 expref: 39 pid: 6500 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560631.320505:0:9502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:3.0:1787560631.320510:0:9502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f34142 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560631.320518:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f34142 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560631.320525:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f34142 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560631.320553:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787560631.320812:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f34142 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.320825:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f34142 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560631.320844:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787560631.320991:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f3413b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc9f expref: 40 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.321007:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f34142 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc9f expref: 39 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.321014:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:1.0:1787560631.321016:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787560631.321019:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbff600, rc 0) 00000100:00100000:1.0:1787560631.321067:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec32c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+39:11202:x1874392853289216:12345-192.168.203.29@tcp:101:dd.0 Request processed in 6779us (6995us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1787560631.321075:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 60 00000100:00100000:3.0:1787560631.321483:0:9502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3884a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+38:2403:x1874392853289344:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 1101us (1401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560631.321491:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 55 00000100:00100000:0.0:1787560631.330315:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560631.330918:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853289472 00000100:00100000:3.0:1787560631.330928:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853289472 00000100:00100000:3.0:1787560631.330995:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 61 00000100:00100000:3.0:1787560631.331004:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+38:11202:x1874392853289472:12345-192.168.203.29@tcp:101:dd.0 00010000:00010000:3.0:1787560631.331027:0:10172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560631.331049:0:10172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f34150 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fca6 expref: -99 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560631.331085:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f34157 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560631.331097:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f34157 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560631.331108:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f34157 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560631.331238:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f34150 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fca6 expref: 40 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560631.331257:0:10172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f34157 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fca6 expref: 39 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560631.331267:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:3.0:1787560631.331270:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787560631.331273:0:10172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f7600, rc 0) 00000100:00100000:3.0:1787560631.331779:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+39:11202:x1874392853289472:12345-192.168.203.29@tcp:101:dd.0 Request processed in 773us (1472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560631.331787:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 61 00000100:00100000:2.0:1787560631.345413:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560631.345605:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853289728 00000100:00100000:0.0:1787560631.345615:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853289728 00000100:00100000:0.0:1787560631.345666:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 62 00000100:00100000:0.0:1787560631.345676:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+39:11202:x1874392853289728:12345-192.168.203.29@tcp:36:dd.0 00010000:00010000:0.0:1787560631.345897:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f3415e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560631.345916:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f3415e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560631.345928:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f3415e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787560631.345987:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:0.0:1787560631.346008:0:6500:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f6fe1f4f reply state 000000008f229e36 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f3415e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560631.346020:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f3415e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560631.346028:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:0.0:1787560631.346044:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787560631.346048:0:6500:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787560631.346137:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+42:11202:x1874392853289728:12345-192.168.203.29@tcp:36:dd.0 Request processed in 462us (733us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1787560631.346145:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 62 00000020:00080000:0.0:1787560631.346149:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787560631.353746:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec390a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862814720:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787560631.353831:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560631.354061:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862814720 00000100:00100000:2.0:1787560631.354084:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862814720 00000100:00100000:2.0:1787560631.354134:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787560631.354143:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec32c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862814720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787560631.354177:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787560631.354234:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec32c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862814720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560631.354241:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787560631.354328:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec390a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862814720:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787560631.628730:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560631.629461:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853289856 00000100:00100000:1.0:1787560631.629472:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853289856 00000100:00100000:1.0:1787560631.629552:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 63 00000100:00100000:1.0:1787560631.629562:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec390a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+42:11216:x1874392853289856:12345-192.168.203.29@tcp:101:stat.0 00010000:00010000:1.0:1787560631.629702:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560631.629725:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f34165 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fcad expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.629793:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3416c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.629826:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3416c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.629839:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3416c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.629853:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f34173 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.629861:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f34173 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.629867:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f34173 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.629937:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3417a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.629948:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f34142 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc9f expref: 43 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.629957:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3417a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.630002:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f34142 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc9f expref: 43 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.630015:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f34142 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc9f expref: 43 pid: 6498 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560631.630041:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b87100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6498:1874392862814848:192.168.203.29@tcp:104: 00000100:00100000:1.0:1787560631.630141:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec322d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560631.634063:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b87100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6498:1874392862814848:192.168.203.29@tcp:104: 00010000:00010000:1.0:1787560631.634097:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3417a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560631.638121:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560631.638250:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853290112 00000100:00100000:2.0:1787560631.638261:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853290112 00000100:00100000:2.0:1787560631.638315:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:2.0:1787560631.638323:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec390aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+44:6644:x1874392853290112:12345-192.168.203.29@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787560631.638636:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec390aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+45:6644:x1874392853290112:12345-192.168.203.29@tcp:35:ldlm_bl.0 Request processed in 312us (524us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1787560631.638644:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:0.0:1787560631.646056:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560631.646155:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853290240 00000100:00100000:3.0:1787560631.646164:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853290240 00010000:00010000:3.0:1787560631.646211:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f34142 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc9f expref: 45 pid: 6498 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560631.646254:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 56 00000100:00100000:3.0:1787560631.646264:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3908e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+45:2404:x1874392853290240:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560631.646278:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560631.646285:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f34142 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc9f expref: 45 pid: 6498 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560631.646315:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f34142 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc9f expref: 45 pid: 6498 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560631.646337:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f34142 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc9f expref: 45 pid: 6498 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560631.646355:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:3.0:1787560631.646359:0:6486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3417a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560631.646369:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3417a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560631.646377:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3417a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560631.646404:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787560631.646481:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3417a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.646491:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3417a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560631.646503:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3908e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+44:2404:x1874392853290240:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 240us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560631.646512:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 56 00000004:00200000:1.0:1787560631.647361:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787560631.647367:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787560631.647411:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3417a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.647427:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3417a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.647477:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3416c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.647484:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3416c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.647490:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3416c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.647496:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbff800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560631.647510:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3416c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.647518:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3416c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.647531:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:1.0:1787560631.647602:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560631.647608:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3416c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.647614:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3416c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.647628:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f34173 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.647634:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f34173 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.647640:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f34173 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.647645:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbff200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560631.647648:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f34173 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.647654:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f34173 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.647661:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9caec3203200) 00010000:00010000:1.0:1787560631.647663:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560631.647672:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f34173 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.647678:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f34173 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.647712:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f34165 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcad expref: 44 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.647725:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3417a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcad expref: 43 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.647732:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:1.0:1787560631.647734:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787560631.647737:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbfec00, rc 0) 00000100:00100000:1.0:1787560631.647787:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec390a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+43:11216:x1874392853289856:12345-192.168.203.29@tcp:101:stat.0 Request processed in 18226us (19067us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560631.647794:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 63 00000100:00100000:0.0:1787560631.735284:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560631.735569:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853290496 00000100:00100000:3.0:1787560631.735583:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853290496 00000100:00100000:3.0:1787560631.735691:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 64 00000100:00100000:3.0:1787560631.735703:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1fac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+43:11222:x1874392853290496:12345-192.168.203.29@tcp:36:truncate.0 00010000:00010000:3.0:1787560631.735777:0:10172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560631.735813:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3417a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcad expref: 43 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560631.735857:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:3.0:1787560631.735863:0:10172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787560631.736121:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f34181 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560631.736139:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f34181 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560631.736151:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f34181 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787560631.736205:0:10172:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:3.0:1787560631.736236:0:10172:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f06154d2 reply state 0000000053c4ff66 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f34181 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560631.736314:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f34181 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560631.736321:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:3.0:1787560631.736324:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787560631.736328:0:10172:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787560631.736637:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1fac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+45:11222:x1874392853290496:12345-192.168.203.29@tcp:36:truncate.0 Request processed in 934us (1365us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1787560631.736645:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 64 00000020:00080000:3.0:1787560631.736650:0:10172:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787560631.888332:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560631.892198:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853290624 00000100:00100000:2.0:1787560631.892224:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853290624 00000100:00100000:2.0:1787560631.892347:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 65 00000100:00100000:2.0:1787560631.892361:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec32c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+45:11236:x1874392853290624:12345-192.168.203.29@tcp:101:stat.0 00010000:00010000:2.0:1787560631.892410:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560631.892620:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f34188 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fcb4 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560631.892710:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f3418f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560631.892727:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f3418f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560631.892766:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f3418f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560631.892781:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34196 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560631.892790:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34196 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560631.892797:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34196 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560631.892915:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f3419d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560631.892925:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f3419d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560631.895456:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f3419d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560631.895542:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1787560631.895548:0:6499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787560631.895589:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f3419d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560631.895607:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f3419d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560631.895620:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f3418f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560631.895651:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f3418f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560631.895660:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f3418f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560631.895667:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560631.895672:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f3418f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560631.895680:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f3418f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560631.895696:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:2.0:1787560631.895699:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560631.895705:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f3418f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560631.895712:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f3418f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560631.895735:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34196 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560631.895742:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34196 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560631.895748:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34196 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560631.895754:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168a00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560631.895764:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34196 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560631.895771:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34196 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560631.895780:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9caec3203200) 00010000:00010000:2.0:1787560631.895783:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560631.895786:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34196 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560631.895792:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34196 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560631.895845:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f34188 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcb4 expref: 47 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560631.895862:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f3419d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcb4 expref: 46 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560631.895870:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:2.0:1787560631.895872:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787560631.895875:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2169600, rc 0) 00000100:00100000:2.0:1787560631.897592:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec32c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+46:11236:x1874392853290624:12345-192.168.203.29@tcp:101:stat.0 Request processed in 3607us (7648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560631.897617:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 65 00000100:00100000:0.0:1787560631.984570:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560631.984776:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853290880 00000100:00100000:1.0:1787560631.984790:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853290880 00000100:00100000:1.0:1787560631.984867:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 66 00000100:00100000:1.0:1787560631.984880:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+46:11246:x1874392853290880:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:1.0:1787560631.984919:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560631.984956:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f341a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fcbb expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560631.985339:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1787560631.985522:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f341a4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcbb expref: 48 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.985561:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec2028000) 00010000:00010000:1.0:1787560631.985564:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787560631.985570:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f341a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcbb expref: 48 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560631.985585:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbff000, rc 0) 00000100:00100000:1.0:1787560631.987479:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+47:11246:x1874392853290880:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 787us (1111us total) trans 4294967341 rc 301/301 00000100:00100000:1.0:1787560631.987497:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 66 00000100:00100000:0.0:1787560631.990182:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560631.990545:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853291136 00000100:00100000:2.0:1787560631.990560:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853291136 00000100:00100000:2.0:1787560631.990692:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:2.0:1787560631.990705:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+47:11246:x1874392853291136:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:2.0:1787560631.991057:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+48:11246:x1874392853291136:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 354us (888us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1787560631.991066:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:3.0:1787560632.102217:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560632.107951:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853291392 00000100:00100000:1.0:1787560632.107984:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853291392 00000100:00100000:1.0:1787560632.108104:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 67 00000100:00100000:1.0:1787560632.108120:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec32c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+48:11252:x1874392853291392:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:1.0:1787560632.108154:0:10172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560632.108182:0:10172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f341b2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fcc2 expref: -99 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560632.108345:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f341b9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560632.108364:0:10172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f3419d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcb4 expref: 49 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560632.108375:0:10172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f341b9 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560632.108420:0:10172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f3419d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcb4 expref: 49 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560632.108488:0:10172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f3419d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcb4 expref: 49 pid: 6499 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560632.108507:0:10172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b87100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10172:1874392862814976:192.168.203.29@tcp:104: 00000100:00100000:1.0:1787560632.108645:0:10172:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c53c0 going to sleep for 11 seconds 00000100:00080000:3.0:1787560632.109542:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560632.113028:0:10172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b87100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10172:1874392862814976:192.168.203.29@tcp:104: 00010000:00010000:1.0:1787560632.113068:0:10172:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f341b9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560632.113339:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560632.113474:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853291520 00000100:00100000:1.0:1787560632.113483:0:9502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853291520 00010000:00010000:1.0:1787560632.113528:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f3419d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcb4 expref: 50 pid: 6499 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560632.113576:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 57 00000100:00100000:1.0:1787560632.113587:0:9502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd7cb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+50:2405:x1874392853291520:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560632.113607:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560632.113616:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f3419d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcb4 expref: 50 pid: 6499 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560632.113631:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f3419d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcb4 expref: 50 pid: 6499 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560632.113673:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f3419d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcb4 expref: 50 pid: 6499 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560632.113709:0:9502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:1.0:1787560632.113716:0:9502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f341b9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560632.113730:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f341b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560632.113740:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f341b9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560632.113774:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560632.113837:0:9502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd7cb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+49:2405:x1874392853291520:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 250us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560632.113846:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 57 00010000:00010000:3.0:1787560632.114394:0:10172:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f341b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.114407:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f341b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560632.114461:0:10172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1787560632.114648:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f341b2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcc2 expref: 50 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.115327:0:10172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f341b9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcc2 expref: 49 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.115338:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:3.0:1787560632.115341:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787560632.115344:0:10172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbff200, rc 0) 00000100:00100000:3.0:1787560632.115408:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec32c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+49:11252:x1874392853291392:12345-192.168.203.29@tcp:101:bash.0 Request processed in 7292us (13206us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1787560632.115417:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 67 00000100:00100000:3.0:1787560632.121851:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560632.125149:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853291776 00000100:00100000:2.0:1787560632.125169:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853291776 00000100:00100000:2.0:1787560632.125503:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 68 00000100:00100000:2.0:1787560632.125519:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec32c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+49:11252:x1874392853291776:12345-192.168.203.29@tcp:36:bash.0 00010000:00010000:2.0:1787560632.126190:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f341c7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.126217:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f341c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.126234:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f341c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787560632.126523:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1787560632.126557:0:6499:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b792f7e reply state 00000000a23af490 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f341c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.126574:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f341c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.126584:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:2.0:1787560632.126588:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787560632.126593:0:6499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787560632.126818:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec32c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+52:11252:x1874392853291776:12345-192.168.203.29@tcp:36:bash.0 Request processed in 1300us (4977us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1787560632.126828:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 68 00000020:00080000:2.0:1787560632.126846:0:6499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787560632.132879:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560632.133029:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853291904 00000100:00100000:3.0:1787560632.133044:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853291904 00000100:00100000:3.0:1787560632.133119:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 69 00000100:00100000:3.0:1787560632.133131:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+52:11252:x1874392853291904:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:3.0:1787560632.133161:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560632.133186:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f341ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fcc9 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.133343:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f341d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.133366:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f341b9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcc2 expref: 53 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.133376:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f341d5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.133416:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f341b9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcc2 expref: 53 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.133472:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f341b9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcc2 expref: 53 pid: 10172 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560632.133489:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec32c4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6500:1874392862815104:192.168.203.29@tcp:104: 00000100:00100000:3.0:1787560632.133590:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787560632.136229:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec32c4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6500:1874392862815104:192.168.203.29@tcp:104: 00010000:00010000:3.0:1787560632.136292:0:6500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f341d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560632.137751:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560632.137863:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853292032 00000100:00100000:1.0:1787560632.137876:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853292032 00010000:00010000:1.0:1787560632.137942:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f341b9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcc2 expref: 54 pid: 10172 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560632.137993:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 58 00000100:00100000:1.0:1787560632.138005:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+54:2404:x1874392853292032:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560632.138026:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560632.138035:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f341b9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcc2 expref: 54 pid: 10172 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560632.138052:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f341b9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcc2 expref: 54 pid: 10172 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560632.138099:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f341b9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcc2 expref: 54 pid: 10172 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560632.138118:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:1.0:1787560632.138124:0:6484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f341d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560632.138134:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f341d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560632.138142:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f341d5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560632.138183:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560632.138260:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+53:2404:x1874392853292032:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 257us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560632.138268:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 58 00010000:00010000:0.0:1787560632.138427:0:6500:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f341d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.138466:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f341d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560632.138536:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787560632.138542:0:6500:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787560632.138568:0:6500:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f341d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.138605:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f341ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcc9 expref: 53 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.138621:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f341d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcc9 expref: 52 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.138637:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:0.0:1787560632.138640:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787560632.138642:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f7000, rc 0) 00000100:00100000:0.0:1787560632.138670:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+52:11252:x1874392853291904:12345-192.168.203.29@tcp:101:bash.0 Request processed in 5543us (5807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560632.138677:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 69 00000100:00100000:0.0:1787560632.143389:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560632.143596:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853292288 00000100:00100000:3.0:1787560632.143609:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853292288 00000100:00100000:3.0:1787560632.143688:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00100000:3.0:1787560632.143702:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd7c06c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+52:11252:x1874392853292288:12345-192.168.203.29@tcp:35:bash.0 00000100:00100000:3.0:1787560632.144498:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd7c06c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+53:11252:x1874392853292288:12345-192.168.203.29@tcp:35:bash.0 Request processed in 726us (1052us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1787560632.144509:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00100000:2.0:1787560632.225956:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560632.226186:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853292544 00000100:00100000:3.0:1787560632.226218:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853292544 00000100:00100000:3.0:1787560632.226306:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 70 00000100:00100000:3.0:1787560632.226320:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+53:11262:x1874392853292544:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1787560632.226368:0:10172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560632.226398:0:10172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f341dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fcd0 expref: -99 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560632.226801:0:10172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787560632.226942:0:10172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f341dc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcd0 expref: 55 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.226961:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec2028000) 00010000:00010000:2.0:1787560632.226975:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787560632.226981:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f341dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcd0 expref: 55 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.226999:0:10172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f7800, rc 0) 00000100:00100000:2.0:1787560632.227081:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+54:11262:x1874392853292544:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 764us (1143us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1787560632.227090:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 70 00000100:00100000:0.0:1787560632.231679:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560632.231973:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853292672 00000100:00100000:2.0:1787560632.231985:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853292672 00000100:00100000:2.0:1787560632.232057:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 71 00000100:00100000:2.0:1787560632.232069:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+54:11262:x1874392853292672:12345-192.168.203.29@tcp:34:lfs.0 00010000:00010000:2.0:1787560632.232173:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f341ea lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.232193:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f341ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.232207:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f341ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.232219:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f341f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.232253:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f341f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.232260:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f341f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.232353:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f341f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.232362:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f341f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.232368:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f341f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787560632.232606:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f341f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.232623:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f341ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.232631:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f341ea lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.232638:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f341ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.232644:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169400 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560632.232649:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f341ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.232657:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f341ea lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.232679:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:2.0:1787560632.232682:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560632.232687:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f341ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.232695:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f341ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.232715:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f341f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.232722:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f341f1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.232728:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f341f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.232734:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169a00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560632.232737:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f341f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.232743:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f341f1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.232749:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9caec3203200) 00010000:00010000:2.0:1787560632.232751:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560632.232754:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f341f1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.232759:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f341f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.232778:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f341f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.232784:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f341f8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.232790:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f341f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.232795:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560632.232798:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f341f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.232803:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f341f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.232810:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:2.0:1787560632.232813:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560632.232816:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f341f8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.232822:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f341f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560632.232913:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+54:11262:x1874392853292672:12345-192.168.203.29@tcp:34:lfs.0 Request processed in 843us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560632.232921:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 71 00000100:00100000:0.0:1787560632.235778:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560632.236264:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853292928 00000100:00100000:2.0:1787560632.236279:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853292928 00000100:00100000:2.0:1787560632.236352:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:2.0:1787560632.236382:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+54:11262:x1874392853292928:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:2.0:1787560632.236698:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+55:11262:x1874392853292928:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 317us (934us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1787560632.236719:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:3.0:1787560632.272632:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560632.272821:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853293184 00000100:00100000:0.0:1787560632.272836:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853293184 00000100:00100000:0.0:1787560632.272925:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 72 00000100:00100000:0.0:1787560632.272938:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec32c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+55:11265:x1874392853293184:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:0.0:1787560632.272991:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560632.273019:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f341ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fcd7 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.273149:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34206 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.273167:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34206 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.273180:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34206 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.273192:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f3420d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.273214:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f3420d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.273222:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f3420d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.273371:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34214 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.273382:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34214 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.273391:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34214 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560632.273402:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787560632.273557:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34206 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.273565:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34206 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.273574:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34206 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.273580:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560632.273586:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34206 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.273594:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34206 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.273622:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:0.0:1787560632.273626:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560632.273632:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34206 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.273639:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34206 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.273657:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f3420d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.273664:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f3420d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.273670:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f3420d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.273676:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881c00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560632.274163:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f3420d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.274177:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f3420d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.274188:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9caec3203200) 00010000:00010000:0.0:1787560632.274191:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560632.274195:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f3420d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.274202:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f3420d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.274330:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f341ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcd7 expref: 58 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.274347:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34214 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcd7 expref: 57 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.274356:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:0.0:1787560632.274358:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787560632.274361:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3880800, rc 0) 00000100:00100000:0.0:1787560632.274532:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec32c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+57:11265:x1874392853293184:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 1595us (1916us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1787560632.274542:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 72 00000100:00100000:0.0:1787560632.280776:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560632.280998:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560632.281535:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853293440 00000100:00100000:2.0:1787560632.281549:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853293440 00000100:00100000:2.0:1787560632.281622:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 73 00000100:00100000:2.0:1787560632.281636:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc87ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+57:11265:x1874392853293440:12345-192.168.203.29@tcp:54:lfs.0 00010000:00010000:2.0:1787560632.281807:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f34222 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.281888:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f34222 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.281913:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f34222 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.281972:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f34222 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.281980:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f34222 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.281987:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f34222 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.281993:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560632.281998:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f34222 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.282029:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f34222 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.282045:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:2.0:1787560632.282049:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787560632.282054:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f34222 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.282060:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f34222 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560632.282368:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc87ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+57:11265:x1874392853293440:12345-192.168.203.29@tcp:54:lfs.0 Request processed in 732us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560632.282378:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 73 00000100:00100000:1.0:1787560632.282809:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853293312 00000100:00100000:3.0:1787560632.285391:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560632.285474:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853293696 00000100:00100000:3.0:1787560632.285486:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853293696 00000100:00100000:3.0:1787560632.285551:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:3.0:1787560632.285563:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+57:11265:x1874392853293696:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:1.0:1787560632.285822:0:9502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853293312 00000100:00100000:1.0:1787560632.285873:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:1.0:1787560632.285881:0:9502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+58:2404:x1874392853293312:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560632.285907:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560632.285941:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34214 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcd7 expref: 58 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560632.285973:0:9502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:1.0:1787560632.285980:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560632.286056:0:9502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+57:2404:x1874392853293312:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 175us (5356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560632.286063:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:3.0:1787560632.286622:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+57:11265:x1874392853293696:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 1059us (1244us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1787560632.286631:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 17 00010000:00010000:2.0:1787560632.307631:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560632.420033:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560632.420393:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853293952 00000100:00100000:2.0:1787560632.420407:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853293952 00000100:00100000:2.0:1787560632.420530:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 74 00000100:00100000:2.0:1787560632.420543:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+57:11284:x1874392853293952:12345-192.168.203.29@tcp:101:cat.0 00010000:00010000:2.0:1787560632.420577:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560632.420604:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f34229 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fcde expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.420747:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34230 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.420772:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34230 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.421019:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34230 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560632.421034:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787560632.421171:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f34229 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcde expref: 60 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.421587:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34230 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcde expref: 59 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.421602:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:2.0:1787560632.421606:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787560632.421610:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2169a00, rc 0) 00000100:00100000:2.0:1787560632.421703:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+59:11284:x1874392853293952:12345-192.168.203.29@tcp:101:cat.0 Request processed in 1161us (1684us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1787560632.421714:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 74 00000100:00100000:1.0:1787560632.454353:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560632.454521:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853294080 00000100:00100000:0.0:1787560632.454534:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853294080 00000100:00100000:0.0:1787560632.454627:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 75 00000100:00100000:0.0:1787560632.454641:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+59:11285:x1874392853294080:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:0.0:1787560632.454672:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560632.454697:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f3423e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fce5 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.454782:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34245 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.454800:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34245 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.454833:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34245 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560632.455018:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787560632.455022:0:6500:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787560632.455047:0:6500:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34245 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.455154:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f3423e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fce5 expref: 61 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.455176:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34245 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fce5 expref: 60 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.455187:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:0.0:1787560632.455191:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787560632.455196:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881600, rc 0) 00000100:00100000:0.0:1787560632.455394:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+60:11285:x1874392853294080:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 755us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560632.455402:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 75 00000100:00100000:0.0:1787560632.464281:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560632.464415:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853294464 00000100:00100000:3.0:1787560632.464464:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853294464 00000100:00100000:3.0:1787560632.464536:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:3.0:1787560632.464547:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc87ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+60:11285:x1874392853294464:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:3.0:1787560632.464932:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc87ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+61:11285:x1874392853294464:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 384us (664us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1787560632.464941:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:1.0:1787560632.471145:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560632.475022:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853294592 00000100:00100000:2.0:1787560632.475044:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853294592 00000100:00100000:2.0:1787560632.475316:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:2.0:1787560632.475331:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+61:11285:x1874392853294592:12345-192.168.203.29@tcp:103:lfs.0 00010000:00010000:2.0:1787560632.475350:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787560632.475379:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f341d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcc9 expref: 61 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.475408:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34230 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcde expref: 60 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.475488:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f340d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc83 expref: 59 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.475500:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:2.0:1787560632.475506:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560632.475606:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+58:11285:x1874392853294592:12345-192.168.203.29@tcp:103:lfs.0 Request processed in 278us (4475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560632.475615:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:1.0:1787560632.478425:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560632.481452:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853294720 00000100:00100000:2.0:1787560632.481474:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853294720 00000100:00100000:2.0:1787560632.481563:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 76 00000100:00100000:2.0:1787560632.481574:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+58:11285:x1874392853294720:12345-192.168.203.29@tcp:58:lfs.0 00010000:00010000:2.0:1787560632.481775:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f3424c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.481797:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f3424c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.481811:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f3424c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787560632.483468:0:10172:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787560632.483970:0:10172:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1787560632.484655:0:10172:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1787560632.484865:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+58:11285:x1874392853294720:12345-192.168.203.29@tcp:58:lfs.0 Request processed in 3283us (6444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560632.484880:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 76 00000040:00080000:2.0:1787560632.501188:0:13775:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787560632.501201:0:13775:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787560632.501270:0:13775:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787560632.501281:0:13775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787560632.501517:0:13775:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc52c0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13775:1874392862815232:192.168.203.29@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787560632.501641:0:13775:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd8640840 going to sleep for 11 seconds 00000040:00080000:0.0:1787560632.503408:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787560632.517038:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560632.517397:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853294848 00000100:00100000:3.0:1787560632.517411:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853294848 00000100:00100000:3.0:1787560632.517505:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 77 00000100:00100000:3.0:1787560632.517517:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+59:11289:x1874392853294848:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787560632.517579:0:6499:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787560632.517747:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+59:11289:x1874392853294848:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 Request processed in 231us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560632.517756:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 77 00000100:00100000:2.0:1787560632.517895:0:13775:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc52c0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13775:1874392862815232:192.168.203.29@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787560632.521390:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560632.521550:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853294976 00000100:00100000:0.0:1787560632.521564:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853294976 00000100:00100000:0.0:1787560632.521641:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 78 00000100:00100000:0.0:1787560632.521655:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+58:11287:x1874392853294976:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:0.0:1787560632.521683:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560632.521730:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34253 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fcec expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.521986:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3425a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.522004:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3425a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.522019:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3425a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.522034:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34261 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.522042:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34261 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.522048:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34261 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.522141:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34268 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.522153:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34268 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.522161:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34268 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560632.522217:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787560632.522223:0:6500:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787560632.522320:0:6500:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34268 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.522343:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34268 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.522353:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3425a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.522360:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3425a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.522368:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3425a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.522374:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881a00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560632.522379:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3425a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.522388:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3425a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.522403:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:0.0:1787560632.522406:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560632.522411:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3425a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.522417:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3425a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.522478:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34261 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.522485:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34261 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.522498:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34261 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.522504:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560632.522507:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34261 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.522514:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34261 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.522524:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9caec3203200) 00010000:00010000:0.0:1787560632.522527:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560632.522530:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34261 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.522535:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34261 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.522570:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34253 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcec expref: 60 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.522584:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34268 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcec expref: 59 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.522592:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:0.0:1787560632.522594:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787560632.522597:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3880800, rc 0) 00000100:00100000:0.0:1787560632.522668:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+59:11287:x1874392853294976:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 1015us (1291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560632.522685:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 78 00000100:00100000:1.0:1787560632.530691:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560632.530781:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853295104 00000100:00100000:2.0:1787560632.530793:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853295104 00000100:00100000:2.0:1787560632.530877:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 79 00000100:00100000:2.0:1787560632.530890:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+59:11289:x1874392853295104:12345-192.168.203.29@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787560632.530992:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f3426f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.531013:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f3426f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.531026:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f3426f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.531237:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34276 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.531264:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34276 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.531277:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34276 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.531312:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f3427d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.531335:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f3427d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.531341:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f3427d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560632.531389:0:10172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787560632.531393:0:10172:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787560632.531406:0:10172:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f3427d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.531419:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f3426f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.531426:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f3426f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.531470:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f3426f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.531488:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169a00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560632.531493:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f3426f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.531500:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f3426f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.531512:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9caec3207900) 00010000:00010000:2.0:1787560632.531515:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560632.531520:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f3426f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.531538:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f3426f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.531555:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34276 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.531562:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34276 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.531568:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34276 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.531572:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169400 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560632.531575:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34276 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.531581:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34276 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.531588:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9cafda3d1200) 00010000:00010000:2.0:1787560632.531590:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560632.531593:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34276 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.531598:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34276 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.531611:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f3427d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.531617:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f3427d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.531627:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f3427d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.531632:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169e00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560632.531635:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f3427d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.531640:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f3427d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.531647:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:2.0:1787560632.531650:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560632.531653:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f3427d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.531658:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f3427d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560632.535375:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+59:11289:x1874392853295104:12345-192.168.203.29@tcp:34:lhsmtool_posix.0 Request processed in 1299us (1508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560632.535404:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 79 00000100:00100000:1.0:1787560632.539015:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560632.539224:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853295360 00000100:00100000:0.0:1787560632.539238:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853295360 00000100:00100000:0.0:1787560632.539308:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 80 00000100:00100000:0.0:1787560632.539318:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+59:11289:x1874392853295360:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787560632.539338:0:13787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560632.539359:0:13787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34284 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fcf3 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.540213:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f3428b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.540232:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f3428b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.540244:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f3428b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560632.540256:0:13787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787560632.540331:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f3428b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.540340:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f3428b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.540347:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f3428b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.540353:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560632.540358:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f3428b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.540378:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f3428b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.540392:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:0.0:1787560632.540395:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787560632.540399:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f3428b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.540404:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f3428b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.541184:0:13787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34284 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcf3 expref: 61 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.541200:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9caec3207900) 00010000:00010000:0.0:1787560632.541203:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787560632.541208:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34284 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcf3 expref: 61 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.541221:0:13787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881c00, rc 0) 00000100:00100000:0.0:1787560632.541362:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+60:11289:x1874392853295360:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 2043us (2357us total) trans 4294967353 rc 301/301 00000100:00100000:0.0:1787560632.541372:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 80 00000100:00100000:1.0:1787560632.551678:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560632.552460:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853295488 00000100:00100000:0.0:1787560632.552474:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853295488 00000100:00100000:3.0:1787560632.552620:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 81 00000100:00100000:3.0:1787560632.552637:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+60:11289:x1874392853295488:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787560632.552687:0:6500:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787560632.553014:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+60:11289:x1874392853295488:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 Request processed in 380us (1349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560632.553026:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 81 00000100:00100000:1.0:1787560632.560261:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560632.560774:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853295744 00000100:00100000:3.0:1787560632.560788:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853295744 00000100:00100000:3.0:1787560632.560873:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 82 00000100:00100000:3.0:1787560632.560885:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec390aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+60:11289:x1874392853295744:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787560632.561013:0:10172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560632.561017:0:10172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787560632.561055:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34245 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fce5 expref: 60 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.561080:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:3.0:1787560632.561086:0:10172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787560632.561103:0:10172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34299 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fcfa expref: -99 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787560632.561777:0:10172:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:3.0:1787560632.564123:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f342a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.564152:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f342a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.564166:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f342a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.564277:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34299 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcfa expref: 62 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.564301:0:10172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f342a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcfa expref: 61 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.564312:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cafe1537f00) 00010000:00010000:3.0:1787560632.564315:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787560632.564320:0:10172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f6800, rc 0) 00000100:00100000:3.0:1787560632.564558:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec390aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+61:11289:x1874392853295744:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 3672us (4308us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1787560632.564570:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 82 00000100:00100000:1.0:1787560632.574081:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560632.577139:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853296000 00000100:00100000:0.0:1787560632.577163:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853296000 00000100:00100000:0.0:1787560632.577265:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 83 00000100:00100000:0.0:1787560632.577278:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+61:11289:x1874392853296000:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787560632.577372:0:13787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560632.577406:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f342a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcfa expref: 61 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.579731:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cafe1537f00) 00010000:00010000:0.0:1787560632.579766:0:13787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787560632.579812:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f342ae lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.579834:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f342ae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.579848:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f342ae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.580253:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f342b5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x8ae8e958 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.580278:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f342b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x8ae8e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.580292:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f342b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x8ae8e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.580344:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f342ae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.580351:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f342ae lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.580359:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f342ae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.580380:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881c00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560632.580385:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f342ae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.580394:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f342ae lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.580407:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:0.0:1787560632.580411:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560632.580415:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f342ae lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.580422:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f342ae lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.580470:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f342b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x8ae8e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.580636:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f342b5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8ae8e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.580643:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f342b5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8ae8e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.580649:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560632.580653:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f342b5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8ae8e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.580660:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f342b5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8ae8e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.580923:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x8ae8e958 (ffff9caec2028700) 00010000:00010000:0.0:1787560632.580927:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560632.580930:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f342b5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x8ae8e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.580937:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f342b5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x8ae8e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560632.581139:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+60:11289:x1874392853296000:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 3858us (7079us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787560632.581149:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 83 00000100:00100000:1.0:1787560632.587805:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560632.587903:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853296128 00000100:00100000:3.0:1787560632.587915:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853296128 00000100:00100000:3.0:1787560632.587988:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 84 00000100:00100000:3.0:1787560632.588000:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+60:11289:x1874392853296128:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787560632.588024:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560632.588049:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f342bc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fd01 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.588111:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f342c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.588126:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f342c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.588139:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f342c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.588265:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f342bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd01 expref: 62 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.588285:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f342c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd01 expref: 61 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.588294:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cafe1537400) 00010000:00010000:3.0:1787560632.588297:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787560632.588302:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f7000, rc 0) 00000100:00100000:3.0:1787560632.588385:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+61:11289:x1874392853296128:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 387us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560632.588392:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 84 00000100:00100000:1.0:1787560632.594160:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560632.594332:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853296384 00000100:00100000:3.0:1787560632.594346:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853296384 00000100:00100000:3.0:1787560632.594588:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 85 00000100:00100000:3.0:1787560632.594602:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+61:11289:x1874392853296384:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787560632.594714:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f342ca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.594757:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f342ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.594770:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f342ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787560632.595105:0:10172:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1787560632.595118:0:10172:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 351934686513ns, next at 352934683244ns, rc = 0 00000004:00010000:3.0:1787560632.595194:0:10172:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fae86a6e reply state 000000004d834c03 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f342ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.595210:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f342ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.595219:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cafe1537400) 00010000:00010000:3.0:1787560632.595222:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787560632.595226:0:10172:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787560632.595558:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+63:11289:x1874392853296384:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 957us (1412us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1787560632.595566:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 85 00000100:00100000:2.0:1787560632.602263:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560632.602747:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853296512 00000100:00100000:0.0:1787560632.602760:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853296512 00000100:00100000:0.0:1787560632.602880:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 86 00000100:00100000:0.0:1787560632.602902:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+63:11289:x1874392853296512:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787560632.602934:0:13787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560632.602971:0:13787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f342d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fd08 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.603047:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f342d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd08 expref: 64 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.603065:0:13787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f342d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd08 expref: 64 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.603088:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cafe1537400) 00010000:00010000:0.0:1787560632.603092:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787560632.603115:0:13787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881800, rc 0) 00000100:00100000:0.0:1787560632.603182:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+64:11289:x1874392853296512:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 282us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560632.603190:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 86 00000100:00100000:1.0:1787560632.617458:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560632.623039:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853296640 00000100:00100000:0.0:1787560632.623059:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853296640 00000100:00100000:0.0:1787560632.623217:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 32 00000100:00100000:0.0:1787560632.623230:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1874392853296640:12345-192.168.203.29@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1787560632.623296:0:10171:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 9331bacf-6cfc-4379-8649-925e79b19df1@192.168.203.29@tcp t0 exp 0000000000000000 cur 351 last 0 00000020:00000080:0.0:1787560632.623338:0:10171:0:(genops.c:1385:class_connect()) connect: client 9331bacf-6cfc-4379-8649-925e79b19df1, cookie 0x4642c20bf2f342d8 00002000:00100000:0.0:1787560632.623352:0:10171:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9331bacf-6cfc-4379-8649-925e79b19df1/ffff9cafffe73800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787560632.623377:0:10171:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:0.0:1787560632.623501:0:10171:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787560632.623543:0:10171:0:(import.c:65:import_set_state_nolock()) ffff9cafffe70800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787560632.623669:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+6:2401:x1874392853296640:12345-192.168.203.29@tcp:8:lhsmtool_posix.0 Request processed in 439us (6222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560632.623678:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 32 00000100:00100000:1.0:1787560632.626805:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560632.626992:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853296768 00000100:00100000:0.0:1787560632.627006:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853296768 00000100:00100000:0.0:1787560632.627129:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 33 00000100:00100000:0.0:1787560632.627143:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+6:0:x1874392853296768:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1787560632.628071:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1787560632.640388:0:9491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:0.0:1787560632.640407:0:9491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9331bacf-6cfc-4379-8649-925e79b19df1 00000100:00100000:1.0:1787560632.640813:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:0:x1874392853296768:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 Request processed in 13665us (14014us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787560632.640826:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 33 00000100:00100000:0.0:1787560632.644991:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560632.645088:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853297024 00000100:00100000:3.0:1787560632.645107:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853297024 00000100:00100000:3.0:1787560632.645184:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:3.0:1787560632.645197:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc87aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+64:11289:x1874392853297024:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787560632.645543:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc87aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+65:11289:x1874392853297024:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 346us (566us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1787560632.645553:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:3.0:1787560632.649714:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560632.649844:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853297280 00000100:00100000:1.0:1787560632.649858:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853297280 00000100:00100000:1.0:1787560632.649949:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 87 00000100:00100000:1.0:1787560632.649973:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+65:11289:x1874392853297280:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787560632.650124:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+65:11289:x1874392853297280:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 163us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560632.650145:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 87 00000100:00100000:1.0:1787560632.655028:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560632.658021:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853297408 00000100:00100000:3.0:1787560632.658042:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853297408 00000100:00100000:3.0:1787560632.658139:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 88 00000100:00100000:3.0:1787560632.658153:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+65:11289:x1874392853297408:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787560632.658181:0:10172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560632.658208:0:10172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f342df lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fd0f expref: -99 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.658316:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f342e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.658333:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f342e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.658345:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f342e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560632.658403:0:10172:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787560632.658427:0:10172:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f342e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.658479:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f342df lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd0f expref: 67 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.658501:0:10172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f342e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd0f expref: 66 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.658511:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cafe1537400) 00010000:00010000:3.0:1787560632.658515:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787560632.658530:0:10172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafc0030400, rc 0) 00000100:00100000:3.0:1787560632.658612:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+66:11289:x1874392853297408:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 463us (3594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560632.658620:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 88 00000100:00100000:0.0:1787560632.662755:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560632.662865:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853297536 00000100:00100000:2.0:1787560632.662878:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853297536 00000100:00100000:2.0:1787560632.662947:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 34 00000100:00100000:2.0:1787560632.662968:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc87ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+5:2405:x1874392853297536:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787560632.662991:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560632.663019:0:8412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004292f8e7/0x4642c20bf2f342ed lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fd16 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787560632.663059:0:8412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c02b8, blocks: 0x0 00010000:00010000:2.0:1787560632.663087:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=352s v=(0 0) 00010000:00010000:2.0:1787560632.663092:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560632.663103:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004292f8e7/0x4642c20bf2f342ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd16 expref: 6 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.663126:0:8412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004292f8e7/0x4642c20bf2f342ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd16 expref: 6 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.663142:0:8412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2169400, rc 0) 00000100:00100000:2.0:1787560632.663217:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc87ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:2405:x1874392853297536:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 259us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560632.663224:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 34 00000100:00100000:0.0:1787560632.668288:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560632.669354:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853297792 00000100:00100000:2.0:1787560632.669370:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853297792 00000100:00100000:2.0:1787560632.671053:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 89 00000100:00100000:2.0:1787560632.671080:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc87ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+66:11289:x1874392853297792:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787560632.671239:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc87ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+66:11289:x1874392853297792:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 170us (2966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560632.671249:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 89 00000100:00100000:0.0:1787560632.676406:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560632.676712:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853297920 00000100:00100000:3.0:1787560632.676726:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853297920 00000100:00100000:3.0:1787560632.676802:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 35 00000100:00100000:3.0:1787560632.676815:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+6:11289:x1874392853297920:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787560632.676837:0:8415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560632.676864:0:8415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d551c91d/0x4642c20bf2f342f4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fd1d expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.676913:0:8415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004292f8e7/0x4642c20bf2f342ed lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd16 expref: 7 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.676925:0:8415:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560632.677489:0:8415:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560632.677572:0:8415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d551c91d/0x4642c20bf2f342f4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd1d expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.677621:0:8415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004292f8e7/0x4642c20bf2f342ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd16 expref: 7 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.677639:0:8415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004292f8e7/0x4642c20bf2f342ed lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd16 expref: 7 pid: 8412 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560632.677658:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3ae1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8415:1874392862815360:192.168.203.29@tcp:104: 00000100:00100000:3.0:1787560632.677795:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560632.681381:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3ae1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8415:1874392862815360:192.168.203.29@tcp:104: 00010000:00010000:3.0:1787560632.681684:0:8415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d551c91d/0x4642c20bf2f342f4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd1d expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.681715:0:8415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafc0030200, rc 0) 00000100:00100000:0.0:1787560632.682759:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560632.682845:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853298048 00000100:00100000:3.0:1787560632.682856:0:9502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853298048 00010000:00010000:3.0:1787560632.682902:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004292f8e7/0x4642c20bf2f342ed lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd16 expref: 8 pid: 8412 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560632.682954:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 59 00000100:00100000:3.0:1787560632.682974:0:9502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+8:2404:x1874392853298048:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560632.682994:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560632.683024:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004292f8e7/0x4642c20bf2f342ed lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd16 expref: 8 pid: 8412 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.683041:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004292f8e7/0x4642c20bf2f342ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd16 expref: 8 pid: 8412 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.683073:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004292f8e7/0x4642c20bf2f342ed lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd16 expref: 8 pid: 8412 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.683089:0:9502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560632.683093:0:9502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560632.683122:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d551c91d/0x4642c20bf2f342f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd1d expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.683133:0:9502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d551c91d/0x4642c20bf2f342f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd1d expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.683177:0:9502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d551c91d/0x4642c20bf2f342f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd1d expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560632.683194:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3ae1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9502:1874392862815488:192.168.203.29@tcp:105: 00000100:00100000:3.0:1787560632.683288:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560632.683476:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+7:11289:x1874392853297920:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 6661us (7084us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560632.683485:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 35 00000100:00100000:0.0:1787560632.697578:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560632.697732:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3ae1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9502:1874392862815488:192.168.203.29@tcp:105: 00010000:00010000:3.0:1787560632.697756:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560632.697833:0:9502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+6:2404:x1874392853298048:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 14860us (15081us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560632.697847:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 59 00000100:00100000:2.0:1787560632.700602:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853298176 00000100:00100000:2.0:1787560632.700628:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853298176 00002000:00100000:2.0:1787560632.700693:0:8420:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9caec3af2a00 x1874392853298176/t0(0) o4->9331bacf-6cfc-4379-8649-925e79b19df1@192.168.203.29@tcp:748/0 lens 504/0 e 0 to 0 dl 1787560643 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787560632.700705:0:8420:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9caec3af2a00 with x1874392853298176 ext(0->8) 00002000:00010000:2.0:1787560632.700712:0:8420:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9caec3af2a00 00000100:00100000:2.0:1787560632.700760:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:2.0:1787560632.700781:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9331bacf-6cfc-4379-8649-925e79b19df1+6:2405:x1874392853298176:12345-192.168.203.29@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787560632.703685:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9331bacf-6cfc-4379-8649-925e79b19df1+8:2405:x1874392853298176:12345-192.168.203.29@tcp:4:lhsmtool_posix.0 Request processed in 2896us (6112us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787560632.703700:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 0 00002000:00100000:2.0:1787560632.703710:0:8420:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9caec3af2a00 x1874392853298176/t4294967303(0) o4->9331bacf-6cfc-4379-8649-925e79b19df1@192.168.203.29@tcp:748/0 lens 504/448 e 0 to 0 dl 1787560643 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787560632.703720:0:8420:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9caec3af2a00 with x1874392853298176 ext(0->8) 00002000:00010000:2.0:1787560632.703727:0:8420:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9caec3af2a00 00000100:00100000:3.0:1787560632.706312:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560632.706886:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853298304 00000100:00100000:1.0:1787560632.706901:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853298304 00000100:00100000:1.0:1787560632.707084:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 90 00000100:00100000:1.0:1787560632.707100:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3ae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+66:11289:x1874392853298304:12345-192.168.203.29@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787560632.721789:0:6478:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00010000:00010000:0.0:1787560632.722004:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f3400e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.722027:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f3400e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.722036:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f3400e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.722041:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168e00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560632.722047:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f3400e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.722056:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f3400e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.722080:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9cafda3d1700) 00010000:00010000:0.0:1787560632.722083:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560632.722089:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f3400e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.722095:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f3400e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.722118:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34015 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.722124:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34015 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.722149:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34015 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.722154:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169000 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560632.722157:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34015 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.722164:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34015 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.722172:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:0.0:1787560632.722175:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560632.722177:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34015 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.722183:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34015 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.722202:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f34054 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.722208:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f34054 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.722213:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f34054 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.722217:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbffe00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560632.722220:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f34054 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787560632.723171:0:6478:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:2.0:1787560632.723252:0:6478:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1787560632.723268:0:6478:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9caec21fb840 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1787560632.723274:0:6478:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9caec1082300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9caec21fb0c0 00000020:00080000:2.0:1787560632.723277:0:6478:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9caec1082700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cafc12e7e00 00010000:00010000:0.0:1787560632.723358:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f34054 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.723374:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9caec3203200) 00010000:00010000:0.0:1787560632.723377:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560632.723381:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f34054 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.723387:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f34054 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.723411:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f3415e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.723418:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f3415e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.723424:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f3415e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.723443:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560632.723448:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f3415e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.723453:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f3415e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.723460:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:0.0:1787560632.723462:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560632.723465:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f3415e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.723483:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f3415e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.723495:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f34181 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.723501:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f34181 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560632.723505:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3ae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+17:11289:x1874392853298304:12345-192.168.203.29@tcp:44:lhsmtool_posix.0 Request processed in 16405us (17202us total) trans 0 rc 0/0 00010000:00010000:0.0:1787560632.723507:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f34181 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.723513:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7c00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560632.723515:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f34181 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560632.723517:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 90 00010000:00010000:0.0:1787560632.723520:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f34181 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.723528:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:0.0:1787560632.723530:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560632.723533:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f34181 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.723538:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f34181 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.723546:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f341c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.723553:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f341c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.723563:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f341c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.723567:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168a00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560632.723570:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f341c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.723592:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f341c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.723600:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:0.0:1787560632.723602:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560632.723605:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f341c7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.723610:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f341c7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.723622:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f342ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.723628:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f342ca lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.723633:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f342ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.723638:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560632.723641:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f342ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.723655:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f342ca lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.723663:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cafe1537400) 00010000:00010000:0.0:1787560632.723666:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787560632.723668:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f342ca lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.723673:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f342ca lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787560632.723789:0:6530:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1787560632.724030:0:6530:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1787560632.724716:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787560632.724737:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862815616:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787560632.725295:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560632.725359:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787560632.725370:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862815744:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787560632.725402:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560632.725457:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862815616 00000100:00100000:2.0:1787560632.725465:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862815616 00000100:00100000:2.0:1787560632.725700:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862815744 00000100:00100000:2.0:1787560632.725704:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862815744 00000100:00100000:2.0:1787560632.725731:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787560632.725741:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862815616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787560632.726225:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00002000:00010000:2.0:1787560632.726226:0:8412:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787560632.726230:0:8412:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787560632 00002000:00010000:2.0:1787560632.726233:0:8412:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787560632.726235:0:8412:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1787560632 -> 1787560632 00002000:00010000:2.0:1787560632.726238:0:8412:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1787560632.726247:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3626:x1874392862815744:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787560632.726268:0:10171:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00000100:00100000:2.0:1787560632.726296:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3623:x1874392862815616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 556us (1004us total) trans 4294967304 rc 0/0 00002000:00010000:1.0:1787560632.726301:0:10171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a8c02b6, atime: 0x6a8c02b6, ctime: 0x6a8c02b6, blocks: 0x8 00000100:00100000:2.0:1787560632.726303:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1787560632.726309:0:10171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085e02259/0x4642c20bf2f342fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560632.726328:0:10171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=352s v=(0 0) 00000100:00080000:2.0:1787560632.726329:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787560632.726333:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787560632.726333:0:10171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560632.726341:0:10171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085e02259/0x4642c20bf2f342fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560632.726359:0:10171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085e02259/0x4642c20bf2f342fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560632.726369:0:10171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085e02259/0x4642c20bf2f342fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787560632.726376:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9caffcb09500/2, rc 0, transno 4294967304 00010000:00010000:1.0:1787560632.726376:0:10171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085e02259/0x4642c20bf2f342fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560632.726382:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862815616:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1787560632.726409:0:10171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787560632.726454:0:6487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560632.726462:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085e02259/0x4642c20bf2f342fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.726470:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbff000 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:2.0:1787560632.726482:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085e02259/0x4642c20bf2f342fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.726491:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085e02259/0x4642c20bf2f342fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.726510:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085e02259/0x4642c20bf2f342fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.726518:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085e02259/0x4642c20bf2f342fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.726539:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560632.726541:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560632.726542:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560632.726555:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3626:x1874392862815744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 312us (1152us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787560632.726562:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:2.0:1787560632.726564:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9caec33c4700/2, rc 0, transno 4294967302 00000100:00100000:2.0:1787560632.726569:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862815744:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787560632.727592:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560632.727681:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853298432 00000100:00100000:0.0:1787560632.727689:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853298432 00000100:00100000:0.0:1787560632.727771:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 38 00000100:00100000:0.0:1787560632.727782:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+8:2405:x1874392853298432:12345-192.168.203.29@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787560632.729701:0:9491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1787560632.729716:0:9491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:0.0:1787560632.730058:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:2405:x1874392853298432:12345-192.168.203.29@tcp:16:lhsmtool_posix.0 Request processed in 2270us (2466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560632.730070:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 38 00000100:00100000:1.0:1787560632.738001:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560632.738125:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853298688 00000100:00100000:3.0:1787560632.738138:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853298688 00000100:00100000:3.0:1787560632.738205:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 91 00000100:00100000:3.0:1787560632.738214:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+14:11289:x1874392853298688:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787560632.738276:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560632.738305:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f342e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd0f expref: 14 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.738324:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cafe1537400) 00010000:00010000:3.0:1787560632.738337:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787560632.738372:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34302 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.738386:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34302 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.738395:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34302 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787560632.738579:0:6500:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b1e0f21 reply state 00000000f96c387d transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34302 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.738589:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34302 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.738594:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cafe1537400) 00010000:00010000:3.0:1787560632.738596:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787560632.738598:0:6500:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787560632.738713:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+15:11289:x1874392853298688:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 500us (727us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1787560632.738719:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 91 00000100:00100000:1.0:1787560632.747854:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560632.752066:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853298816 00000100:00100000:0.0:1787560632.752087:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853298816 00000100:00100000:0.0:1787560632.752170:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 39 00000100:00100000:0.0:1787560632.752182:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+6:2404:x1874392853298816:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787560632.752392:0:10171:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787560632.752396:0:10171:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1787560632 -> 1787560631 00002000:00010000:0.0:1787560632.752398:0:10171:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787560630 00002000:00010000:0.0:1787560632.752409:0:10171:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1787560632 -> 1787560631 00002000:00010000:0.0:1787560632.752412:0:10171:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787560632.752535:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+7:2404:x1874392853298816:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 Request processed in 353us (4689us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787560632.752543:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 39 00000100:00100000:0.0:1787560632.754773:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560632.755015:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853299072 00000100:00100000:2.0:1787560632.755027:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853299072 00000100:00100000:2.0:1787560632.760403:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 92 00000100:00100000:2.0:1787560632.760425:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+15:11289:x1874392853299072:12345-192.168.203.29@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787560632.760539:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34309 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.760560:0:13787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f342c3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd01 expref: 15 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.760595:0:13787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34309 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.760644:0:13787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f342c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd01 expref: 15 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.760659:0:13787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f342c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd01 expref: 15 pid: 6500 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560632.760676:0:13787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc52c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13787:1874392862815872:192.168.203.29@tcp:104: 00000100:00100000:2.0:1787560632.760791:0:13787:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd8640840 going to sleep for 11 seconds 00000100:00100000:1.0:1787560632.767175:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560632.767374:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853299200 00000100:00100000:3.0:1787560632.767389:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853299200 00010000:00010000:3.0:1787560632.767483:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f342c3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd01 expref: 16 pid: 6500 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560632.767531:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 60 00000100:00100000:3.0:1787560632.767544:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+16:2404:x1874392853299200:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560632.767563:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560632.767588:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f342c3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd01 expref: 16 pid: 6500 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.767605:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f342c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd01 expref: 16 pid: 6500 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.767633:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cafe1537400) 00010000:00010000:3.0:1787560632.767640:0:6486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34309 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.767652:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34309 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.767661:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34309 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.767684:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560632.767756:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+16:2404:x1874392853299200:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 215us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560632.767765:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 60 00010000:00010000:2.0:1787560632.769150:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f342c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd01 expref: 15 pid: 6500 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560632.769178:0:13787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc52c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13787:1874392862815872:192.168.203.29@tcp:104: 00010000:00010000:2.0:1787560632.769218:0:13787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34309 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.769229:0:13787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34309 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.769248:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34309 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.769299:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34309 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.769307:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34309 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.769330:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34309 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.769337:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168a00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560632.769342:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34309 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.769351:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34309 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.769367:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cafe1537400) 00010000:00010000:2.0:1787560632.769370:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787560632.769375:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34309 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.769381:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34309 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560632.769484:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+14:11289:x1874392853299072:12345-192.168.203.29@tcp:55:lhsmtool_posix.0 Request processed in 9066us (14722us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787560632.769494:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 92 00000100:00100000:1.0:1787560632.776733:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560632.776867:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853299328 00000100:00100000:2.0:1787560632.776881:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853299328 00000100:00100000:2.0:1787560632.777027:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 40 00000100:00100000:2.0:1787560632.777042:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+7:2404:x1874392853299328:12345-192.168.203.29@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787560632.777103:0:8415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f05c3dc8/0x4642c20bf2f34310 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.777130:0:8415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d551c91d/0x4642c20bf2f342f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd1d expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.777159:0:8415:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560632.777164:0:8415:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787560632.777169:0:8415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f05c3dc8/0x4642c20bf2f34310 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.777216:0:8415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d551c91d/0x4642c20bf2f342f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd1d expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.777245:0:8415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d551c91d/0x4642c20bf2f342f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd1d expref: 7 pid: 8415 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560632.777263:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc52c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8415:1874392862816000:192.168.203.29@tcp:104: 00000100:00100000:2.0:1787560632.777372:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd8640840 going to sleep for 11 seconds 00000100:00100000:2.0:1787560632.780821:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc52c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8415:1874392862816000:192.168.203.29@tcp:104: 00010000:00010000:2.0:1787560632.780878:0:8415:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f05c3dc8/0x4642c20bf2f34310 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560632.780912:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560632.781153:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853299456 00000100:00100000:2.0:1787560632.781162:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853299456 00010000:00010000:2.0:1787560632.781206:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d551c91d/0x4642c20bf2f342f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd1d expref: 8 pid: 8415 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560632.781255:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 61 00000100:00100000:2.0:1787560632.781266:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+8:2404:x1874392853299456:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560632.781305:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560632.781333:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d551c91d/0x4642c20bf2f342f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd1d expref: 8 pid: 8415 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.781348:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d551c91d/0x4642c20bf2f342f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd1d expref: 8 pid: 8415 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.781377:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d551c91d/0x4642c20bf2f342f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd1d expref: 8 pid: 8415 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.781397:0:6485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787560632.781402:0:6485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787560632.781408:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f05c3dc8/0x4642c20bf2f34310 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.781419:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f05c3dc8/0x4642c20bf2f34310 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.781477:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560632.781544:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+7:2404:x1874392853299456:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 278us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560632.781551:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 61 00010000:00010000:1.0:1787560632.781906:0:8415:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f05c3dc8/0x4642c20bf2f34310 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560632.781916:0:8415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f05c3dc8/0x4642c20bf2f34310 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560632.781936:0:8415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f05c3dc8/0x4642c20bf2f34310 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560632.781942:0:8415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f05c3dc8/0x4642c20bf2f34310 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560632.781948:0:8415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f05c3dc8/0x4642c20bf2f34310 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560632.781977:0:8415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169000 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560632.781983:0:8415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f05c3dc8/0x4642c20bf2f34310 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560632.781992:0:8415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f05c3dc8/0x4642c20bf2f34310 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560632.782006:0:8415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f05c3dc8/0x4642c20bf2f34310 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560632.782015:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f05c3dc8/0x4642c20bf2f34310 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560632.782094:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+6:2404:x1874392853299328:12345-192.168.203.29@tcp:1:lhsmtool_posix.0 Request processed in 5056us (5377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560632.782102:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 40 00000100:00100000:3.0:1787560632.785403:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560632.787785:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853299712 00000100:00100000:2.0:1787560632.787807:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853299712 00000100:00100000:2.0:1787560632.787914:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 93 00000100:00100000:2.0:1787560632.787927:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+14:11289:x1874392853299712:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787560632.788076:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34317 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.788098:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f34157 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fca6 expref: 14 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.788110:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34317 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.788159:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f34157 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fca6 expref: 14 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.788176:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f34157 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fca6 expref: 14 pid: 10172 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560632.788193:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc52c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6499:1874392862816128:192.168.203.29@tcp:104: 00000100:00100000:2.0:1787560632.788315:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd8640840 going to sleep for 11 seconds 00000100:00100000:3.0:1787560632.790906:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560632.790996:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853299840 00000100:00100000:0.0:1787560632.791008:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853299840 00010000:00010000:0.0:1787560632.791059:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f34157 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fca6 expref: 15 pid: 10172 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560632.791101:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 62 00000100:00100000:0.0:1787560632.791112:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd7cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+15:2404:x1874392853299840:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787560632.791129:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560632.791136:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f34157 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fca6 expref: 15 pid: 10172 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.791150:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f34157 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fca6 expref: 15 pid: 10172 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.791178:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:0.0:1787560632.791184:0:6486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34317 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.791195:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34317 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.791203:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34317 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.791255:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560632.791327:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd7cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+15:2404:x1874392853299840:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 216us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560632.791335:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 62 00010000:00010000:2.0:1787560632.791730:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f34157 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fca6 expref: 14 pid: 10172 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560632.791750:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc52c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6499:1874392862816128:192.168.203.29@tcp:104: 00010000:00010000:2.0:1787560632.791784:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34317 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.791793:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34317 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.791799:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34317 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.792054:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3431e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.792068:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f342d1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd08 expref: 14 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.792078:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3431e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.792116:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f342d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd08 expref: 14 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.792132:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f342d1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd08 expref: 14 pid: 13787 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560632.792149:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc52c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6499:1874392862816256:192.168.203.29@tcp:104: 00000100:00100000:2.0:1787560632.792218:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd86403c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560632.795575:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc52c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6499:1874392862816256:192.168.203.29@tcp:104: 00010000:00010000:2.0:1787560632.795626:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3431e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560632.795862:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560632.796245:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853299968 00000100:00100000:2.0:1787560632.796255:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853299968 00010000:00010000:2.0:1787560632.796305:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f342d1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd08 expref: 15 pid: 13787 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560632.796347:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 63 00000100:00100000:2.0:1787560632.796358:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+15:2404:x1874392853299968:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560632.796389:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560632.796397:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f342d1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd08 expref: 15 pid: 13787 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.796412:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f342d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd08 expref: 15 pid: 13787 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.796458:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f342d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd08 expref: 15 pid: 13787 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.796478:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cafe1537400) 00010000:00010000:2.0:1787560632.796483:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3431e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.796493:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3431e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.796502:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3431e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.796539:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787560632.796576:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3431e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560632.796587:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3431e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560632.796611:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+14:2404:x1874392853299968:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 253us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560632.796620:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 63 00000001:00080000:1.0:1787560632.796732:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:1.0:1787560632.796892:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:1.0:1787560632.796936:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:1.0:1787560632.797040:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6499:1874392862816384:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787560632.797112:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560632.797157:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc7ed4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787560632.797806:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862816384 00000100:00100000:3.0:1787560632.797823:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862816384 00000100:00100000:3.0:1787560632.797881:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787560632.797898:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6499:x1874392862816384:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787560632.798036:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6499:x1874392862816384:12345-0@lo:1000:mdt00_001.0 Request processed in 139us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560632.798059:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787560632.798159:0:6499:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1787560632.798166:0:6499:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9caffcb09500, transno 4294967304 00000100:00100000:1.0:1787560632.798194:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6499:1874392862816384:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1787560632.798357:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:1.0:1787560632.798420:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6499:1874392862816512:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787560632.798509:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560632.798540:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c4bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787560632.798593:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862816512 00000100:00100000:3.0:1787560632.798599:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862816512 00000100:00100000:3.0:1787560632.798636:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787560632.798644:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6499:x1874392862816512:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787560632.798788:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6499:x1874392862816512:12345-0@lo:1000:mdt00_001.0 Request processed in 145us (279us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787560632.798796:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787560632.798915:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6499:1874392862816512:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787560632.798957:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3431e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.798978:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3431e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.798996:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3431e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.799003:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169400 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560632.799008:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3431e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.799016:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3431e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.799036:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cafe1537400) 00010000:00010000:2.0:1787560632.799040:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787560632.799045:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3431e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.799052:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3431e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.799088:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f3424c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.799096:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f3424c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.799101:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f3424c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.799106:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560632.799109:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f3424c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.799123:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f3424c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.799133:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:2.0:1787560632.799135:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787560632.799138:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f3424c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.799144:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f3424c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.799195:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34325 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.799209:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34268 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcec expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.799219:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34325 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.799264:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34268 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcec expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.799280:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34268 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcec expref: 17 pid: 6500 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560632.799291:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc52c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6499:1874392862816640:192.168.203.29@tcp:104: 00000100:00100000:2.0:1787560632.799369:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd8640180 going to sleep for 11 seconds 00000100:00100000:2.0:1787560632.802077:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc52c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6499:1874392862816640:192.168.203.29@tcp:104: 00010000:00010000:2.0:1787560632.802146:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34325 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560632.803547:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560632.803815:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853300096 00000100:00100000:3.0:1787560632.803827:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853300096 00010000:00010000:3.0:1787560632.803882:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34268 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcec expref: 18 pid: 6500 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560632.803985:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 64 00000100:00100000:3.0:1787560632.803998:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+18:2405:x1874392853300096:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560632.804018:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560632.804026:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34268 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcec expref: 18 pid: 6500 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.804042:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34268 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcec expref: 18 pid: 6500 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.804069:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34268 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fcec expref: 18 pid: 6500 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.804089:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:3.0:1787560632.804111:0:6486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34325 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.804122:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34325 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.804130:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34325 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.804168:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560632.804242:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+17:2405:x1874392853300096:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 247us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560632.804250:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 64 00010000:00010000:2.0:1787560632.804571:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34325 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.804582:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34325 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.804599:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34325 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.804606:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34325 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.804614:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34325 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.804621:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168a00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560632.804628:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34325 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.804637:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34325 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.804649:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:2.0:1787560632.804652:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560632.804657:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34325 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.804663:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34325 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.804693:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34317 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.804700:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34317 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.804706:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34317 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.804711:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169a00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560632.804715:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34317 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.804722:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34317 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.804730:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafe1537a00) 00010000:00010000:2.0:1787560632.804733:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787560632.804735:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34317 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560632.804740:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34317 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560632.804946:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+16:11289:x1874392853299712:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 17020us (19558us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1787560632.804969:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 93 00000020:00080000:2.0:1787560632.804975:0:6499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787560632.805165:0:13775:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787560632.805171:0:13775:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787560632.805190:0:13775:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787560632.805198:0:13775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787560632.809697:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560632.809780:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853300352 00000100:00100000:3.0:1787560632.809796:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853300352 00000100:00100000:3.0:1787560632.809879:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:3.0:1787560632.810003:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+16:11289:x1874392853300352:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787560632.810402:0:6501:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787560632.810629:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1787560632.810676:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177400/0x4642c20bf2f3432c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.810697:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177400/0x4642c20bf2f3432c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.810712:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177400/0x4642c20bf2f3432c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.810722:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177400/0x4642c20bf2f3432c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.810741:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177400/0x4642c20bf2f3432c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.810748:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177400/0x4642c20bf2f3432c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560632.810765:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787560632.811002:0:9501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560632.811010:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177400/0x4642c20bf2f3432c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.811019:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb002177400 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560632.811024:0:9501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177400/0x4642c20bf2f3432c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.811034:0:9501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177400/0x4642c20bf2f3432c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.811050:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cafe1537400) 00010000:00010000:0.0:1787560632.811053:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787560632.811059:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177400/0x4642c20bf2f3432c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.811066:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177400/0x4642c20bf2f3432c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560632.811083:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560632.811092:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560632.811094:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560632.811127:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+18:11289:x1874392853300352:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 1000us (1207us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1787560632.811138:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 20 00000020:00080000:3.0:1787560632.811145:0:6501:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787560632.885584:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787560632.885615:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3af3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862816768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787560632.885705:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560632.885808:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862816768 00000100:00100000:0.0:1787560632.885818:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862816768 00000100:00100000:0.0:1787560632.885885:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787560632.885897:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3625:x1874392862816768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787560632.885936:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787560632.885996:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3625:x1874392862816768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560632.886004:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787560632.886062:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3af3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862816768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560632.886471:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862816896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787560632.886512:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560632.886631:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862816896 00000100:00100000:1.0:1787560632.886636:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862816896 00000100:00100000:1.0:1787560632.886686:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787560632.886694:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862816896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787560632.886708:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787560632.886748:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862816896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560632.886754:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787560632.886805:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862816896:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787560632.887573:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787560633.331828:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787560633.417232:0:14189:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787560633.417248:0:14189:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787560633.417409:0:14189:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787560633.417417:0:14189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787560633.501194:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560633.501289:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853300608 00000100:00100000:2.0:1787560633.501303:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853300608 00000100:00100000:2.0:1787560633.501384:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 94 00000100:00100000:2.0:1787560633.501398:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+18:11308:x1874392853300608:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1787560633.501453:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560633.501481:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34333 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fd24 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.501636:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f3433a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.501656:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f3433a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.501671:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f3433a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560633.501686:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787560633.501824:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34333 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd24 expref: 21 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.501844:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f3433a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd24 expref: 20 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.501854:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:2.0:1787560633.501857:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787560633.501861:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2168600, rc 0) 00000100:00100000:2.0:1787560633.501948:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+20:11308:x1874392853300608:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 553us (770us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1787560633.501988:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 94 00000100:00100000:0.0:1787560633.506090:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560633.506260:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853300736 00000100:00100000:2.0:1787560633.506274:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853300736 00000100:00100000:2.0:1787560633.506362:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 95 00000100:00100000:2.0:1787560633.506375:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+20:11308:x1874392853300736:12345-192.168.203.29@tcp:34:lfs.0 00010000:00010000:2.0:1787560633.506529:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34348 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.506554:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34348 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.506569:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34348 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.506588:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f3434f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.506595:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f3434f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.506602:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f3434f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.508855:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f34356 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.508894:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f34356 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.508908:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f34356 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787560633.509013:0:13787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f34356 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.509033:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34348 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.509041:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34348 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.509152:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34348 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.509158:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169400 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560633.509164:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34348 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.509172:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34348 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.509188:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:2.0:1787560633.509191:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560633.509196:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34348 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.509202:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34348 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.509219:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f3434f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.509226:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f3434f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.509238:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f3434f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.509255:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169e00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560633.509259:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f3434f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.509266:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f3434f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.509275:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9cafef7ce200) 00010000:00010000:2.0:1787560633.509278:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560633.509281:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f3434f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.509286:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f3434f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.509311:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f34356 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.509318:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f34356 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.509323:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f34356 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.509329:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560633.509331:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f34356 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.509348:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f34356 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.509357:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafef7ced00) 00010000:00010000:2.0:1787560633.509359:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560633.509362:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f34356 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.509368:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f34356 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560633.509527:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+20:11308:x1874392853300736:12345-192.168.203.29@tcp:34:lfs.0 Request processed in 3147us (3444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560633.509538:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 95 00000100:00100000:1.0:1787560633.573382:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560633.573521:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853300992 00000100:00100000:2.0:1787560633.573537:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853300992 00000100:00100000:2.0:1787560633.573621:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 96 00000100:00100000:2.0:1787560633.573636:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+20:11311:x1874392853300992:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1787560633.573673:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560633.573705:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f3435d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fd2b expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.573805:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f34364 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.573883:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f34364 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.573897:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f34364 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.573945:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3436b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.573965:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3436b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.573974:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3436b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.574125:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34372 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.574136:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34372 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.574145:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34372 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560633.574157:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787560633.574261:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f34364 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.574269:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f34364 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.574276:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f34364 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.574283:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169e00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560633.574289:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f34364 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.574307:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f34364 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.574322:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:2.0:1787560633.574325:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560633.574331:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f34364 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.574338:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f34364 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.574352:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3436b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.574359:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3436b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.574365:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3436b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.574371:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169400 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560633.574374:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3436b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.574381:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3436b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.574388:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9cafef7ced00) 00010000:00010000:2.0:1787560633.574391:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560633.574393:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3436b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.574409:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3436b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.574491:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f3435d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd2b expref: 23 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.574507:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34372 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd2b expref: 22 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.574516:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafef7ce200) 00010000:00010000:2.0:1787560633.574519:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787560633.574522:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2168a00, rc 0) 00000100:00100000:2.0:1787560633.574592:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+22:11311:x1874392853300992:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 960us (1226us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1787560633.574598:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 96 00000100:00100000:3.0:1787560633.596377:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560633.596812:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853301120 00000100:00100000:3.0:1787560633.596827:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853301120 00000100:00100000:3.0:1787560633.596896:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 97 00000100:00100000:3.0:1787560633.596910:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+22:11311:x1874392853301120:12345-192.168.203.29@tcp:54:lfs.0 00010000:00010000:3.0:1787560633.597028:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f34380 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.597051:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f34380 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.597066:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f34380 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.597129:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f34380 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.597138:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f34380 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.597146:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f34380 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.597154:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb002176600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560633.597159:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f34380 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.597168:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f34380 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.597184:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafef7ce200) 00010000:00010000:3.0:1787560633.597188:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787560633.597194:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f34380 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.597201:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f34380 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560633.597530:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+22:11311:x1874392853301120:12345-192.168.203.29@tcp:54:lfs.0 Request processed in 622us (6688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560633.597540:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 97 00000100:00100000:3.0:1787560633.602267:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560633.602527:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853301376 00000100:00100000:0.0:1787560633.602540:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853301376 00000100:00100000:0.0:1787560633.602609:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:0.0:1787560633.602623:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd7c06050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+22:11311:x1874392853301376:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:0.0:1787560633.603267:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd7c06050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+23:11311:x1874392853301376:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 644us (1011us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1787560633.603277:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:3.0:1787560633.651421:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560633.651576:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853301632 00000100:00100000:2.0:1787560633.651591:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853301632 00000100:00100000:2.0:1787560633.651737:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 98 00000100:00100000:2.0:1787560633.651752:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+23:10836:x1874392853301632:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:2.0:1787560633.651800:0:13787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560633.651826:0:13787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f34387 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fd32 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.651992:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3438e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.652009:0:13787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34372 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd2b expref: 24 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.652037:0:13787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3438e lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.652077:0:13787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34372 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd2b expref: 24 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.652093:0:13787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34372 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd2b expref: 24 pid: 6499 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560633.652111:0:13787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc52c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13787:1874392862817024:192.168.203.29@tcp:104: 00000100:00100000:2.0:1787560633.652232:0:13787:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd8640c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787560633.656377:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560633.657261:0:13787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc52c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13787:1874392862817024:192.168.203.29@tcp:104: 00010000:00010000:2.0:1787560633.657313:0:13787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3438e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560633.657336:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853301760 00000100:00100000:1.0:1787560633.657347:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853301760 00010000:00010000:1.0:1787560633.657403:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34372 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd2b expref: 25 pid: 6499 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560633.657516:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 65 00000100:00100000:1.0:1787560633.657528:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+25:2405:x1874392853301760:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560633.657565:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560633.657585:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34372 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd2b expref: 25 pid: 6499 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560633.657599:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34372 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd2b expref: 25 pid: 6499 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560633.657624:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34372 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd2b expref: 25 pid: 6499 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560633.657642:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafef7ce200) 00010000:00010000:1.0:1787560633.657646:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3438e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560633.657656:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3438e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560633.657663:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3438e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560633.657692:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787560633.657750:0:13787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3438e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560633.657757:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+24:2405:x1874392853301760:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 229us (1392us total) trans 0 rc 0/0 00010000:00010000:2.0:1787560633.657766:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3438e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560633.657771:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 65 00000004:00200000:2.0:1787560633.657797:0:13787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787560633.657977:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f34387 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd32 expref: 25 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.657995:0:13787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3438e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd32 expref: 24 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.658015:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafef7ce200) 00010000:00010000:2.0:1787560633.658019:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787560633.658021:0:13787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2169400, rc 0) 00000100:00100000:2.0:1787560633.658187:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+24:10836:x1874392853301632:12345-192.168.203.29@tcp:101:bash.0 Request processed in 6438us (6797us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1787560633.658195:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 98 00000100:00100000:3.0:1787560633.665174:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560633.665300:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853301888 00000100:00100000:2.0:1787560633.665315:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853301888 00000100:00100000:2.0:1787560633.665392:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 99 00000100:00100000:2.0:1787560633.665405:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3ae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+24:10836:x1874392853301888:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:2.0:1787560633.665476:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560633.665504:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f3439c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fd39 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.665552:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f343a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.665568:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f343a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.665583:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f343a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.665741:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f3439c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd39 expref: 26 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.665775:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f343a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd39 expref: 25 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.665795:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafef7ce200) 00010000:00010000:2.0:1787560633.665799:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787560633.665803:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2169e00, rc 0) 00000100:00100000:2.0:1787560633.665978:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3ae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+25:10836:x1874392853301888:12345-192.168.203.29@tcp:101:bash.0 Request processed in 575us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560633.665987:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 99 00000100:00100000:0.0:1787560633.671105:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560633.671207:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853302144 00000100:00100000:3.0:1787560633.671220:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853302144 00000100:00100000:3.0:1787560633.671356:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 100 00000100:00100000:3.0:1787560633.671369:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+25:10836:x1874392853302144:12345-192.168.203.29@tcp:36:bash.0 00010000:00010000:3.0:1787560633.671756:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f343aa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.671776:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f343aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.671788:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f343aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787560633.671838:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:3.0:1787560633.671868:0:6500:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0034fa1 reply state 0000000029d1c464 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f343aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.671886:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f343aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.671894:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafef7ce200) 00010000:00010000:3.0:1787560633.671897:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787560633.671902:0:6500:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787560633.671944:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:3.0:1787560633.672092:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+29:10836:x1874392853302144:12345-192.168.203.29@tcp:36:bash.0 Request processed in 724us (1003us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1787560633.672101:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 100 00000020:00080000:3.0:1787560633.672108:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787560633.680839:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560633.684055:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853302272 00000100:00100000:2.0:1787560633.684844:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853302272 00000100:00100000:2.0:1787560633.685163:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 101 00000100:00100000:2.0:1787560633.685177:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+29:10836:x1874392853302272:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:2.0:1787560633.685394:0:13787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560633.685426:0:13787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f343b1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fd40 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.685538:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f343b1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd40 expref: 30 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.685556:0:13787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f343b1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd40 expref: 30 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.685581:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafef7ce200) 00010000:00010000:2.0:1787560633.685585:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787560633.685591:0:13787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2169200, rc 0) 00000100:00100000:2.0:1787560633.686587:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+30:10836:x1874392853302272:12345-192.168.203.29@tcp:101:bash.0 Request processed in 1404us (5756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560633.686624:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 101 00000100:00100000:2.0:1787560633.690258:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560633.690639:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853302400 00000100:00100000:0.0:1787560633.690672:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853302400 00000100:00100000:0.0:1787560633.690821:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 41 00000100:00100000:0.0:1787560633.690835:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+6:10836:x1874392853302400:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:0.0:1787560633.690861:0:8414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560633.690902:0:8414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007760b92b/0x4642c20bf2f343b8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fd47 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787560633.690944:0:8414:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a8c02b7, atime: 0x6a8c02b6, ctime: 0x6a8c02b7, blocks: 0x8 00010000:00010000:0.0:1787560633.690981:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=353s v=(0 0) 00010000:00010000:0.0:1787560633.690987:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560633.690997:0:8414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007760b92b/0x4642c20bf2f343b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd47 expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.691020:0:8414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007760b92b/0x4642c20bf2f343b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd47 expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.691034:0:8414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881800, rc 0) 00000100:00100000:0.0:1787560633.691114:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+7:10836:x1874392853302400:12345-192.168.203.29@tcp:101:bash.0 Request processed in 281us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560633.691121:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 41 00000100:00100000:0.0:1787560633.695426:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560633.695842:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853302528 00000100:00100000:2.0:1787560633.695855:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853302528 00002000:00010000:2.0:1787560633.696052:0:8418:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:2.0:1787560633.696058:0:8418:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9caec3af0a80 with x1874392853302528 ext(0->18446744073709551615) 00002000:00010000:2.0:1787560633.696073:0:8418:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9caec3af0a80. 00000100:00100000:2.0:1787560633.696174:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:2.0:1787560633.696187:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9331bacf-6cfc-4379-8649-925e79b19df1+7:2405:x1874392853302528:12345-192.168.203.29@tcp:10:bash.0 00002000:00010000:2.0:1787560633.696596:0:8418:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787560633.696600:0:8418:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1787560631 -> 1787560633 00002000:00010000:2.0:1787560633.696603:0:8418:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1787560630 -> 1787560630 00002000:00010000:2.0:1787560633.696605:0:8418:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1787560631 -> 1787560633 00002000:00010000:2.0:1787560633.696608:0:8418:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1787560633.697098:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9331bacf-6cfc-4379-8649-925e79b19df1+8:2405:x1874392853302528:12345-192.168.203.29@tcp:10:bash.0 Request processed in 909us (1683us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787560633.697110:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 1 00002000:00010000:2.0:1787560633.697115:0:8418:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:2.0:1787560633.697118:0:8418:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9caec3af0a80 with x1874392853302528 ext(0->18446744073709551615) 00002000:00010000:2.0:1787560633.697125:0:8418:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9caec3af0a80. 00000100:00100000:3.0:1787560633.772273:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560633.772540:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853302656 00000100:00100000:0.0:1787560633.772554:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853302656 00000100:00100000:0.0:1787560633.772647:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 102 00000100:00100000:0.0:1787560633.772661:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+30:11325:x1874392853302656:12345-192.168.203.29@tcp:34:lfs.0 00010000:00010000:0.0:1787560633.772762:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f343bf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.772795:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f343bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.772810:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f343bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.772844:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f343c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.772853:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f343c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.772860:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f343c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.773120:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f343cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.773132:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f343cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.773140:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f343cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787560633.773202:0:10172:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f343cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.773217:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f343bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.773287:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f343bf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.773309:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f343bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.773317:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881000 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560633.773322:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f343bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.773331:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f343bf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.773347:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:0.0:1787560633.773350:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560633.773356:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f343bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.773363:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f343bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.773378:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f343c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.773385:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f343c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.773392:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f343c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.773397:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560633.773401:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f343c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.773419:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f343c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.773504:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9caec2028200) 00010000:00010000:0.0:1787560633.773507:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560633.773511:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f343c6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.773517:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f343c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.773534:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f343cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.773540:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f343cd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.773546:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f343cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.773552:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881a00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560633.773555:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f343cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.773562:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f343cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.773570:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafef7ce200) 00010000:00010000:0.0:1787560633.773573:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560633.773577:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f343cd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.773594:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f343cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560633.773707:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+30:11325:x1874392853302656:12345-192.168.203.29@tcp:34:lfs.0 Request processed in 1045us (1447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560633.773717:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 102 00000100:00100000:3.0:1787560633.814043:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560633.814238:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853302912 00000100:00100000:0.0:1787560633.814252:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853302912 00000100:00100000:0.0:1787560633.814334:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 103 00000100:00100000:0.0:1787560633.814347:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3ae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+30:11328:x1874392853302912:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:0.0:1787560633.814375:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560633.814402:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f343d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fd4e expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.814541:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f343db lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.814559:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f343db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.814573:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f343db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.814590:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f343e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.814597:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f343e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.814626:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f343e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.814762:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f343e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.814772:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f343e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.814780:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f343e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560633.814790:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787560633.814899:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f343db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.814909:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f343db lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.814916:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f343db lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.814922:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560633.814927:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f343db lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.814935:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f343db lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.814949:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:0.0:1787560633.814964:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560633.814980:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f343db lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.814987:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f343db lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.815004:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f343e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.815011:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f343e2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.815017:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f343e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.815023:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881000 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560633.815027:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f343e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.815033:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f343e2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.815042:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9caec2028200) 00010000:00010000:0.0:1787560633.815044:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560633.815047:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f343e2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.815053:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f343e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.815102:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f343d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd4e expref: 33 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.815128:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f343e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd4e expref: 32 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.815136:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafef7ce200) 00010000:00010000:0.0:1787560633.815138:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787560633.815141:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881c00, rc 0) 00000100:00100000:0.0:1787560633.815223:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3ae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+32:11328:x1874392853302912:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 878us (1196us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1787560633.815231:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 103 00000100:00100000:3.0:1787560633.819272:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560633.819561:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853303040 00000100:00100000:2.0:1787560633.819575:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853303040 00000100:00100000:2.0:1787560633.819655:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 104 00000100:00100000:2.0:1787560633.819668:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+32:11328:x1874392853303040:12345-192.168.203.29@tcp:54:lfs.0 00010000:00010000:2.0:1787560633.819781:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f343f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.819809:0:13787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3438e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd32 expref: 32 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.820413:0:13787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f343f7 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.820517:0:13787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3438e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd32 expref: 32 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.820535:0:13787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3438e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd32 expref: 32 pid: 13787 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560633.820552:0:13787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc52c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13787:1874392862817152:192.168.203.29@tcp:104: 00000100:00100000:2.0:1787560633.820677:0:13787:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd8640b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787560633.825303:0:13787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc52c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13787:1874392862817152:192.168.203.29@tcp:104: 00010000:00010000:2.0:1787560633.825358:0:13787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f343f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560633.833939:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560633.834068:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853303296 00000100:00100000:0.0:1787560633.834082:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853303296 00000100:00100000:0.0:1787560633.834162:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:0.0:1787560633.834180:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+33:6176:x1874392853303296:12345-192.168.203.29@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787560633.834925:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+34:6176:x1874392853303296:12345-192.168.203.29@tcp:35:ldlm_bl.0 Request processed in 748us (998us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1787560633.834937:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:3.0:1787560633.837772:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560633.837968:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853303424 00000100:00100000:1.0:1787560633.837982:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853303424 00010000:00010000:1.0:1787560633.838036:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3438e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd32 expref: 34 pid: 13787 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560633.838110:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 66 00000100:00100000:1.0:1787560633.838123:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+34:2405:x1874392853303424:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560633.838144:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560633.838153:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3438e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd32 expref: 34 pid: 13787 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560633.838169:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3438e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd32 expref: 34 pid: 13787 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560633.838195:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f3438e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd32 expref: 34 pid: 13787 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560633.838216:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafef7ce200) 00010000:00010000:1.0:1787560633.838222:0:6484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f343f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560633.838243:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f343f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560633.838251:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f343f7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560633.838286:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560633.838361:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+33:2405:x1874392853303424:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 240us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560633.838370:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 66 00010000:00010000:2.0:1787560633.838692:0:13787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f343f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.838703:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f343f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.838752:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f343f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.838761:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f343f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.838779:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f343f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.838786:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560633.838791:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f343f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.838799:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f343f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.838811:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafef7ce200) 00010000:00010000:2.0:1787560633.838826:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787560633.838831:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f343f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.838838:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f343f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560633.838900:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+32:11328:x1874392853303040:12345-192.168.203.29@tcp:54:lfs.0 Request processed in 19235us (19645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560633.838910:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 104 00000100:00100000:2.0:1787560633.841837:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560633.842046:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853303680 00000100:00100000:0.0:1787560633.842059:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853303680 00000100:00100000:0.0:1787560633.842132:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:0.0:1787560633.842145:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+32:11328:x1874392853303680:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:0.0:1787560633.842478:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+33:11328:x1874392853303680:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 334us (663us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1787560633.842487:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:3.0:1787560633.908079:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787560633.908115:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc52c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862817280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787560633.908213:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560633.908479:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862817280 00000100:00100000:2.0:1787560633.908491:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862817280 00000100:00100000:2.0:1787560633.908575:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787560633.908588:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3ae1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862817280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787560633.908630:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560633.908687:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3ae1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862817280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560633.908717:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:3.0:1787560633.908787:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787560633.908833:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc52c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862817280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787560633.909391:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862817792:0@lo:400:kworker.0 00000100:00100000:0.0:1787560633.909593:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862817408:0@lo:400:kworker.0 00000100:00100000:3.0:1787560633.909594:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862817536:0@lo:400:kworker.0 00000100:00100000:3.0:1787560633.909637:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560633.909640:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560633.909779:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862817536 00000100:00100000:2.0:1787560633.909785:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862817536 00000100:00100000:2.0:1787560633.909838:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787560633.909847:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3ae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862817536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560633.915235:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862818048:0@lo:400:kworker.0 00000100:00100000:3.0:1787560633.915390:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560633.915450:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862818560:0@lo:400:kworker.0 00000100:00100000:3.0:1787560633.915471:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560633.915504:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787560633.915511:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc52c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862818944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787560633.915534:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560633.915575:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862818944 00000100:00100000:3.0:1787560633.915584:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862818944 00000100:00100000:3.0:1787560633.915636:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787560633.915645:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1874392862818944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787560633.915676:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787560633.915718:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1874392862818944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560633.915725:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787560633.915777:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc52c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862818944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787560633.915824:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862818048 00000100:00100000:3.0:1787560633.915827:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862818048 00000100:00100000:3.0:1787560633.915861:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862818560 00000100:00100000:3.0:1787560633.915863:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862818560 00000100:00100000:3.0:1787560633.915877:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787560633.915882:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862818048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560633.915915:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862818048:12345-0@lo:400:kworker.0 Request processed in 33us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560633.915922:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787560633.915932:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1787560633.915938:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862818560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560633.915973:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862818560:12345-0@lo:400:kworker.0 Request processed in 35us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560633.915978:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00080000:3.0:1787560633.915994:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560633.916010:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862818048:0@lo:400:kworker.0 00000100:00100000:3.0:1787560633.916019:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862818560:0@lo:400:kworker.0 00000100:00100000:3.0:1787560633.916060:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862817664:0@lo:400:kworker.0 00000100:00100000:3.0:1787560633.916086:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560633.916110:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862818176:0@lo:400:kworker.0 00000100:00100000:3.0:1787560633.916127:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560633.916139:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862818688:0@lo:400:kworker.0 00000100:00100000:3.0:1787560633.916155:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560633.916171:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862818176 00000100:00100000:3.0:1787560633.916174:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862818176 00000100:00100000:3.0:1787560633.916198:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862818688 00000100:00100000:3.0:1787560633.916200:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862818688 00000100:00100000:3.0:1787560633.916214:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787560633.916219:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862818176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560633.916247:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862818176:12345-0@lo:400:kworker.0 Request processed in 28us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560633.916264:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787560633.916275:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1787560633.916280:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874392862818688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560633.916304:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874392862818688:12345-0@lo:400:kworker.0 Request processed in 23us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560633.916310:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00080000:3.0:1787560633.916325:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787560633.916339:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862817920:0@lo:400:kworker.0 00010000:00080000:3.0:1787560633.916344:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec33c5180 x1874392862818176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560633.916357:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862818176:0@lo:400:kworker.0 00010000:00080000:3.0:1787560633.916368:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cafffe4c380 x1874392862818688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560633.916377:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862818688:0@lo:400:kworker.0 00000100:00100000:0.0:1787560633.916386:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560633.916418:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862817664 00000100:00100000:0.0:1787560633.916419:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862818432:0@lo:400:kworker.0 00000100:00100000:3.0:1787560633.916422:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862817664 00000100:00100000:0.0:1787560633.916473:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560633.916479:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862817920 00000100:00100000:3.0:1787560633.916482:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862817920 00000100:00100000:3.0:1787560633.916499:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787560633.916506:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862817664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560633.916509:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862818432 00000100:00100000:0.0:1787560633.916515:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862818432 00000100:00100000:3.0:1787560633.916548:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862817664:12345-0@lo:400:kworker.0 Request processed in 42us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560633.916555:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787560633.916565:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787560633.916568:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3625:x1874392862818432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560633.916582:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787560633.916590:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862817920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560633.916611:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3625:x1874392862818432:12345-0@lo:400:kworker.0 Request processed in 46us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560633.916621:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787560633.916626:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862817920:12345-0@lo:400:kworker.0 Request processed in 37us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560633.916634:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787560633.916648:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862817408 00000100:00100000:0.0:1787560633.916653:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862817408 00000100:00100000:3.0:1787560633.916660:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862817664:0@lo:400:kworker.0 00000100:00100000:0.0:1787560633.916687:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1787560633.916696:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3625:x1874392862817408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560633.916736:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3625:x1874392862817408:12345-0@lo:400:kworker.0 Request processed in 41us (7095us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560633.916743:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1787560633.916783:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862818432:0@lo:400:kworker.0 00000100:00100000:0.0:1787560633.916803:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862817408:0@lo:400:kworker.0 00000100:00100000:0.0:1787560633.916813:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862817920:0@lo:400:kworker.0 00000100:00100000:1.0:1787560633.923369:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560633.924041:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862817792 00000100:00100000:1.0:1787560633.924049:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862818304:0@lo:400:kworker.0 00000100:00100000:3.0:1787560633.924055:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862817792 00000100:00100000:1.0:1787560633.924122:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560633.924148:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787560633.924159:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862818304 00000100:00100000:3.0:1787560633.924162:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862817792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560633.924165:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862818304 00000100:00100000:1.0:1787560633.924207:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787560633.924231:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862818304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560633.924242:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862817792:12345-0@lo:400:kworker.0 Request processed in 82us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560633.924273:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862818304:12345-0@lo:400:kworker.0 Request processed in 59us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560633.924281:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787560633.924342:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862818304:0@lo:400:kworker.0 00000100:00100000:1.0:1787560633.924352:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862818816:0@lo:400:kworker.0 00000100:00100000:1.0:1787560633.924381:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560633.924476:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862817792:0@lo:400:kworker.0 00000100:00100000:3.0:1787560633.924507:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1787560633.924572:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862818816 00000100:00100000:0.0:1787560633.924578:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862818816 00000100:00100000:0.0:1787560633.924615:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787560633.924642:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3624:x1874392862818816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560633.924695:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3624:x1874392862818816:12345-0@lo:400:kworker.0 Request processed in 54us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560633.924702:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787560633.924828:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862818816:0@lo:400:kworker.0 00000100:00100000:2.0:1787560633.926106:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3ae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862817536:12345-0@lo:400:kworker.0 Request processed in 16251us (16458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560633.926121:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787560633.928539:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862817536:0@lo:400:kworker.0 00000100:00100000:0.0:1787560633.929222:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560633.930015:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853303936 00000100:00100000:3.0:1787560633.930026:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853303936 00000100:00100000:3.0:1787560633.930114:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 105 00000100:00100000:3.0:1787560633.930125:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+33:11339:x1874392853303936:12345-192.168.203.29@tcp:101:cat.0 00010000:00010000:3.0:1787560633.930157:0:10172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560633.930184:0:10172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177a00/0x4642c20bf2f343fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fd55 expref: -99 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.930383:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f34405 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.930422:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f34405 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.930472:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f34405 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.930493:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f3440c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.930502:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f3440c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.930509:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f3440c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.930655:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177400/0x4642c20bf2f34413 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.930664:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177400/0x4642c20bf2f34413 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.930671:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177400/0x4642c20bf2f34413 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560633.930681:0:10172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:3.0:1787560633.930791:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f34405 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.930800:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f34405 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.930807:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f34405 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.930819:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb002176200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560633.930826:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f34405 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.930834:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f34405 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.930849:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:3.0:1787560633.930853:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560633.930858:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f34405 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.930865:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f34405 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.930883:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f3440c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.930891:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f3440c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.930898:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f3440c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.930904:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb002177800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560633.930907:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f3440c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.930914:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f3440c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.930934:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9cafe1537800) 00010000:00010000:3.0:1787560633.930937:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560633.930940:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f3440c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.930946:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f3440c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.931013:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177a00/0x4642c20bf2f343fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd55 expref: 36 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.931028:0:10172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177400/0x4642c20bf2f34413 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd55 expref: 35 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560633.931037:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafef7ce200) 00010000:00010000:3.0:1787560633.931039:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787560633.931042:0:10172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb002177400, rc 0) 00000100:00100000:3.0:1787560633.932303:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+35:11339:x1874392853303936:12345-192.168.203.29@tcp:101:cat.0 Request processed in 2173us (3080us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1787560633.932314:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 105 00000100:00100000:1.0:1787560633.938699:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560633.938814:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853304192 00000100:00100000:0.0:1787560633.938828:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853304192 00000100:00100000:0.0:1787560633.938906:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00100000:0.0:1787560633.938919:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+35:11339:x1874392853304192:12345-192.168.203.29@tcp:35:cat.0 00000100:00100000:0.0:1787560633.939993:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+36:11339:x1874392853304192:12345-192.168.203.29@tcp:35:cat.0 Request processed in 1068us (1302us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1787560633.940006:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00100000:2.0:1787560633.974620:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560633.974727:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853304448 00000100:00100000:0.0:1787560633.974740:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853304448 00000100:00100000:0.0:1787560633.974816:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 106 00000100:00100000:0.0:1787560633.974829:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+36:11340:x1874392853304448:12345-192.168.203.29@tcp:36:rm.0 00010000:00010000:0.0:1787560633.974972:0:13787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1787560633.975006:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f343b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd40 expref: 36 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.975034:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177400/0x4642c20bf2f34413 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd55 expref: 35 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.975154:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f343e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd4e expref: 34 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.975193:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f343a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd39 expref: 33 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.975205:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafef7ce200) 00010000:00010000:0.0:1787560633.975211:0:13787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787560633.975239:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34421 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.975314:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34421 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.975326:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34421 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.975344:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34428 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.975352:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34428 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.975359:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34428 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.975525:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f3442f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.975534:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f3442f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.975541:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f3442f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787560633.975822:0:13787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1787560633.975833:0:13787:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 353315401138ns, next at 354315398380ns, rc = 0 00010000:00010000:0.0:1787560633.977124:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34436 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.977147:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34436 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.977158:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34436 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.977168:0:13787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34436 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.977176:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34436 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.977182:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34436 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.977321:0:13787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787560633.977351:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f3442f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.977358:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f3442f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.977365:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f3442f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.977371:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560633.977390:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f3442f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.977399:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f3442f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.977414:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafef7ce200) 00010000:00010000:0.0:1787560633.977418:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787560633.977423:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f3442f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.977446:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f3442f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.977470:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34421 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.977476:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34421 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.977481:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34421 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.977487:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881000 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560633.977489:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34421 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.977496:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34421 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.977504:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:0.0:1787560633.977507:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560633.977519:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34421 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.977526:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34421 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787560633.977537:0:13787:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082c221ad reply state 0000000013165e5d transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34428 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.977550:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34428 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560633.977557:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9caec2028200) 00010000:00010000:0.0:1787560633.977559:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787560633.977563:0:13787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787560633.977681:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+34:11340:x1874392853304448:12345-192.168.203.29@tcp:36:rm.0 Request processed in 2849us (3071us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1787560633.977691:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 106 00010000:00010000:2.0:1787560633.986096:0:9500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560633.986119:0:9500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34436 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.986133:0:9500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881a00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:2.0:1787560633.986138:0:9500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34436 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.986150:0:9500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34436 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.986176:0:9500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafef7ce200) 00010000:00010000:2.0:1787560633.986180:0:9500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787560633.986186:0:9500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34436 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.986193:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34436 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560633.986216:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560633.986242:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560633.986244:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560634.032789:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560634.033015:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853304704 00000100:00100000:2.0:1787560634.033028:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853304704 00000100:00100000:2.0:1787560634.033141:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 107 00000100:00100000:2.0:1787560634.033155:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+34:11346:x1874392853304704:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:2.0:1787560634.033187:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1787560634.033481:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787560634.035379:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f3443d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fd5c expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.036871:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177a00/0x4642c20bf2f34444 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.036898:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177a00/0x4642c20bf2f34444 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.036912:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177a00/0x4642c20bf2f34444 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.036934:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f3444b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.036942:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f3444b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.036948:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f3444b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787560634.037654:0:6499:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:3.0:1787560634.037852:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f34452 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.037864:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f34452 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.037874:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f34452 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.037915:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177a00/0x4642c20bf2f34444 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.037922:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177a00/0x4642c20bf2f34444 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.037931:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177a00/0x4642c20bf2f34444 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.037938:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb002177a00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560634.037943:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177a00/0x4642c20bf2f34444 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.037980:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177a00/0x4642c20bf2f34444 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.037994:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:3.0:1787560634.037998:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560634.038004:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177a00/0x4642c20bf2f34444 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.038011:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177a00/0x4642c20bf2f34444 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787560634.038029:0:6499:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016617b8d reply state 0000000021bf6d51 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f3444b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.038042:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f3444b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.038148:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9caec2028200) 00010000:00010000:3.0:1787560634.038151:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787560634.038155:0:6499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787560634.038201:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f3443d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd5c expref: 37 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.038362:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f34452 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd5c expref: 36 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.038373:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537800) 00010000:00010000:3.0:1787560634.038375:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787560634.038378:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb002176200, rc 0) 00000100:00100000:3.0:1787560634.038685:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+37:11346:x1874392853304704:12345-192.168.203.29@tcp:101:bash.0 Request processed in 5532us (5911us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1787560634.038708:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 107 00000100:00100000:1.0:1787560634.044125:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560634.044260:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853304832 00000100:00100000:2.0:1787560634.044274:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853304832 00000100:00100000:2.0:1787560634.044361:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 42 00000100:00100000:2.0:1787560634.044376:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+7:2405:x1874392853304832:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:2.0:1787560634.044400:0:10171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560634.044428:0:10171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c20cc5b0/0x4642c20bf2f34460 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fd63 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787560634.044510:0:10171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787560634.044537:0:10171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=353s v=(0 0) 00010000:00010000:2.0:1787560634.044543:0:10171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560634.044556:0:10171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c20cc5b0/0x4642c20bf2f34460 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd63 expref: 8 pid: 10171 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.044582:0:10171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c20cc5b0/0x4642c20bf2f34460 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd63 expref: 8 pid: 10171 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.044624:0:10171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2169600, rc 0) 00000100:00100000:2.0:1787560634.044697:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+8:2405:x1874392853304832:12345-192.168.203.29@tcp:101:bash.0 Request processed in 325us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560634.044704:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 42 00000100:00080000:3.0:1787560634.045473:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787560634.048807:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560634.051201:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853304960 00000100:00100000:0.0:1787560634.051369:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853304960 00000100:00100000:0.0:1787560634.051483:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 43 00000100:00100000:0.0:1787560634.051496:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+8:11346:x1874392853304960:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:0.0:1787560634.051631:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560634.051658:0:8412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053dce82c/0x4642c20bf2f34467 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fd6a expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.051701:0:8412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c20cc5b0/0x4642c20bf2f34460 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd63 expref: 9 pid: 10171 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.051713:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560634.051736:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560634.051743:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053dce82c/0x4642c20bf2f34467 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd6a expref: 9 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.051799:0:8412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c20cc5b0/0x4642c20bf2f34460 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd63 expref: 9 pid: 10171 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.051819:0:8412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c20cc5b0/0x4642c20bf2f34460 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd63 expref: 9 pid: 10171 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560634.051839:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3af1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1874392862819072:192.168.203.29@tcp:104: 00000100:00100000:0.0:1787560634.052177:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd9b9cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787560634.054694:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3af1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1874392862819072:192.168.203.29@tcp:104: 00010000:00010000:1.0:1787560634.054743:0:8412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000053dce82c/0x4642c20bf2f34467 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd6a expref: 9 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.054769:0:8412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881600, rc 0) 00000100:00100000:1.0:1787560634.054845:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+9:11346:x1874392853304960:12345-192.168.203.29@tcp:101:bash.0 Request processed in 3351us (6052us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560634.054887:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 43 00000100:00100000:1.0:1787560634.060960:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560634.061335:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853305088 00000100:00100000:2.0:1787560634.061348:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853305088 00010000:00010000:2.0:1787560634.061407:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c20cc5b0/0x4642c20bf2f34460 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd63 expref: 9 pid: 10171 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560634.061501:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 67 00000100:00100000:2.0:1787560634.061514:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+9:2404:x1874392853305088:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560634.061533:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560634.061562:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c20cc5b0/0x4642c20bf2f34460 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd63 expref: 9 pid: 10171 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.061579:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c20cc5b0/0x4642c20bf2f34460 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd63 expref: 9 pid: 10171 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.061607:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c20cc5b0/0x4642c20bf2f34460 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd63 expref: 9 pid: 10171 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.061776:0:6485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560634.061781:0:6485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560634.061825:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000053dce82c/0x4642c20bf2f34467 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd6a expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.061836:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053dce82c/0x4642c20bf2f34467 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd6a expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.061896:0:6485:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000053dce82c/0x4642c20bf2f34467 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd6a expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560634.061913:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc52c3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6485:1874392862819200:192.168.203.29@tcp:105: 00000100:00100000:2.0:1787560634.062066:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd8640b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787560634.066861:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc52c3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6485:1874392862819200:192.168.203.29@tcp:105: 00010000:00010000:2.0:1787560634.066911:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560634.067018:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+8:2404:x1874392853305088:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 5505us (6080us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560634.067032:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 67 00000100:00100000:0.0:1787560634.072908:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560634.073192:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853305344 00000100:00100000:3.0:1787560634.073206:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853305344 00000100:00100000:3.0:1787560634.073488:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 25 00000100:00100000:3.0:1787560634.073500:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+37:11346:x1874392853305344:12345-192.168.203.29@tcp:35:bash.0 00000100:00100000:3.0:1787560634.073908:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+38:11346:x1874392853305344:12345-192.168.203.29@tcp:35:bash.0 Request processed in 409us (1025us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1787560634.073917:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 25 00000100:00100000:1.0:1787560634.200270:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560634.200384:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853305472 00000100:00100000:3.0:1787560634.200398:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853305472 00000100:00100000:3.0:1787560634.200516:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 108 00000100:00100000:3.0:1787560634.200529:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+38:11362:x1874392853305472:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1787560634.200562:0:10172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560634.200587:0:10172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177a00/0x4642c20bf2f3446e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fd71 expref: -99 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.200675:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177400/0x4642c20bf2f34475 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.200693:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177400/0x4642c20bf2f34475 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.200707:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177400/0x4642c20bf2f34475 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560634.200765:0:10172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1787560634.200785:0:10172:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787560634.200825:0:10172:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177400/0x4642c20bf2f34475 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.200855:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177a00/0x4642c20bf2f3446e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd71 expref: 40 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.200994:0:10172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177400/0x4642c20bf2f34475 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd71 expref: 39 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.201006:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:3.0:1787560634.201009:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787560634.201014:0:10172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb002177400, rc 0) 00000100:00100000:3.0:1787560634.201106:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+39:11362:x1874392853305472:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 580us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560634.201114:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 108 00000100:00100000:2.0:1787560634.209514:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560634.209799:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853305728 00000100:00100000:0.0:1787560634.209821:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853305728 00000100:00100000:0.0:1787560634.209899:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 109 00000100:00100000:0.0:1787560634.209912:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+39:11362:x1874392853305728:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:0.0:1787560634.209939:0:13787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560634.209976:0:13787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f3447c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fd78 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.210120:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34483 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.210137:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34483 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.210150:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34483 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560634.210182:0:13787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787560634.210327:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f3447c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd78 expref: 42 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.210345:0:13787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34483 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd78 expref: 41 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.210356:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537800) 00010000:00010000:0.0:1787560634.210359:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787560634.210363:0:13787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3880200, rc 0) 00000100:00100000:0.0:1787560634.210492:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+41:11362:x1874392853305728:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 582us (993us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1787560634.210500:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 109 00000100:00100000:0.0:1787560634.213896:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560634.213975:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853305984 00000100:00100000:3.0:1787560634.213988:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853305984 00000100:00100000:0.0:1787560634.213997:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560634.214136:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 110 00000100:00100000:3.0:1787560634.214151:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+41:11362:x1874392853305984:12345-192.168.203.29@tcp:101:lfs.0 00000100:00100000:1.0:1787560634.214159:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853306112 00000100:00100000:1.0:1787560634.214166:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853306112 00010000:00010000:3.0:1787560634.214191:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560634.214222:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177a00/0x4642c20bf2f34491 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fd7f expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560634.214222:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:1.0:1787560634.214237:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+42:2404:x1874392853306112:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560634.214254:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560634.214471:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f34498 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.214721:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34483 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd78 expref: 43 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.214725:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f34498 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.214759:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537800) 00010000:00010000:3.0:1787560634.214760:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f34498 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.214770:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:3.0:1787560634.214777:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00000100:00100000:1.0:1787560634.214840:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+42:2404:x1874392853306112:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 606us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560634.214849:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00010000:00010000:3.0:1787560634.214977:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177a00/0x4642c20bf2f34491 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd7f expref: 43 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.214996:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f34498 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd7f expref: 42 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.215004:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537800) 00010000:00010000:3.0:1787560634.215008:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787560634.215010:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafc0030200, rc 0) 00000100:00100000:3.0:1787560634.215039:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+42:11362:x1874392853305984:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 893us (1218us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1787560634.215046:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 110 00000100:00100000:1.0:1787560634.220145:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560634.220495:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853306240 00000100:00100000:2.0:1787560634.220510:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853306240 00000100:00100000:2.0:1787560634.220593:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 44 00000100:00100000:2.0:1787560634.220607:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+8:2405:x1874392853306240:12345-192.168.203.29@tcp:1:lfs.0 00010000:00010000:2.0:1787560634.220670:0:10171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000643e1686/0x4642c20bf2f344a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.220696:0:10171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000053dce82c/0x4642c20bf2f34467 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd6a expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.220730:0:10171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560634.220735:0:10171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787560634.220741:0:10171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000643e1686/0x4642c20bf2f344a6 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.220788:0:10171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000053dce82c/0x4642c20bf2f34467 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd6a expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.220805:0:10171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000053dce82c/0x4642c20bf2f34467 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd6a expref: 8 pid: 8412 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560634.220823:0:10171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc52c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10171:1874392862819328:192.168.203.29@tcp:104: 00000100:00100000:2.0:1787560634.220930:0:10171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd8640b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787560634.225960:0:10171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc52c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10171:1874392862819328:192.168.203.29@tcp:104: 00010000:00010000:1.0:1787560634.226013:0:10171:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000643e1686/0x4642c20bf2f344a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560634.228888:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560634.229004:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853306368 00000100:00100000:2.0:1787560634.229016:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853306368 00002000:00100000:2.0:1787560634.229084:0:8420:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9cafffe4ea00 x1874392853306368/t0(0) o4->9331bacf-6cfc-4379-8649-925e79b19df1@192.168.203.29@tcp:750/0 lens 504/0 e 0 to 0 dl 1787560645 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787560634.229096:0:8420:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cafffe4ea00 with x1874392853306368 ext(0->8) 00010000:00010000:2.0:1787560634.229108:0:8420:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000053dce82c/0x4642c20bf2f34467 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd6a expref: 9 pid: 8412 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.229128:0:8420:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000053dce82c/0x4642c20bf2f34467 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd6a expref: 9 pid: 8412 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787560634.229137:0:8420:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9cafffe4ea00 00000100:00100000:2.0:1787560634.229194:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:2.0:1787560634.229206:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9331bacf-6cfc-4379-8649-925e79b19df1+9:2405:x1874392853306368:12345-192.168.203.29@tcp:4:lfs.0 00000100:00100000:2.0:1787560634.230634:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9331bacf-6cfc-4379-8649-925e79b19df1+11:2405:x1874392853306368:12345-192.168.203.29@tcp:4:lfs.0 Request processed in 1420us (1749us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787560634.230649:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 1 00002000:00100000:2.0:1787560634.230660:0:8420:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9cafffe4ea00 x1874392853306368/t4294967303(0) o4->9331bacf-6cfc-4379-8649-925e79b19df1@192.168.203.29@tcp:750/0 lens 504/448 e 0 to 0 dl 1787560645 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787560634.230672:0:8420:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cafffe4ea00 with x1874392853306368 ext(0->8) 00010000:00010000:2.0:1787560634.230683:0:8420:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000053dce82c/0x4642c20bf2f34467 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd6a expref: 11 pid: 8412 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.230702:0:8420:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000053dce82c/0x4642c20bf2f34467 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd6a expref: 11 pid: 8412 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787560634.230711:0:8420:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9cafffe4ea00 00000100:00100000:2.0:1787560634.232912:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560634.233724:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853306496 00000100:00100000:3.0:1787560634.233740:0:9502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853306496 00010000:00010000:3.0:1787560634.233799:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000053dce82c/0x4642c20bf2f34467 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd6a expref: 11 pid: 8412 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560634.233855:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 68 00000100:00100000:3.0:1787560634.233868:0:9502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd7cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+11:2404:x1874392853306496:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560634.233887:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787560634.233909:0:9502:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787560634.233912:0:9502:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787560633 00002000:00010000:3.0:1787560634.233933:0:9502:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787560633 00002000:00010000:3.0:1787560634.233935:0:9502:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1787560633 00002000:00010000:3.0:1787560634.233937:0:9502:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1787560634.233961:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000053dce82c/0x4642c20bf2f34467 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd6a expref: 11 pid: 8412 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.233979:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000053dce82c/0x4642c20bf2f34467 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd6a expref: 11 pid: 8412 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.234008:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053dce82c/0x4642c20bf2f34467 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd6a expref: 11 pid: 8412 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.234028:0:9502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787560634.234034:0:9502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787560634.234041:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000643e1686/0x4642c20bf2f344a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.234052:0:9502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000643e1686/0x4642c20bf2f344a6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.234094:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560634.234183:0:9502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd7cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+10:2404:x1874392853306496:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 317us (1283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560634.234192:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 68 00010000:00010000:1.0:1787560634.234337:0:10171:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000643e1686/0x4642c20bf2f344a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.234364:0:10171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000643e1686/0x4642c20bf2f344a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.234391:0:10171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000643e1686/0x4642c20bf2f344a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.234400:0:10171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000643e1686/0x4642c20bf2f344a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.234409:0:10171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000643e1686/0x4642c20bf2f344a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.234418:0:10171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168400 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560634.234423:0:10171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000643e1686/0x4642c20bf2f344a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.234464:0:10171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000643e1686/0x4642c20bf2f344a6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.234480:0:10171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000643e1686/0x4642c20bf2f344a6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.234489:0:10171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000643e1686/0x4642c20bf2f344a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560634.234567:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+9:2405:x1874392853306240:12345-192.168.203.29@tcp:1:lfs.0 Request processed in 13963us (14437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560634.234578:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 44 00000100:00100000:0.0:1787560634.237813:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560634.237934:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853306752 00000100:00100000:2.0:1787560634.237963:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853306752 00000100:00100000:2.0:1787560634.238041:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 26 00000100:00100000:2.0:1787560634.238055:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd7c07050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+42:11362:x1874392853306752:12345-192.168.203.29@tcp:35:lfs.0 00000004:00010000:2.0:1787560634.238147:0:6502:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f34498 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd7f expref: 42 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787560634.239820:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1787560634.239903:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1787560634.242473:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1787560634.242581:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f344ad lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.242607:0:6502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f34452 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd5c expref: 46 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.242628:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f344ad lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.242684:0:6502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f34452 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd5c expref: 46 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.242705:0:6502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f34452 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd5c expref: 46 pid: 6499 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560634.242723:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc52c1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6502:1874392862819456:192.168.203.29@tcp:104: 00000100:00100000:2.0:1787560634.242860:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd8640b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787560634.248701:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560634.248858:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853306880 00000100:00100000:1.0:1787560634.248872:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853306880 00010000:00010000:1.0:1787560634.248929:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f34452 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd5c expref: 47 pid: 6499 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560634.248984:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 69 00000100:00100000:1.0:1787560634.248996:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+47:2404:x1874392853306880:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560634.249014:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560634.249022:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f34452 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd5c expref: 47 pid: 6499 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.249038:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f34452 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd5c expref: 47 pid: 6499 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.249065:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537800) 00010000:00010000:1.0:1787560634.249072:0:6486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f344ad lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.249084:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f344ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.249093:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f344ad lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.249144:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560634.249218:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+47:2404:x1874392853306880:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 223us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560634.249236:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 69 00010000:00010000:3.0:1787560634.250276:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f34452 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd5c expref: 46 pid: 6499 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560634.250532:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc52c1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6502:1874392862819456:192.168.203.29@tcp:104: 00010000:00010000:3.0:1787560634.250580:0:6502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f344ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.250591:0:6502:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f344ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.250597:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f344ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787560634.250756:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:3.0:1787560634.250899:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:3.0:1787560634.251118:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6502:1874392862819584:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787560634.251202:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560634.251240:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec322db40 going to sleep for 11 seconds 00000100:00100000:2.0:1787560634.251345:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862819584 00000100:00100000:2.0:1787560634.251353:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862819584 00000100:00100000:2.0:1787560634.251455:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787560634.251467:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6502:x1874392862819584:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787560634.251578:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6502:x1874392862819584:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 113us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560634.251585:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787560634.251630:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6502:1874392862819584:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787560634.251792:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1787560634.251862:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6502:1874392862819712:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787560634.251910:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560634.251937:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c4b180 going to sleep for 11 seconds 00000100:00100000:2.0:1787560634.253321:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862819712 00000100:00100000:2.0:1787560634.253337:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862819712 00000100:00100000:2.0:1787560634.253405:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787560634.253416:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6502:x1874392862819712:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787560634.253683:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6502:x1874392862819712:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 269us (1770us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787560634.253691:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787560634.253736:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6502:1874392862819712:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787560634.253809:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1787560634.253858:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f344ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.253870:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f344ad lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.253889:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f344ad lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.253896:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560634.253901:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f344ad lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.253910:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f344ad lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.253930:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537800) 00010000:00010000:1.0:1787560634.253940:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00000100:00080000:3.0:1787560634.253941:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787560634.253946:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f344ad lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.254077:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f344ad lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787560634.254240:0:6502:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787560634.254318:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1787560634.254333:0:6502:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 353593900600ns, next at 354593897461ns, rc = 0 00000001:00080000:1.0:1787560634.254341:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1787560634.254368:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537800) 00010000:00010000:1.0:1787560634.254372:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787560634.254380:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f34498 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd7f expref: 50 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560634.254545:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd7c07050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+49:11362:x1874392853306752:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 16492us (16744us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1787560634.254554:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 26 00000020:00080000:1.0:1787560634.254558:0:6502:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787560634.260625:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560634.260709:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853307008 00000100:00100000:3.0:1787560634.260722:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853307008 00000100:00100000:3.0:1787560634.260794:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 111 00000100:00100000:3.0:1787560634.260805:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+49:11362:x1874392853307008:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1787560634.260836:0:10172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560634.260863:0:10172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f344b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fd86 expref: -99 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.260944:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f344b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd86 expref: 50 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.261001:0:10172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f344b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd86 expref: 50 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.261024:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:3.0:1787560634.261028:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787560634.261033:0:10172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafc0030400, rc 0) 00000100:00100000:3.0:1787560634.261107:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+50:11362:x1874392853307008:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 304us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560634.261114:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 111 00000100:00100000:3.0:1787560634.266544:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560634.266647:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853307264 00000100:00100000:0.0:1787560634.266661:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853307264 00000100:00100000:0.0:1787560634.266732:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 27 00000100:00100000:0.0:1787560634.266744:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+50:11362:x1874392853307264:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:0.0:1787560634.267225:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+51:11362:x1874392853307264:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 481us (693us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1787560634.267234:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 27 00010000:00010000:2.0:1787560634.356151:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560634.359547:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560634.359658:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853307392 00000100:00100000:0.0:1787560634.359673:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853307392 00000100:00100000:0.0:1787560634.359752:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 112 00000100:00100000:0.0:1787560634.359764:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+51:11372:x1874392853307392:12345-192.168.203.29@tcp:34:lfs.0 00010000:00010000:0.0:1787560634.359988:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f344bb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.360171:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f344bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.360187:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f344bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.360202:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f344c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.360210:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f344c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.360217:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f344c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.360611:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f344c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.360622:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f344c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.360631:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f344c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787560634.360690:0:13787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f344c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.360723:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f344bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.360730:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f344bb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.360739:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f344bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.360746:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881a00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560634.360751:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f344bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.360760:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f344bb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.360774:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:0.0:1787560634.360778:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560634.360784:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f344bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.360791:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f344bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.360804:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f344c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.360810:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f344c2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.360817:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f344c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.360960:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560634.360963:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f344c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.360970:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f344c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.360980:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9caec2028200) 00010000:00010000:0.0:1787560634.360983:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560634.360986:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f344c2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.360994:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f344c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.361005:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f344c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.361011:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f344c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.361018:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f344c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.361024:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881000 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560634.361027:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f344c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.361033:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f344c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.361052:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:0.0:1787560634.361055:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560634.361058:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f344c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.361065:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f344c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560634.361171:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+51:11372:x1874392853307392:12345-192.168.203.29@tcp:34:lfs.0 Request processed in 1404us (1635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560634.361181:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 112 00000100:00100000:1.0:1787560634.427581:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560634.427684:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853307648 00000100:00100000:3.0:1787560634.427697:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853307648 00000100:00100000:3.0:1787560634.427782:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 113 00000100:00100000:3.0:1787560634.427794:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+51:11375:x1874392853307648:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1787560634.427821:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560634.427866:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f344d0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fd8d expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.428105:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f344d7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.428122:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f344d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.428134:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f344d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.428169:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177a00/0x4642c20bf2f344de lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.428176:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177a00/0x4642c20bf2f344de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.428182:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177a00/0x4642c20bf2f344de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.428315:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f344e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.428322:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f344e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.428328:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f344e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560634.428339:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787560634.428488:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f344d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.428497:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f344d7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.428504:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f344d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.428511:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb002176200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560634.428517:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f344d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.428535:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f344d7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.428549:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:3.0:1787560634.428552:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560634.428557:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f344d7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.428563:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f344d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.428579:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177a00/0x4642c20bf2f344de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.428584:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177a00/0x4642c20bf2f344de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.428590:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177a00/0x4642c20bf2f344de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.428594:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb002177a00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560634.428597:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177a00/0x4642c20bf2f344de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.428602:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177a00/0x4642c20bf2f344de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.428607:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9caec2028200) 00010000:00010000:3.0:1787560634.428609:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560634.428611:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177a00/0x4642c20bf2f344de lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.428625:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177a00/0x4642c20bf2f344de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.428668:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f344d0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd8d expref: 54 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.428684:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f344e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd8d expref: 53 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.428691:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:3.0:1787560634.428694:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787560634.428697:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f7600, rc 0) 00000100:00100000:3.0:1787560634.429133:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+53:11375:x1874392853307648:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 1339us (1567us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1787560634.429143:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 113 00000100:00100000:3.0:1787560634.433580:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560634.433700:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853307776 00000100:00100000:0.0:1787560634.433716:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853307776 00000100:00100000:0.0:1787560634.433794:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 114 00000100:00100000:0.0:1787560634.433806:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+53:11375:x1874392853307776:12345-192.168.203.29@tcp:54:lfs.0 00010000:00010000:0.0:1787560634.433898:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f344f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.433919:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f344f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.433933:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f344f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.433992:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f344f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.434000:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f344f3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.434031:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f344f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.434038:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881000 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560634.434044:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f344f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.434052:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f344f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.434067:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:0.0:1787560634.434071:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787560634.434077:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f344f3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.434084:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f344f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560634.434183:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+53:11375:x1874392853307776:12345-192.168.203.29@tcp:54:lfs.0 Request processed in 378us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560634.434191:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 114 00000100:00100000:1.0:1787560634.439718:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560634.441364:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853308032 00000100:00100000:2.0:1787560634.441384:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853308032 00000100:00100000:2.0:1787560634.441491:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 28 00000100:00100000:2.0:1787560634.441503:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+53:11375:x1874392853308032:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:2.0:1787560634.441815:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+54:11375:x1874392853308032:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 314us (2112us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1787560634.441824:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 28 00000100:00100000:1.0:1787560634.522175:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560634.522330:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853308288 00000100:00100000:2.0:1787560634.522344:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853308288 00000100:00100000:2.0:1787560634.522417:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 115 00000100:00100000:2.0:1787560634.522428:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+54:11385:x1874392853308288:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:2.0:1787560634.522490:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560634.522494:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787560634.522527:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177400/0x4642c20bf2f34475 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd71 expref: 54 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.522551:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:2.0:1787560634.522556:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787560634.522570:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f344fa lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fd94 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.522808:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34501 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.522938:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f344e5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd8d expref: 54 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.522957:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34501 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.523000:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f344e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd8d expref: 54 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.523016:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f344e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd8d expref: 54 pid: 6499 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560634.523032:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc52c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6498:1874392862819840:192.168.203.29@tcp:104: 00000100:00100000:2.0:1787560634.523136:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd8640600 going to sleep for 11 seconds 00000100:00100000:2.0:1787560634.528036:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc52c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6498:1874392862819840:192.168.203.29@tcp:104: 00010000:00010000:2.0:1787560634.528099:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34501 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560634.529307:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560634.529967:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853308416 00000100:00100000:3.0:1787560634.529982:0:9502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853308416 00010000:00010000:3.0:1787560634.530034:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f344e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd8d expref: 55 pid: 6499 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560634.530124:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 70 00000100:00100000:3.0:1787560634.530135:0:9502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+55:2404:x1874392853308416:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560634.530152:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560634.530160:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f344e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd8d expref: 55 pid: 6499 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.530198:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f344e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd8d expref: 55 pid: 6499 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.530237:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f344e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd8d expref: 55 pid: 6499 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.530258:0:9502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:3.0:1787560634.530264:0:9502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34501 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.530275:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34501 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.530284:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34501 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.530320:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560634.530384:0:9502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+54:2404:x1874392853308416:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 250us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560634.530392:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 70 00010000:00010000:0.0:1787560634.530456:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34501 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.530464:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34501 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560634.530488:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787560634.530657:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f344fa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd94 expref: 55 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.530686:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34501 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd94 expref: 54 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.530694:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:0.0:1787560634.530697:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787560634.530700:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2168200, rc 0) 00000100:00100000:0.0:1787560634.530726:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+54:11385:x1874392853308288:12345-192.168.203.29@tcp:101:bash.0 Request processed in 8300us (8565us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1787560634.530732:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 115 00000100:00100000:3.0:1787560634.536253:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560634.536349:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853308544 00000100:00100000:0.0:1787560634.536366:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853308544 00000100:00100000:0.0:1787560634.536498:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 116 00000100:00100000:0.0:1787560634.536511:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+54:11385:x1874392853308544:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:0.0:1787560634.536557:0:10172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560634.536585:0:10172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f3450f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fd9b expref: -99 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.536631:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34516 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.536659:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34516 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.536673:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34516 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.536837:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f3450f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd9b expref: 56 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.536866:0:10172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34516 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd9b expref: 55 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.536885:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:0.0:1787560634.536888:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787560634.536893:0:10172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881600, rc 0) 00000100:00100000:0.0:1787560634.536971:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+55:11385:x1874392853308544:12345-192.168.203.29@tcp:101:bash.0 Request processed in 462us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560634.536988:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 116 00000100:00100000:1.0:1787560634.540272:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560634.540558:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853308800 00000100:00100000:3.0:1787560634.540577:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853308800 00000100:00100000:3.0:1787560634.540648:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 117 00000100:00100000:3.0:1787560634.540659:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+55:11385:x1874392853308800:12345-192.168.203.29@tcp:36:bash.0 00010000:00010000:1.0:1787560634.541235:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3451d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.541259:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3451d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.541296:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3451d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787560634.541352:0:13787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:1.0:1787560634.541381:0:13787:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba55f9b1 reply state 000000009c6dfe24 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3451d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.541394:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3451d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.541401:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:1.0:1787560634.541404:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787560634.541408:0:13787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787560634.541553:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+58:11385:x1874392853308800:12345-192.168.203.29@tcp:36:bash.0 Request processed in 894us (1295us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1787560634.541561:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 117 00000020:00080000:1.0:1787560634.541567:0:13787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787560634.546466:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560634.546601:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853308928 00000100:00100000:0.0:1787560634.546614:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853308928 00000100:00100000:0.0:1787560634.546723:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 118 00000100:00100000:0.0:1787560634.546737:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+58:11385:x1874392853308928:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:0.0:1787560634.546771:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560634.546797:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34524 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fda2 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.547118:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3452b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.547135:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34501 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd94 expref: 59 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.547144:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3452b lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.547188:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34501 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd94 expref: 59 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.547221:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34501 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd94 expref: 59 pid: 6498 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560634.547238:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3af2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6498:1874392862819968:192.168.203.29@tcp:104: 00000100:00100000:0.0:1787560634.547385:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd9b9cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787560634.551934:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560634.552145:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3af2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6498:1874392862819968:192.168.203.29@tcp:104: 00010000:00010000:0.0:1787560634.552182:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3452b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560634.552330:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853309056 00000100:00100000:2.0:1787560634.552340:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853309056 00010000:00010000:2.0:1787560634.552392:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34501 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd94 expref: 60 pid: 6498 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560634.552474:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 71 00000100:00100000:2.0:1787560634.552486:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+60:2404:x1874392853309056:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560634.552504:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560634.552531:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34501 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd94 expref: 60 pid: 6498 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.552545:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34501 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd94 expref: 60 pid: 6498 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.552573:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34501 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd94 expref: 60 pid: 6498 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.552592:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:2.0:1787560634.552598:0:6484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3452b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.552610:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3452b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.552618:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3452b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.552662:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560634.552742:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+59:2404:x1874392853309056:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 257us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560634.552750:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 71 00010000:00010000:0.0:1787560634.552869:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3452b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.552878:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3452b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560634.552966:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787560634.552972:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787560634.553000:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3452b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.553039:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34524 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fda2 expref: 59 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.553055:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3452b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fda2 expref: 58 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.553063:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:0.0:1787560634.553074:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787560634.553077:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881a00, rc 0) 00000100:00100000:0.0:1787560634.553106:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+58:11385:x1874392853308928:12345-192.168.203.29@tcp:101:bash.0 Request processed in 6373us (6690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560634.553113:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 118 00000100:00100000:1.0:1787560634.559183:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560634.559275:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853309312 00000100:00100000:2.0:1787560634.559288:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853309312 00000100:00100000:2.0:1787560634.559363:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 29 00000100:00100000:2.0:1787560634.559377:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+58:11385:x1874392853309312:12345-192.168.203.29@tcp:35:bash.0 00000100:00100000:2.0:1787560634.559703:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+59:11385:x1874392853309312:12345-192.168.203.29@tcp:35:bash.0 Request processed in 327us (534us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1787560634.559732:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 29 00000100:00100000:3.0:1787560634.645674:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560634.645973:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853309440 00000100:00100000:0.0:1787560634.645988:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853309440 00000100:00100000:0.0:1787560634.646078:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 119 00000100:00100000:0.0:1787560634.646091:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+59:11391:x1874392853309440:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:0.0:1787560634.646130:0:10172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560634.646158:0:10172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34532 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fda9 expref: -99 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.646250:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34539 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.646268:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34539 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.646282:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34539 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560634.646343:0:10172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787560634.646347:0:10172:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787560634.646374:0:10172:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34539 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.646405:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34532 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fda9 expref: 61 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.646494:0:10172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34539 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fda9 expref: 60 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.646507:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:0.0:1787560634.646510:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787560634.646514:0:10172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881c00, rc 0) 00000100:00100000:0.0:1787560634.646590:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+60:11391:x1874392853309440:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 501us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560634.646599:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 119 00000100:00100000:3.0:1787560634.652631:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560634.652755:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853309568 00000100:00100000:1.0:1787560634.652768:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853309568 00000100:00100000:1.0:1787560634.652850:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 120 00000100:00100000:1.0:1787560634.652862:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+60:11391:x1874392853309568:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:1.0:1787560634.652898:0:13787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560634.652926:0:13787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f34540 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fdb0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.653019:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f34547 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.653058:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f34547 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.653072:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f34547 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.653089:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3454e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.653097:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3454e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.653104:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3454e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.653211:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f34555 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.653221:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f34555 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.653229:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f34555 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560634.653283:0:13787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787560634.653288:0:13787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787560634.653310:0:13787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f34555 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.653324:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f34555 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.653344:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f34547 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.653351:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f34547 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.653358:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f34547 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.653365:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbff200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560634.653370:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f34547 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.653379:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f34547 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.653395:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:1.0:1787560634.653399:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560634.653405:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f34547 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.653411:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f34547 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.653427:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3454e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.653731:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3454e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.653738:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3454e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.653750:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbff800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560634.653753:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3454e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.653759:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3454e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.653768:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9caec2028200) 00010000:00010000:1.0:1787560634.653771:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560634.653774:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3454e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.653779:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3454e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.653813:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f34540 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdb0 expref: 62 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.653828:0:13787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f34555 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdb0 expref: 61 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.653837:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:1.0:1787560634.653840:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787560634.653843:0:13787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbfe200, rc 0) 00000100:00100000:1.0:1787560634.654113:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+61:11391:x1874392853309568:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 1251us (1494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560634.654123:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 120 00000100:00100000:2.0:1787560634.657311:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560634.657490:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853309824 00000100:00100000:0.0:1787560634.657504:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853309824 00000100:00100000:0.0:1787560634.657588:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 121 00000100:00100000:0.0:1787560634.657602:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+61:11391:x1874392853309824:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:0.0:1787560634.657633:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560634.657660:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f3455c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fdb7 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560634.657760:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00010000:00010000:0.0:1787560634.657797:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34563 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.657825:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3452b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fda2 expref: 62 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.657835:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f34555 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdb0 expref: 62 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.657870:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34563 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.657917:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f34555 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdb0 expref: 62 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.658327:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f34555 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdb0 expref: 62 pid: 13787 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560634.658347:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3af2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6498:1874392862820096:192.168.203.29@tcp:104: 00000100:00100000:1.0:1787560634.658378:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853309952 00000100:00100000:1.0:1787560634.658391:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853309952 00010000:00010000:1.0:1787560634.658420:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f34555 lrc: 6/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdb0 expref: 63 pid: 13787 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.658496:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3452b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fda2 expref: 63 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.658506:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3452b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fda2 expref: 63 pid: 6498 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560634.658515:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3af1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6498:1874392862820224:192.168.203.29@tcp:104: 00000100:00100000:0.0:1787560634.658540:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd9b9cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787560634.658631:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 72 00000100:00100000:1.0:1787560634.658641:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+63:2405:x1874392853309952:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560634.658655:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560634.658662:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f34555 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdb0 expref: 63 pid: 13787 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.658675:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f34555 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdb0 expref: 63 pid: 13787 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.658697:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:1.0:1787560634.658703:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34563 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.658710:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34563 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.658717:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560634.658758:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+63:2405:x1874392853309952:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 117us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560634.658765:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 72 00010000:00010000:0.0:1787560634.661191:0:6498:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.29@tcp) returned -22 from blocking AST (req@000000002894a393 x1874392862820096) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f34555 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdb0 expref: 62 pid: 13787 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.661222:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f34555 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdb0 expref: 62 pid: 13787 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560634.661242:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3af2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6498:1874392862820096:192.168.203.29@tcp:104: 00000100:00100000:0.0:1787560634.661277:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3af1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6498:1874392862820224:192.168.203.29@tcp:104: 00010000:00010000:0.0:1787560634.661300:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:0.0:1787560634.661306:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34563 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.661316:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34563 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.661326:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34563 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560634.662268:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560634.662391:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853310080 00000100:00100000:2.0:1787560634.662399:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853310080 00010000:00010000:2.0:1787560634.662479:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3452b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fda2 expref: 62 pid: 6498 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560634.662531:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 73 00000100:00100000:2.0:1787560634.662598:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+62:2405:x1874392853310080:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560634.662621:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560634.662628:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3452b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fda2 expref: 62 pid: 6498 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.662713:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3452b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fda2 expref: 62 pid: 6498 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.662734:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3452b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fda2 expref: 62 pid: 6498 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.662747:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:2.0:1787560634.662750:0:6484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34563 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.662757:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34563 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560634.662774:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34563 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.662826:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34563 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.662834:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34563 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560634.662858:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787560634.662897:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560634.662972:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+61:2405:x1874392853310080:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 430us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560634.662979:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 73 00010000:00010000:0.0:1787560634.663196:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f3455c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdb7 expref: 62 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.663211:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34563 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdb7 expref: 61 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.663274:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:0.0:1787560634.663277:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787560634.663280:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3880000, rc 0) 00000100:00100000:0.0:1787560634.663309:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+61:11391:x1874392853309824:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 5711us (6014us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1787560634.663325:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 121 00000100:00100000:2.0:1787560634.666370:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560634.666622:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853310336 00000100:00100000:3.0:1787560634.666637:0:9502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853310336 00000100:00100000:3.0:1787560634.666719:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:3.0:1787560634.666732:0:9502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+61:11391:x1874392853310336:12345-192.168.203.29@tcp:103:lfs.0 00010000:00010000:3.0:1787560634.666751:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560634.666781:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f344b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd86 expref: 61 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.666802:0:9502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:3.0:1787560634.666808:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560634.666912:0:9502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+60:11391:x1874392853310336:12345-192.168.203.29@tcp:103:lfs.0 Request processed in 182us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560634.666920:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:1.0:1787560634.669217:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560634.669335:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853310464 00000100:00100000:3.0:1787560634.669348:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853310464 00000100:00100000:3.0:1787560634.669417:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 122 00000100:00100000:3.0:1787560634.669459:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+60:11391:x1874392853310464:12345-192.168.203.29@tcp:58:lfs.0 00010000:00010000:3.0:1787560634.669644:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34571 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.669666:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34571 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.669679:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34571 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787560634.669813:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1787560634.670136:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+60:11391:x1874392853310464:12345-192.168.203.29@tcp:58:lfs.0 Request processed in 708us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560634.670143:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 122 00000100:00100000:0.0:1787560634.672073:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560634.672244:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853310592 00000100:00100000:1.0:1787560634.672256:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853310592 00000100:00100000:1.0:1787560634.672322:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 123 00000100:00100000:1.0:1787560634.672335:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+60:11391:x1874392853310592:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:1.0:1787560634.672374:0:13787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560634.672399:0:13787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f34578 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fdbe expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.672553:0:13787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34571 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.672566:0:13787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f34578 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdbe expref: 61 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.672588:0:13787:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34571 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.672603:0:13787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f34578 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdbe expref: 61 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.672620:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:1.0:1787560634.672623:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787560634.672626:0:13787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f34578 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdbe expref: 61 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.672718:0:13787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbff200, rc 0) 00000100:00100000:1.0:1787560634.672892:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+61:11391:x1874392853310592:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 559us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560634.672900:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 123 00000040:00080000:0.0:1787560634.867685:0:13775:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787560634.867698:0:13775:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787560634.867759:0:13775:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1787560634.867775:0:13775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787560634.869455:0:13775:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3af2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13775:1874392862820352:192.168.203.29@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787560634.869630:0:13775:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc1370d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787560634.878273:0:13775:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3af2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13775:1874392862820352:192.168.203.29@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787560634.885337:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560634.885688:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853310720 00000100:00100000:0.0:1787560634.885703:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853310720 00000100:00100000:0.0:1787560634.885896:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 124 00000100:00100000:0.0:1787560634.885909:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+61:11392:x1874392853310720:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787560634.885991:0:6498:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787560634.886277:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+61:11392:x1874392853310720:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 Request processed in 368us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560634.886286:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 124 00000100:00100000:3.0:1787560634.891400:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560634.891550:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853310848 00000100:00100000:1.0:1787560634.891565:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853310848 00000100:00100000:1.0:1787560634.891644:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 125 00000100:00100000:1.0:1787560634.891675:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+61:11392:x1874392853310848:12345-192.168.203.29@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787560634.891781:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f3457f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.891803:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f3457f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.891818:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f3457f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.891837:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f34586 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.891845:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f34586 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.891851:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f34586 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.891890:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f3458d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.891901:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f3458d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.891908:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f3458d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560634.891988:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787560634.891994:0:6499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787560634.892009:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f3458d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.892033:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f3457f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.892040:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f3457f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.892048:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f3457f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.892055:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbfe200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560634.892060:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f3457f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.892068:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f3457f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.892083:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9caec3207900) 00010000:00010000:1.0:1787560634.892086:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560634.892092:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f3457f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.892098:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f3457f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.892110:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f34586 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.892116:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f34586 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.892121:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f34586 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.892133:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbff800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560634.892136:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f34586 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.892142:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f34586 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.892149:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9caec3203800) 00010000:00010000:1.0:1787560634.892152:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560634.892155:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f34586 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.892161:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f34586 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.892177:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f3458d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.892183:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f3458d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.892189:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f3458d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.892195:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbffe00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560634.892197:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f3458d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.892203:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f3458d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.892220:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:1.0:1787560634.892222:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560634.892225:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f3458d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.892231:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f3458d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560634.892329:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+61:11392:x1874392853310848:12345-192.168.203.29@tcp:34:lhsmtool_posix.0 Request processed in 655us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560634.892338:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 125 00000100:00100000:2.0:1787560634.897680:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560634.902303:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853311104 00000100:00100000:1.0:1787560634.902327:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853311104 00000100:00100000:1.0:1787560634.902454:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 126 00000100:00100000:1.0:1787560634.902469:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+61:11392:x1874392853311104:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787560634.902498:0:13787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560634.902526:0:13787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f34594 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fdc5 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.902669:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f3459b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.902689:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f3459b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.902702:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f3459b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560634.902716:0:13787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787560634.902833:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f3459b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.902841:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f3459b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.902848:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f3459b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.902855:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbff600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560634.902861:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f3459b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.902868:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f3459b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.902883:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:1.0:1787560634.902886:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787560634.902892:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f3459b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.902899:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f3459b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.902957:0:13787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f34594 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdc5 expref: 63 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.902969:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9caec3207900) 00010000:00010000:1.0:1787560634.902971:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787560634.902975:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f34594 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdc5 expref: 63 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.902996:0:13787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbff000, rc 0) 00000100:00100000:1.0:1787560634.903087:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+62:11392:x1874392853311104:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 621us (5418us total) trans 4294967399 rc 301/301 00000100:00100000:1.0:1787560634.903094:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 126 00000100:00100000:2.0:1787560634.909580:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560634.909753:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853311232 00000100:00100000:0.0:1787560634.909767:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853311232 00000100:00100000:0.0:1787560634.909844:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 127 00000100:00100000:0.0:1787560634.909856:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+62:11392:x1874392853311232:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787560634.909906:0:6498:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787560634.910070:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+62:11392:x1874392853311232:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 Request processed in 216us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560634.910079:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 127 00000100:00100000:0.0:1787560634.914687:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560634.914832:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853311488 00000100:00100000:1.0:1787560634.914845:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853311488 00000100:00100000:1.0:1787560634.914922:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 128 00000100:00100000:1.0:1787560634.914935:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+62:11392:x1874392853311488:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787560634.914982:0:10172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560634.914986:0:10172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787560634.915021:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34539 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fda9 expref: 62 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.915046:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:1.0:1787560634.915052:0:10172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787560634.915069:0:10172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f345a9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fdcc expref: -99 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787560634.915690:0:10172:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:1.0:1787560634.915875:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f345b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.915891:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f345b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.915903:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f345b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.916000:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f345a9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdcc expref: 64 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.916018:0:10172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f345b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdcc expref: 63 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.916027:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9caec3203800) 00010000:00010000:1.0:1787560634.916030:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787560634.916033:0:10172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbff600, rc 0) 00000100:00100000:1.0:1787560634.916119:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+63:11392:x1874392853311488:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 1186us (1447us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1787560634.916128:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 128 00000100:00100000:2.0:1787560634.930924:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560634.931155:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853311744 00000100:00100000:3.0:1787560634.931169:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853311744 00000100:00100000:3.0:1787560634.931255:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 129 00000100:00100000:3.0:1787560634.931266:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+63:11392:x1874392853311744:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787560634.931348:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560634.931382:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f345b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdcc expref: 63 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.931405:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9caec3203800) 00010000:00010000:3.0:1787560634.931417:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787560634.931521:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f345be lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.931538:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f345be lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.931548:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f345be lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.935299:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f345c5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xcc1f2623 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.935324:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f345c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xcc1f2623 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.935335:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f345c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xcc1f2623 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.935407:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f345be lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.935415:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f345be lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.935422:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f345be lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.935428:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560634.935489:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f345be lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.935497:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f345be lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.935509:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:3.0:1787560634.935512:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560634.935516:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f345be lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.935521:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7600/0x4642c20bf2f345be lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.935536:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f345c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xcc1f2623 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.935542:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f345c5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xcc1f2623 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.935548:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f345c5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xcc1f2623 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.935560:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560634.935563:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f345c5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xcc1f2623 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.935568:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f345c5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xcc1f2623 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.935577:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xcc1f2623 (ffff9cafe1537500) 00010000:00010000:3.0:1787560634.935579:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560634.935582:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f345c5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xcc1f2623 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.935588:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f345c5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xcc1f2623 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560634.935752:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+62:11392:x1874392853311744:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 4482us (4839us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787560634.935761:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 129 00000100:00100000:3.0:1787560634.944010:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560634.944290:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853311872 00000100:00100000:1.0:1787560634.944302:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853311872 00000100:00100000:1.0:1787560634.944379:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 130 00000100:00100000:1.0:1787560634.944390:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+62:11392:x1874392853311872:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787560634.944410:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560634.944462:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f345cc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fdd3 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.944499:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f345d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.944513:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f345d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.944524:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f345d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.944649:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f345cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdd3 expref: 64 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.944668:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f345d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdd3 expref: 63 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.944677:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9caec3203300) 00010000:00010000:1.0:1787560634.944680:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787560634.944684:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbffe00, rc 0) 00000100:00100000:1.0:1787560634.944744:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+63:11392:x1874392853311872:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 356us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560634.944751:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 130 00000100:00100000:0.0:1787560634.948382:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560634.948542:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853312128 00000100:00100000:1.0:1787560634.948553:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853312128 00000100:00100000:1.0:1787560634.948602:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 131 00000100:00100000:1.0:1787560634.948613:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+63:11392:x1874392853312128:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787560634.948733:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f345da lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.948750:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f345da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.948780:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f345da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787560634.949045:0:13787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:1.0:1787560634.949154:0:13787:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000069dcc1c6 reply state 000000001a8f9663 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f345da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.949286:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f345da lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.949299:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9caec3203300) 00010000:00010000:1.0:1787560634.949304:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787560634.949310:0:13787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787560634.949557:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+65:11392:x1874392853312128:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 818us (1055us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1787560634.949567:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 131 00000100:00100000:2.0:1787560634.956789:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560634.956878:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853312256 00000100:00100000:3.0:1787560634.956888:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853312256 00000100:00100000:3.0:1787560634.956957:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 132 00000100:00100000:3.0:1787560634.956968:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+65:11392:x1874392853312256:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787560634.956995:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560634.957018:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f345e1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fdda expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.957077:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f345e1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdda expref: 66 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.957107:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f345e1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdda expref: 66 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560634.957129:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9caec3203300) 00010000:00010000:3.0:1787560634.957132:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787560634.957135:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f7800, rc 0) 00000100:00100000:3.0:1787560634.957201:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+66:11392:x1874392853312256:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 234us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560634.957209:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 132 00000100:00100000:3.0:1787560634.963541:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560634.963642:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853312384 00000100:00100000:1.0:1787560634.963653:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853312384 00000100:00100000:1.0:1787560634.963717:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 45 00000100:00100000:1.0:1787560634.963728:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3a1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+8:2405:x1874392853312384:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787560634.964007:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3a1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+9:2405:x1874392853312384:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 Request processed in 281us (474us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787560634.964015:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 45 00000100:00080000:3.0:1787560634.964074:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787560634.969248:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560634.977787:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853312640 00000100:00100000:2.0:1787560634.977801:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853312640 00000100:00100000:2.0:1787560634.977863:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 30 00000100:00100000:2.0:1787560634.977873:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+66:11392:x1874392853312640:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787560634.978093:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+67:11392:x1874392853312640:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 221us (8855us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1787560634.978101:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 30 00000100:00100000:0.0:1787560634.981089:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560634.981234:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853312896 00000100:00100000:3.0:1787560634.981243:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853312896 00000100:00100000:3.0:1787560634.981298:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 133 00000100:00100000:3.0:1787560634.981308:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc87ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+67:11392:x1874392853312896:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787560634.981408:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc87ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+67:11392:x1874392853312896:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 101us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560634.981415:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 133 00000100:00100000:2.0:1787560634.983750:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560634.983997:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853313024 00000100:00100000:0.0:1787560634.984007:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853313024 00000100:00100000:0.0:1787560634.984100:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 134 00000100:00100000:0.0:1787560634.984112:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+67:11392:x1874392853313024:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787560634.984132:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560634.984153:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f345e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fde1 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.984220:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f345ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.984233:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f345ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.984246:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f345ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560634.984290:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787560634.984309:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f345ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.984335:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f345e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fde1 expref: 69 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.984354:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f345ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fde1 expref: 68 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560634.984383:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9caec3203300) 00010000:00010000:0.0:1787560634.984386:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787560634.984389:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881a00, rc 0) 00000100:00100000:0.0:1787560634.984697:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+68:11392:x1874392853313024:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 586us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560634.984705:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 134 00000100:00100000:0.0:1787560634.988005:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560634.988085:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853313152 00000100:00100000:1.0:1787560634.988095:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853313152 00000100:00100000:1.0:1787560634.988163:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 46 00000100:00100000:1.0:1787560634.988174:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc87aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+9:2405:x1874392853313152:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787560634.988194:0:8414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560634.988216:0:8414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000563f796/0x4642c20bf2f345f6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fde8 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787560634.988255:0:8414:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c02ba, blocks: 0x0 00010000:00010000:1.0:1787560634.988275:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=354s v=(0 0) 00010000:00010000:1.0:1787560634.988293:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560634.988303:0:8414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000563f796/0x4642c20bf2f345f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fde8 expref: 10 pid: 8414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.988322:0:8414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000563f796/0x4642c20bf2f345f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fde8 expref: 10 pid: 8414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560634.988336:0:8414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbfe200, rc 0) 00000100:00100000:1.0:1787560634.988395:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc87aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+10:2405:x1874392853313152:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 223us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560634.988402:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 46 00000100:00100000:1.0:1787560634.996358:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560634.996550:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853313408 00000100:00100000:3.0:1787560634.996559:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853313408 00000100:00100000:3.0:1787560634.996617:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 135 00000100:00100000:3.0:1787560634.996628:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3baf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+68:11392:x1874392853313408:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787560634.996737:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3baf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+68:11392:x1874392853313408:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 110us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560634.996754:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 135 00000100:00100000:3.0:1787560635.000485:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560635.000602:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853313536 00000100:00100000:1.0:1787560635.000612:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853313536 00000100:00100000:1.0:1787560635.000665:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 47 00000100:00100000:1.0:1787560635.000675:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3a19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+10:11392:x1874392853313536:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787560635.000690:0:8415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560635.000707:0:8415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a08793e/0x4642c20bf2f345fd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fdef expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.000737:0:8415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000563f796/0x4642c20bf2f345f6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fde8 expref: 11 pid: 8414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.000745:0:8415:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560635.000750:0:8415:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560635.000755:0:8415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a08793e/0x4642c20bf2f345fd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdef expref: 11 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.000802:0:8415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000563f796/0x4642c20bf2f345f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fde8 expref: 11 pid: 8414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.000816:0:8415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000563f796/0x4642c20bf2f345f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fde8 expref: 11 pid: 8414 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560635.000830:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8415:1874392862820480:192.168.203.29@tcp:104: 00000100:00100000:1.0:1787560635.000922:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c4b300 going to sleep for 11 seconds 00000100:00100000:3.0:1787560635.005273:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8415:1874392862820480:192.168.203.29@tcp:104: 00010000:00010000:3.0:1787560635.005315:0:8415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a08793e/0x4642c20bf2f345fd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdef expref: 11 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.005333:0:8415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbff600, rc 0) 00000100:00100000:3.0:1787560635.005459:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3a19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+11:11392:x1874392853313536:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 4784us (4981us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560635.005468:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 47 00000100:00100000:2.0:1787560635.006720:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560635.006834:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853313664 00000100:00100000:0.0:1787560635.006842:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853313664 00010000:00010000:0.0:1787560635.006890:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000563f796/0x4642c20bf2f345f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fde8 expref: 11 pid: 8414 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560635.006928:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 74 00000100:00100000:0.0:1787560635.006937:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd7cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+11:2404:x1874392853313664:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787560635.006963:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560635.006997:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000563f796/0x4642c20bf2f345f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fde8 expref: 11 pid: 8414 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.007010:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000563f796/0x4642c20bf2f345f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fde8 expref: 11 pid: 8414 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.007032:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000563f796/0x4642c20bf2f345f6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fde8 expref: 11 pid: 8414 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.007072:0:6486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560635.007077:0:6486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560635.007084:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006a08793e/0x4642c20bf2f345fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdef expref: 10 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.007093:0:6486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a08793e/0x4642c20bf2f345fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdef expref: 10 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.007141:0:6486:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006a08793e/0x4642c20bf2f345fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdef expref: 10 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560635.007157:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6486:1874392862820608:192.168.203.29@tcp:105: 00000100:00100000:0.0:1787560635.007236:0:6486:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc1370d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787560635.018624:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6486:1874392862820608:192.168.203.29@tcp:105: 00010000:00010000:0.0:1787560635.018650:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560635.018705:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd7cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+10:2404:x1874392853313664:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 11769us (11991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560635.018717:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 74 00000100:00100000:1.0:1787560635.025067:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560635.025162:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853313792 00000100:00100000:2.0:1787560635.025172:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853313792 00002000:00100000:2.0:1787560635.025227:0:8418:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9caec3bafb80 x1874392853313792/t0(0) o4->9331bacf-6cfc-4379-8649-925e79b19df1@192.168.203.29@tcp:751/0 lens 504/0 e 0 to 0 dl 1787560646 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787560635.025251:0:8418:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9caec3bafb80 with x1874392853313792 ext(0->12) 00002000:00010000:2.0:1787560635.025257:0:8418:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9caec3bafb80 00000100:00100000:2.0:1787560635.025291:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:2.0:1787560635.025301:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9331bacf-6cfc-4379-8649-925e79b19df1+10:2404:x1874392853313792:12345-192.168.203.29@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787560635.029914:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9331bacf-6cfc-4379-8649-925e79b19df1+12:2404:x1874392853313792:12345-192.168.203.29@tcp:4:lhsmtool_posix.0 Request processed in 4605us (4845us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787560635.029930:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 2 00002000:00100000:2.0:1787560635.029955:0:8418:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9caec3bafb80 x1874392853313792/t4294967309(0) o4->9331bacf-6cfc-4379-8649-925e79b19df1@192.168.203.29@tcp:751/0 lens 504/448 e 0 to 0 dl 1787560646 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787560635.029967:0:8418:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9caec3bafb80 with x1874392853313792 ext(0->12) 00002000:00010000:2.0:1787560635.029973:0:8418:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9caec3bafb80 00000100:00100000:2.0:1787560635.037275:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560635.037375:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853313920 00000100:00100000:0.0:1787560635.037386:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853313920 00000100:00100000:0.0:1787560635.037476:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 136 00000100:00100000:0.0:1787560635.037486:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+68:11392:x1874392853313920:12345-192.168.203.29@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787560635.039866:0:6478:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:2.0:1787560635.039907:0:6478:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:2.0:1787560635.039931:0:6478:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9caec2c4be40 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1787560635.039936:0:6478:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cafc8744500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9caec2c4b600 00000020:00080000:2.0:1787560635.039940:0:6478:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cafc8744a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9caec21d4600 00000004:00080000:2.0:1787560635.039979:0:6478:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1787560635.040011:0:6478:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cafc7ed4b40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1787560635.040015:0:6478:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cafeec20800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cafc7ed4900 00000020:00080000:2.0:1787560635.040018:0:6478:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cafeec20600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9caec39a6c00 00000020:00080000:2.0:1787560635.040031:0:6478:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1787560635.040106:0:6530:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1787560635.040168:0:6530:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787560635.040265:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787560635.040283:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862820736:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787560635.040358:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560635.040399:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862820736 00000100:00100000:0.0:1787560635.040404:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862820736 00000100:00100000:0.0:1787560635.040479:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787560635.040488:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3625:x1874392862820736:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787560635.040512:0:8414:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:0.0:1787560635.040538:0:8414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d4223f7/0x4642c20bf2f34604 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.040561:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007760b92b/0x4642c20bf2f343b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd47 expref: 11 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.040571:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787560635.040575:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787560635.040580:0:8414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d4223f7/0x4642c20bf2f34604 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.040609:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007760b92b/0x4642c20bf2f343b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd47 expref: 11 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.040626:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007760b92b/0x4642c20bf2f343b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd47 expref: 11 pid: 8414 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560635.040639:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8414:1874392862820864:192.168.203.29@tcp:104: 00000100:00100000:0.0:1787560635.040697:0:8414:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd9b9cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787560635.040798:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+22:11392:x1874392853313920:12345-192.168.203.29@tcp:44:lhsmtool_posix.0 Request processed in 3313us (3532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560635.040808:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 136 00000100:00080000:0.0:1787560635.040850:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787560635.042130:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862820992:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787560635.042180:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560635.042423:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862820992 00000100:00100000:1.0:1787560635.042461:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862820992 00000100:00100000:1.0:1787560635.042503:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787560635.042512:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3623:x1874392862820992:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787560635.042535:0:8412:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:1.0:1787560635.042566:0:8412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a8c02b9, atime: 0x6a8c02b9, ctime: 0x6a8c02b9, blocks: 0x8 00010000:00010000:1.0:1787560635.042574:0:8412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000563f796/0x4642c20bf2f3460b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.042589:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=354s v=(0 0) 00010000:00010000:1.0:1787560635.042594:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560635.042600:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000563f796/0x4642c20bf2f3460b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.042617:0:8412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000563f796/0x4642c20bf2f3460b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.042646:0:8412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000563f796/0x4642c20bf2f3460b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.042654:0:8412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000563f796/0x4642c20bf2f3460b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.042675:0:8412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787560635.042815:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3623:x1874392862820992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 304us (633us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787560635.042823:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:1.0:1787560635.042844:0:9501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560635.042851:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000563f796/0x4642c20bf2f3460b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.042859:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbfe200 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560635.042863:0:9501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000563f796/0x4642c20bf2f3460b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.042872:0:9501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000563f796/0x4642c20bf2f3460b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.042888:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000563f796/0x4642c20bf2f3460b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.042895:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000563f796/0x4642c20bf2f3460b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.042920:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560635.042923:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560635.042925:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787560635.042965:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9caec3badc00/2, rc 0, transno 4294967305 00000100:00100000:1.0:1787560635.042971:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862820992:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787560635.043345:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34302 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043355:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34302 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043362:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34302 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043368:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb002177c00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560635.043377:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34302 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043384:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34302 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043398:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cafe1537400) 00010000:00010000:3.0:1787560635.043401:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560635.043413:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34302 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043420:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34302 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043613:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f343aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043620:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f343aa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043625:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f343aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043629:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb002176600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560635.043632:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f343aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043637:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f343aa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043645:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cafef7ce200) 00010000:00010000:3.0:1787560635.043648:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560635.043651:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f343aa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043656:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f343aa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043671:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34428 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043677:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34428 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043690:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34428 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043694:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560635.043697:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34428 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043703:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34428 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043710:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9caec2028200) 00010000:00010000:3.0:1787560635.043713:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560635.043716:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34428 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043721:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34428 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043732:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f3444b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043739:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f3444b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043744:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f3444b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043749:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb002177800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560635.043752:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f3444b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043769:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f3444b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043778:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9caec2028200) 00010000:00010000:3.0:1787560635.043780:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560635.043782:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f3444b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043788:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f3444b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043804:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3451d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043810:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3451d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043815:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3451d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043820:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbfec00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560635.043823:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3451d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043828:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3451d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043836:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:3.0:1787560635.043838:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560635.043841:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3451d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043856:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3451d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043869:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f345da lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043992:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f345da lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.043998:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f345da lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.044003:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbff800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560635.044006:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f345da lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.044013:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f345da lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.044022:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9caec3203300) 00010000:00010000:3.0:1787560635.044025:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787560635.044028:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f345da lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.044033:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f345da lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560635.045852:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8414:1874392862820864:192.168.203.29@tcp:104: 00010000:00010000:0.0:1787560635.045891:0:8414:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002d4223f7/0x4642c20bf2f34604 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560635.051331:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560635.051483:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853314048 00000100:00100000:0.0:1787560635.051493:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853314048 00000100:00100000:0.0:1787560635.051542:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 50 00000100:00100000:0.0:1787560635.051552:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec39eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+12:2404:x1874392853314048:12345-192.168.203.29@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787560635.052417:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560635.052676:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853314176 00000100:00100000:3.0:1787560635.052684:0:9502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853314176 00010000:00010000:3.0:1787560635.052722:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007760b92b/0x4642c20bf2f343b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd47 expref: 13 pid: 8414 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560635.052779:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 75 00000100:00100000:3.0:1787560635.052791:0:9502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+13:2404:x1874392853314176:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560635.052806:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560635.052815:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007760b92b/0x4642c20bf2f343b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd47 expref: 13 pid: 8414 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.052832:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007760b92b/0x4642c20bf2f343b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd47 expref: 13 pid: 8414 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.052862:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007760b92b/0x4642c20bf2f343b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd47 expref: 13 pid: 8414 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.052885:0:9502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787560635.052890:0:9502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787560635.052895:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002d4223f7/0x4642c20bf2f34604 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.052906:0:9502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d4223f7/0x4642c20bf2f34604 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.052942:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560635.053014:0:9502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+12:2404:x1874392853314176:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 227us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560635.053024:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 75 00010000:00010000:0.0:1787560635.053178:0:8414:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002d4223f7/0x4642c20bf2f34604 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.053187:0:8414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d4223f7/0x4642c20bf2f34604 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.053198:0:8414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d4223f7/0x4642c20bf2f34604 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.053205:0:8414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d4223f7/0x4642c20bf2f34604 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.053233:0:8414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787560635.053421:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3625:x1874392862820736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12932us (13062us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787560635.053457:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:2.0:1787560635.053738:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560635.053747:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d4223f7/0x4642c20bf2f34604 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560635.053757:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880200 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:2.0:1787560635.053762:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d4223f7/0x4642c20bf2f34604 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560635.053773:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d4223f7/0x4642c20bf2f34604 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560635.053787:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d4223f7/0x4642c20bf2f34604 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560635.053796:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d4223f7/0x4642c20bf2f34604 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560635.053814:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560635.053816:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560635.053818:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787560635.054011:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9caffcb09500/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787560635.054032:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862820736:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1787560635.056188:0:9491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:2.0:1787560635.056213:0:9491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:0.0:1787560635.056781:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec39eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+6:2404:x1874392853314048:12345-192.168.203.29@tcp:16:lhsmtool_posix.0 Request processed in 5223us (5452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560635.056794:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 50 00000100:00100000:1.0:1787560635.063921:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560635.064060:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853314432 00000100:00100000:0.0:1787560635.064070:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853314432 00000100:00100000:0.0:1787560635.064139:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 137 00000100:00100000:0.0:1787560635.064151:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+16:11392:x1874392853314432:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787560635.064207:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560635.064236:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f345ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fde1 expref: 16 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.064254:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9caec3203300) 00010000:00010000:0.0:1787560635.064258:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787560635.064286:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34612 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.064300:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34612 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.064309:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34612 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787560635.064421:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000395f824a reply state 000000008907ee08 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34612 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.064476:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34612 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.064501:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9caec3203300) 00010000:00010000:0.0:1787560635.064504:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787560635.064506:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787560635.064608:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+17:11392:x1874392853314432:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 459us (697us total) trans 4294967403 rc 0/0 00000100:00100000:0.0:1787560635.064615:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 137 00000100:00100000:2.0:1787560635.067900:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560635.068081:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853314560 00000100:00100000:3.0:1787560635.068091:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853314560 00000100:00100000:3.0:1787560635.068149:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 51 00000100:00100000:3.0:1787560635.068159:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec39ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+6:2405:x1874392853314560:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787560635.068340:0:8415:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787560635.068344:0:8415:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787560634 00002000:00010000:3.0:1787560635.068347:0:8415:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787560633 00002000:00010000:3.0:1787560635.068349:0:8415:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1787560634 -> 1787560634 00002000:00010000:3.0:1787560635.068351:0:8415:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787560635.068407:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec39ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+7:2405:x1874392853314560:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 Request processed in 249us (516us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787560635.068414:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 51 00000100:00100000:1.0:1787560635.075250:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560635.075326:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853314816 00000100:00100000:0.0:1787560635.075336:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853314816 00000100:00100000:0.0:1787560635.075388:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 138 00000100:00100000:0.0:1787560635.075397:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+17:11392:x1874392853314816:12345-192.168.203.29@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787560635.075492:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34619 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.075508:0:10172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f345d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdd3 expref: 17 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.075518:0:10172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34619 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.075548:0:10172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f345d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdd3 expref: 17 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.075561:0:10172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f345d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdd3 expref: 17 pid: 6499 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560635.075575:0:10172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10172:1874392862821120:192.168.203.29@tcp:104: 00000100:00100000:0.0:1787560635.075653:0:10172:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc599d900 going to sleep for 11 seconds 00000100:00100000:0.0:1787560635.077885:0:10172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10172:1874392862821120:192.168.203.29@tcp:104: 00010000:00010000:0.0:1787560635.077915:0:10172:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34619 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560635.079217:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560635.079299:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853314944 00000100:00100000:3.0:1787560635.079308:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853314944 00010000:00010000:3.0:1787560635.079347:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f345d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdd3 expref: 18 pid: 6499 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560635.079385:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 76 00000100:00100000:3.0:1787560635.079394:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3baca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+18:2404:x1874392853314944:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560635.079409:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560635.079416:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f345d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdd3 expref: 18 pid: 6499 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.079429:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f345d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdd3 expref: 18 pid: 6499 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.079495:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f345d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdd3 expref: 18 pid: 6499 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.079511:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9caec3203300) 00010000:00010000:3.0:1787560635.079516:0:6484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34619 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.079525:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34619 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.079532:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34619 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.079555:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560635.079611:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3baca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+17:2404:x1874392853314944:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 217us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560635.079618:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 76 00010000:00010000:1.0:1787560635.080019:0:10172:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34619 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.080027:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34619 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.080065:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34619 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.080073:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34619 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.080080:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34619 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.080087:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881c00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560635.080091:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34619 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.080099:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34619 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.080118:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9caec3203300) 00010000:00010000:1.0:1787560635.080121:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787560635.080126:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34619 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.080132:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34619 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560635.080174:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+16:11392:x1874392853314816:12345-192.168.203.29@tcp:55:lhsmtool_posix.0 Request processed in 4778us (4934us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787560635.080183:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 138 00000100:00100000:1.0:1787560635.090684:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560635.090797:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853315072 00000100:00100000:0.0:1787560635.090807:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853315072 00000100:00100000:0.0:1787560635.090860:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 52 00000100:00100000:0.0:1787560635.090870:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+7:2404:x1874392853315072:12345-192.168.203.29@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787560635.090912:0:8414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007bc0c534/0x4642c20bf2f34620 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.090931:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a08793e/0x4642c20bf2f345fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdef expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.090940:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560635.090953:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787560635.090958:0:8414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bc0c534/0x4642c20bf2f34620 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.090991:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a08793e/0x4642c20bf2f345fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdef expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.091005:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a08793e/0x4642c20bf2f345fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdef expref: 7 pid: 8415 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560635.091020:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8414:1874392862821248:192.168.203.29@tcp:104: 00000100:00100000:0.0:1787560635.091097:0:8414:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc599d900 going to sleep for 11 seconds 00000100:00100000:0.0:1787560635.094530:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8414:1874392862821248:192.168.203.29@tcp:104: 00010000:00010000:0.0:1787560635.094564:0:8414:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007bc0c534/0x4642c20bf2f34620 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560635.097691:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560635.097776:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853315200 00000100:00100000:3.0:1787560635.097786:0:9502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853315200 00010000:00010000:3.0:1787560635.097826:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a08793e/0x4642c20bf2f345fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdef expref: 8 pid: 8415 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560635.097868:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 77 00000100:00100000:3.0:1787560635.097877:0:9502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+8:2404:x1874392853315200:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560635.097891:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560635.097911:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a08793e/0x4642c20bf2f345fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdef expref: 8 pid: 8415 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.097954:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a08793e/0x4642c20bf2f345fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdef expref: 8 pid: 8415 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.097978:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a08793e/0x4642c20bf2f345fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdef expref: 8 pid: 8415 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.097994:0:9502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787560635.097999:0:9502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787560635.098004:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007bc0c534/0x4642c20bf2f34620 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.098013:0:9502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bc0c534/0x4642c20bf2f34620 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.098049:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560635.098114:0:9502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+7:2404:x1874392853315200:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 238us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560635.098122:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 77 00010000:00010000:0.0:1787560635.098543:0:8414:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007bc0c534/0x4642c20bf2f34620 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.098554:0:8414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007bc0c534/0x4642c20bf2f34620 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.098575:0:8414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007bc0c534/0x4642c20bf2f34620 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.098584:0:8414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007bc0c534/0x4642c20bf2f34620 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.098592:0:8414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007bc0c534/0x4642c20bf2f34620 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.098598:0:8414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881a00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560635.098602:0:8414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007bc0c534/0x4642c20bf2f34620 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.098611:0:8414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007bc0c534/0x4642c20bf2f34620 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.098652:0:8414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007bc0c534/0x4642c20bf2f34620 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.098660:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007bc0c534/0x4642c20bf2f34620 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560635.098730:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+6:2404:x1874392853315072:12345-192.168.203.29@tcp:1:lhsmtool_posix.0 Request processed in 7859us (8055us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560635.098739:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 52 00000100:00100000:1.0:1787560635.106692:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560635.106773:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853315456 00000100:00100000:0.0:1787560635.106785:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853315456 00000100:00100000:0.0:1787560635.106851:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 139 00000100:00100000:0.0:1787560635.106862:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+16:11392:x1874392853315456:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787560635.106988:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34627 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.107007:0:13787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34516 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd9b expref: 16 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.107018:0:13787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34627 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.107054:0:13787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34516 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd9b expref: 16 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.107068:0:13787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34516 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd9b expref: 16 pid: 10172 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560635.107093:0:13787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13787:1874392862821376:192.168.203.29@tcp:104: 00000100:00100000:0.0:1787560635.107182:0:13787:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc599d900 going to sleep for 11 seconds 00000100:00100000:0.0:1787560635.110372:0:13787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13787:1874392862821376:192.168.203.29@tcp:104: 00010000:00010000:0.0:1787560635.110403:0:13787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34627 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560635.114786:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560635.114865:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853315584 00000100:00100000:3.0:1787560635.114880:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853315584 00010000:00010000:3.0:1787560635.114923:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34516 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd9b expref: 17 pid: 10172 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560635.114973:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 78 00000100:00100000:3.0:1787560635.114983:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+17:2404:x1874392853315584:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560635.115015:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560635.115022:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34516 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd9b expref: 17 pid: 10172 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.115037:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34516 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd9b expref: 17 pid: 10172 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.115062:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34516 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd9b expref: 17 pid: 10172 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.115079:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:3.0:1787560635.115085:0:6484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f34578 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdbe expref: 16 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.115095:0:6484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34627 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.115104:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34627 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.115111:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34627 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.115145:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560635.115206:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+16:2404:x1874392853315584:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 224us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560635.115213:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 78 00010000:00010000:1.0:1787560635.115568:0:13787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34627 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.115577:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34627 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.116411:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3462e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.116428:0:13787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f345e1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdda expref: 16 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.116760:0:13787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3462e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.116816:0:13787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f345e1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdda expref: 16 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.116831:0:13787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f345e1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdda expref: 16 pid: 6500 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560635.116848:0:13787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3baed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13787:1874392862821504:192.168.203.29@tcp:104: 00000100:00100000:1.0:1787560635.117219:0:13787:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c4b480 going to sleep for 11 seconds 00000100:00100000:1.0:1787560635.126029:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560635.126150:0:13787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3baed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13787:1874392862821504:192.168.203.29@tcp:104: 00010000:00010000:0.0:1787560635.126181:0:13787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3462e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560635.126253:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853315712 00000100:00100000:3.0:1787560635.126263:0:9502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853315712 00010000:00010000:3.0:1787560635.126312:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f345e1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdda expref: 17 pid: 6500 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560635.126350:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 79 00000100:00100000:3.0:1787560635.126359:0:9502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3badf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+17:2404:x1874392853315712:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560635.126373:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560635.126380:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f345e1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdda expref: 17 pid: 6500 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.126391:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f345e1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdda expref: 17 pid: 6500 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.126413:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f345e1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdda expref: 17 pid: 6500 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.126466:0:9502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9caec3203300) 00010000:00010000:3.0:1787560635.126471:0:9502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3462e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.126480:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3462e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.126487:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3462e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.126518:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560635.126573:0:9502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3badf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+16:2404:x1874392853315712:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 213us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560635.126580:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 79 00010000:00010000:2.0:1787560635.126767:0:13787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3462e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560635.126784:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3462e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787560635.126888:0:13787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1787560635.127010:0:13787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1787560635.127053:0:13787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1787560635.127126:0:13787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec39ece00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13787:1874392862821632:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787560635.127182:0:13787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560635.127209:0:13787:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd8640b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787560635.130964:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862821632 00000100:00100000:3.0:1787560635.130980:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862821632 00000100:00100000:3.0:1787560635.131051:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787560635.131062:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec39ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:13787:x1874392862821632:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787560635.131230:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec39ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:13787:x1874392862821632:12345-0@lo:1000:mdt00_004.0 Request processed in 169us (4047us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560635.131237:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787560635.131358:0:13787:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:2.0:1787560635.131364:0:13787:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:2.0:1787560635.131387:0:13787:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9caffcb09500 x1874392862820736/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787560651 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560635.131399:0:13787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec39ece00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13787:1874392862821632:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1787560635.131575:0:13787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1787560635.131649:0:13787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec39ece00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13787:1874392862821760:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787560635.131687:0:13787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560635.131717:0:13787:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc7ed4600 going to sleep for 11 seconds 00000100:00100000:1.0:1787560635.131774:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862821760 00000100:00100000:1.0:1787560635.131779:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862821760 00000100:00100000:1.0:1787560635.131817:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787560635.131825:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec39ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:13787:x1874392862821760:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787560635.131964:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec39ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:13787:x1874392862821760:12345-0@lo:1000:mdt00_004.0 Request processed in 140us (275us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1787560635.131971:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787560635.132048:0:13787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec39ece00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13787:1874392862821760:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1787560635.132084:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3462e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.132095:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3462e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.132103:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3462e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.132109:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbff800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560635.132114:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3462e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.132122:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3462e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.132147:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9caec3203300) 00010000:00010000:0.0:1787560635.132150:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787560635.132155:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3462e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.132161:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3462e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.132185:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34571 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.132191:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34571 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.132198:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34571 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.132203:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7000 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560635.132206:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34571 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.132211:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34571 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.132218:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:0.0:1787560635.132220:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787560635.132227:0:13787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f34578 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdbe expref: 19 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.132238:0:13787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f34578 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdbe expref: 19 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.132253:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f34578 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdbe expref: 19 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.132281:0:13787:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f34578 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdbe expref: 19 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560635.132291:0:13787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13787:1874392862821888:192.168.203.29@tcp:105: 00000100:00100000:0.0:1787560635.132366:0:13787:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc599d900 going to sleep for 11 seconds 00000100:00100000:1.0:1787560635.136368:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560635.136490:0:13787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13787:1874392862821888:192.168.203.29@tcp:105: 00010000:00010000:0.0:1787560635.136520:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34571 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.136531:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34571 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.136564:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34635 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.136578:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34635 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.136589:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34635 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.136599:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34635 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.136605:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34635 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.136626:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34635 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.136632:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881a00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560635.136635:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34635 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.136643:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34635 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.136655:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:0.0:1787560635.136658:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560635.136662:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34635 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.136667:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34635 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.136676:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34627 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.136682:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34627 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.136687:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34627 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.136692:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881c00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560635.136694:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34627 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.136711:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34627 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.136720:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:0.0:1787560635.136722:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787560635.136725:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34627 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560635.136731:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34627 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560635.136903:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+19:11392:x1874392853315456:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 30041us (30219us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1787560635.136914:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 139 00000020:00080000:0.0:1787560635.136920:0:13787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1787560635.137030:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853315840 00000100:00100000:2.0:1787560635.137037:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853315840 00000100:00100000:2.0:1787560635.137085:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 31 00000100:00100000:2.0:1787560635.137095:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+19:11391:x1874392853315840:12345-192.168.203.29@tcp:49:lfs.0 00000100:00100000:2.0:1787560635.137184:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+19:11391:x1874392853315840:12345-192.168.203.29@tcp:49:lfs.0 Request processed in 91us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560635.137191:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 31 00000040:00080000:1.0:1787560635.137346:0:13775:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787560635.137351:0:13775:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787560635.137890:0:13775:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787560635.137902:0:13775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787560635.144888:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560635.144936:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560635.145022:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853316096 00000100:00100000:2.0:1787560635.145048:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853316096 00000100:00100000:2.0:1787560635.145107:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 32 00000100:00100000:2.0:1787560635.145118:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd7c07c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+19:11392:x1874392853316096:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787560635.145380:0:6502:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787560635.145413:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:2.0:1787560635.145498:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f3463c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560635.145516:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f3463c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560635.145528:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f3463c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560635.145537:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f3463c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560635.145544:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f3463c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560635.145551:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f3463c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560635.145569:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787560635.145652:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd7c07c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+21:11392:x1874392853316096:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 536us (785us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1787560635.145660:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 32 00000020:00080000:2.0:1787560635.145665:0:6502:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787560635.145808:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853316352 00000100:00100000:3.0:1787560635.145814:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853316352 00000100:00100000:3.0:1787560635.145851:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 140 00000100:00100000:3.0:1787560635.145858:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+21:11391:x1874392853316352:12345-192.168.203.29@tcp:58:lfs.0 00000040:00080000:3.0:1787560635.145984:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1787560635.146036:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+21:11391:x1874392853316352:12345-192.168.203.29@tcp:58:lfs.0 Request processed in 178us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560635.146043:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 140 00010000:00010000:1.0:1787560635.146308:0:9500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560635.146316:0:9500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f3463c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.146339:0:9500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168200 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560635.146343:0:9500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f3463c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.146351:0:9500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f3463c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.146365:0:9500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9caec3203300) 00010000:00010000:1.0:1787560635.146368:0:9500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787560635.146372:0:9500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f3463c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.146378:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f3463c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.146396:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560635.146397:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560635.146399:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560635.187474:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560635.187575:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853316480 00000100:00100000:1.0:1787560635.187590:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853316480 00000100:00100000:1.0:1787560635.187654:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 141 00000100:00100000:1.0:1787560635.187671:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+21:11394:x1874392853316480:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:1.0:1787560635.187705:0:10172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560635.187731:0:10172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f34643 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fdf6 expref: -99 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.187815:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3464a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.187857:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3464a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.187882:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3464a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.187902:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f34651 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.187913:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f34651 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.187920:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f34651 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.188008:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f34658 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.188019:0:10172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34563 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdb7 expref: 22 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.188027:0:10172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f34658 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.188063:0:10172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34563 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdb7 expref: 22 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.188078:0:10172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34563 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdb7 expref: 22 pid: 6498 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560635.188107:0:10172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bae680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10172:1874392862822016:192.168.203.29@tcp:104: 00000100:00100000:1.0:1787560635.188234:0:10172:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c4b900 going to sleep for 11 seconds 00000100:00100000:0.0:1787560635.193638:0:10172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bae680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10172:1874392862822016:192.168.203.29@tcp:104: 00010000:00010000:0.0:1787560635.193672:0:10172:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f34658 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560635.194486:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560635.194596:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853316736 00000100:00100000:2.0:1787560635.194604:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853316736 00000100:00100000:2.0:1787560635.194658:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 33 00000100:00100000:2.0:1787560635.194680:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+23:6644:x1874392853316736:12345-192.168.203.29@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787560635.194888:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+24:6644:x1874392853316736:12345-192.168.203.29@tcp:35:ldlm_bl.0 Request processed in 209us (404us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1787560635.194895:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 33 00000100:00100000:1.0:1787560635.200642:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560635.200756:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853316864 00000100:00100000:3.0:1787560635.200766:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853316864 00010000:00010000:3.0:1787560635.200809:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34563 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdb7 expref: 24 pid: 6498 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560635.200849:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 80 00000100:00100000:3.0:1787560635.200860:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3baea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+24:2404:x1874392853316864:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560635.200874:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560635.200882:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34563 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdb7 expref: 24 pid: 6498 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.200916:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34563 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdb7 expref: 24 pid: 6498 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.200939:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34563 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdb7 expref: 24 pid: 6498 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.200966:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:3.0:1787560635.200971:0:6484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f34658 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.200979:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f34658 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.200987:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f34658 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560635.201019:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560635.201082:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3baea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+23:2404:x1874392853316864:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 223us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560635.201089:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 80 00010000:00010000:1.0:1787560635.201343:0:10172:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f34658 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.201351:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f34658 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560635.201401:0:10172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787560635.201406:0:10172:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787560635.201424:0:10172:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f34658 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.201485:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f34658 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.201496:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3464a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.201503:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3464a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.201509:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3464a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.201515:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbff800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560635.201519:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3464a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.201538:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3464a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.201547:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:1.0:1787560635.201550:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560635.201554:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3464a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.201560:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f3464a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.201571:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f34651 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.201577:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f34651 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.201582:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f34651 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.201587:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbfec00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560635.201590:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f34651 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.201596:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f34651 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.201603:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9caec3203600) 00010000:00010000:1.0:1787560635.201606:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560635.201609:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f34651 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.201625:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f34651 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.201660:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f34643 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdf6 expref: 23 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.201673:0:10172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f34658 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdf6 expref: 22 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560635.201680:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:1.0:1787560635.201682:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787560635.201685:0:10172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbff600, rc 0) 00000100:00100000:1.0:1787560635.201720:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+22:11394:x1874392853316480:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 14052us (14291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560635.201727:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 141 00010000:00010000:2.0:1787560635.379544:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560635.445698:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787560635.445720:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec39eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862822144:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787560635.445789:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560635.445855:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862822144 00000100:00100000:2.0:1787560635.445861:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862822144 00000100:00100000:2.0:1787560635.445915:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787560635.445924:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec39edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862822144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787560635.445966:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1787560635.446009:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec39edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862822144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560635.446016:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787560635.446060:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec39eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862822144:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1787560635.906484:0:14240:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787560635.906491:0:14240:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787560635.906515:0:14240:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787560635.906521:0:14240:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787560636.147968:0:13775:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787560636.147978:0:13775:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787560636.148024:0:13775:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787560636.148036:0:13775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787560636.148171:0:13775:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bae680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13775:1874392862822272:192.168.203.29@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787560636.148290:0:13775:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c4b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560636.159378:0:13775:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bae680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13775:1874392862822272:192.168.203.29@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787560636.164089:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560636.164147:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853316992 00000100:00100000:0.0:1787560636.164157:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853316992 00000100:00100000:0.0:1787560636.164239:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 142 00000100:00100000:0.0:1787560636.164251:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3a19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+22:11406:x1874392853316992:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787560636.164295:0:13787:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787560636.164420:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3a19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+22:11406:x1874392853316992:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 Request processed in 172us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560636.164449:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 142 00000100:00080000:3.0:1787560636.164743:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560636.171677:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560636.171806:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853317248 00000100:00100000:0.0:1787560636.171818:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853317248 00000100:00100000:0.0:1787560636.171899:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 143 00000100:00100000:0.0:1787560636.171912:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec39eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+22:11406:x1874392853317248:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787560636.171945:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560636.171971:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f3465f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fdfd expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560636.172089:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34666 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560636.172102:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34666 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560636.172114:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34666 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560636.172126:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787560636.172244:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f3465f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdfd expref: 25 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560636.172263:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34666 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdfd expref: 24 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560636.172271:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:0.0:1787560636.172274:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787560636.172278:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881a00, rc 0) 00000100:00100000:0.0:1787560636.172342:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec39eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+24:11406:x1874392853317248:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 433us (674us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1787560636.172364:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 143 00000100:00100000:2.0:1787560636.184714:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560636.184758:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560636.184852:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853317632 00000100:00100000:1.0:1787560636.184862:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853317632 00000100:00100000:1.0:1787560636.184932:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 144 00000100:00100000:1.0:1787560636.184951:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec39ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+24:11406:x1874392853317632:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787560636.185026:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f34674 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560636.185042:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f34674 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560636.185054:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f34674 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560636.185200:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f34674 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560636.185207:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f34674 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560636.185213:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f34674 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560636.185232:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbff800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560636.185236:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f34674 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560636.185243:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f34674 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560636.185255:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:1.0:1787560636.185258:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787560636.185277:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f34674 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560636.185283:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f34674 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560636.185410:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec39ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+25:11406:x1874392853317632:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 461us (650us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1787560636.185419:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 144 00000040:00080000:2.0:1787560636.185907:0:13775:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787560636.185912:0:13775:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787560636.186410:0:13775:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787560636.186420:0:13775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787560636.187149:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853317376 00000100:00100000:3.0:1787560636.187158:0:9502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853317376 00000100:00100000:3.0:1787560636.187231:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:3.0:1787560636.187242:0:9502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd7cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+25:2405:x1874392853317376:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560636.187255:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560636.187289:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34666 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdfd expref: 25 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560636.187305:0:9502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:3.0:1787560636.187310:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560636.187367:0:9502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd7cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+24:2405:x1874392853317376:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 127us (2661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560636.187374:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:2.0:1787560636.189933:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560636.190020:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853317888 00000100:00100000:1.0:1787560636.190029:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853317888 00000100:00100000:1.0:1787560636.190084:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 34 00000100:00100000:1.0:1787560636.190095:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec39ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+24:11406:x1874392853317888:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787560636.190317:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec39ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+25:11406:x1874392853317888:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 224us (393us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1787560636.190325:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 34 00010000:00010000:1.0:1787560636.409020:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560636.421056:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560636.421100:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560636.421139:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560636.421170:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560636.421190:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560636.421230:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560636.421257:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853318144 00000100:00100000:0.0:1787560636.421266:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853318144 00000100:00100000:0.0:1787560636.421316:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853318656 00000100:00100000:0.0:1787560636.421320:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853318656 00000100:00100000:0.0:1787560636.421339:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853318528 00000100:00100000:0.0:1787560636.421342:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853318528 00000100:00100000:0.0:1787560636.421361:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 281 00000100:00100000:0.0:1787560636.421371:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+5:2402:x1874392853318144:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560636.421482:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853318272 00000100:00100000:3.0:1787560636.421486:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853318272 00000100:00100000:3.0:1787560636.421513:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853318400 00000100:00100000:3.0:1787560636.421516:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853318400 00000100:00100000:3.0:1787560636.421537:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 107 00000100:00100000:3.0:1787560636.421544:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+9:2403:x1874392853318272:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560636.421605:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+9:2403:x1874392853318272:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 61us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560636.421612:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 107 00000100:00100000:3.0:1787560636.421629:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 108 00000100:00100000:3.0:1787560636.421636:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+6:2402:x1874392853318400:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560636.421660:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+6:2402:x1874392853318400:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 25us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560636.421666:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 108 00000100:00100000:3.0:1787560636.421685:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 282 00000100:00100000:3.0:1787560636.421692:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2402:x1874392853318656:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560636.421716:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2402:x1874392853318656:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 25us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560636.421735:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 282 00000100:00100000:3.0:1787560636.421752:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 283 00000100:00100000:3.0:1787560636.421758:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853318528:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560636.421783:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853318528:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 25us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560636.421789:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 283 00000100:00080000:3.0:1787560636.421805:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787560636.421808:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787560636.421810:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787560636.421812:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787560636.422051:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+5:2402:x1874392853318144:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 681us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560636.422058:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 281 00000100:00100000:1.0:1787560636.422552:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853318016 00000100:00100000:1.0:1787560636.422559:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853318016 00000100:00100000:1.0:1787560636.422601:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 379 00000100:00100000:1.0:1787560636.422609:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+13:2403:x1874392853318016:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560636.422653:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+13:2403:x1874392853318016:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 45us (1607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560636.422660:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 379 00000100:00100000:3.0:1787560636.467760:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862822400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787560636.467847:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560636.468055:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862822400 00000100:00100000:0.0:1787560636.468063:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862822400 00000100:00100000:0.0:1787560636.468118:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787560636.468128:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862822400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787560636.468161:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787560636.468316:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862822400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 189us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560636.468323:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000001:00080000:0.0:1787560636.471456:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:0.0:1787560636.471475:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1787560636.471816:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862822400:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787560637.428519:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787560637.955982:0:14292:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787560637.955993:0:14292:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787560637.956273:0:14292:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787560637.956282:0:14292:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787560638.003881:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862822528:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787560638.003969:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560638.004122:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862822528 00000100:00100000:1.0:1787560638.004130:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862822528 00000100:00100000:1.0:1787560638.004198:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787560638.004208:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3a18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862822528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787560638.004247:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787560638.004299:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3a18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862822528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560638.004306:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787560638.004353:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862822528:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787560638.004508:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862822656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787560638.004540:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560638.004581:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862822656 00000100:00100000:0.0:1787560638.004586:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862822656 00000100:00100000:0.0:1787560638.004613:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787560638.004620:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862822656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787560638.004631:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560638.004674:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862822656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560638.004681:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787560638.004703:0:3623:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1787560638.004709:0:3623:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:0.0:1787560638.004723:0:3623:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9caec33c4700, transno 4294967302 00000004:00080000:0.0:1787560638.004733:0:3623:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:0.0:1787560638.004747:0:3623:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9caec3badc00, transno 4294967305 00000100:00100000:0.0:1787560638.004756:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862822656:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787560638.005461:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787560638.193616:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560638.193713:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853318912 00000100:00100000:2.0:1787560638.193723:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853318912 00000100:00100000:2.0:1787560638.193781:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 145 00000100:00100000:2.0:1787560638.193793:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+25:11427:x1874392853318912:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1787560638.193829:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560638.193851:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f3467b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fe04 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560638.193964:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f34682 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560638.193977:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f34682 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560638.193989:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f34682 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560638.193998:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787560638.194087:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f3467b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe04 expref: 28 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560638.194103:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f34682 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe04 expref: 27 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560638.194111:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:2.0:1787560638.194113:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787560638.194116:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2169200, rc 0) 00000100:00100000:2.0:1787560638.194171:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+27:11427:x1874392853318912:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 381us (564us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1787560638.194188:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 145 00000100:00080000:3.0:1787560638.194337:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560638.206637:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560638.212934:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853319040 00000100:00100000:0.0:1787560638.212948:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853319040 00000100:00100000:0.0:1787560638.213015:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 146 00000100:00100000:0.0:1787560638.213026:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3a18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+27:11427:x1874392853319040:12345-192.168.203.29@tcp:54:lfs.0 00010000:00010000:0.0:1787560638.213092:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34690 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560638.213108:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34690 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560638.213137:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34690 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560638.213177:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34690 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560638.213184:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34690 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560638.213191:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34690 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560638.213196:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560638.213201:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34690 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560638.213208:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34690 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560638.213220:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:0.0:1787560638.213223:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787560638.213227:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34690 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560638.213232:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34690 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560638.213308:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3a18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+27:11427:x1874392853319040:12345-192.168.203.29@tcp:54:lfs.0 Request processed in 283us (6677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560638.213316:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 146 00000100:00100000:2.0:1787560638.352722:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560638.354687:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853319168 00000100:00100000:3.0:1787560638.354701:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853319168 00000100:00100000:3.0:1787560638.355211:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 53 00000100:00100000:3.0:1787560638.355239:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4aa6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+6:2403:x1874392853319168:12345-192.168.203.29@tcp:101:cat.0 00010000:00010000:3.0:1787560638.355257:0:8415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560638.355278:0:8415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab9165b8/0x4642c20bf2f34697 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fe0b expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787560638.355304:0:8415:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a8c02ba, atime: 0x6a8c02b9, ctime: 0x6a8c02ba, blocks: 0x8 00010000:00010000:3.0:1787560638.355323:0:8415:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=357s v=(0 0) 00010000:00010000:3.0:1787560638.355328:0:8415:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560638.355336:0:8415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab9165b8/0x4642c20bf2f34697 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe0b expref: 7 pid: 8415 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560638.355355:0:8415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ab9165b8/0x4642c20bf2f34697 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe0b expref: 7 pid: 8415 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560638.355368:0:8415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f7600, rc 0) 00000100:00100000:3.0:1787560638.355519:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4aa6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+7:2403:x1874392853319168:12345-192.168.203.29@tcp:101:cat.0 Request processed in 282us (2806us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560638.355526:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 53 00000100:00080000:0.0:1787560638.356715:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787560638.363262:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560638.363358:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853319296 00000100:00100000:2.0:1787560638.363368:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853319296 00002000:00100000:2.0:1787560638.363419:0:8420:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9caec33c4380 x1874392853319296/t0(0) o3->9331bacf-6cfc-4379-8649-925e79b19df1@192.168.203.29@tcp:754/0 lens 488/0 e 0 to 0 dl 1787560649 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787560638.363465:0:8420:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9caec33c4380 with x1874392853319296 ext(0->4095) 00002000:00010000:2.0:1787560638.363472:0:8420:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9caec33c4380 00000100:00100000:2.0:1787560638.363502:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:2.0:1787560638.363513:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9331bacf-6cfc-4379-8649-925e79b19df1+7:2402:x1874392853319296:12345-192.168.203.29@tcp:3:cat.0 00000100:00100000:2.0:1787560638.363694:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9331bacf-6cfc-4379-8649-925e79b19df1+7:2402:x1874392853319296:12345-192.168.203.29@tcp:3:cat.0 Request processed in 181us (441us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787560638.363701:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 3 00002000:00100000:2.0:1787560638.363708:0:8420:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9caec33c4380 x1874392853319296/t0(0) o3->9331bacf-6cfc-4379-8649-925e79b19df1@192.168.203.29@tcp:754/0 lens 488/4536 e 0 to 0 dl 1787560649 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787560638.363716:0:8420:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9caec33c4380 with x1874392853319296 ext(0->4095) 00002000:00010000:2.0:1787560638.363719:0:8420:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9caec33c4380 00010000:00010000:1.0:1787560638.455410:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560639.027763:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862822784:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560639.027832:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787560639.028144:0:9935:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 358367710412ns, next at 359367707941ns, rc = 0 00000100:00100000:2.0:1787560639.028211:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787560639.028222:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec39ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862822912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560639.028254:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560639.028286:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862822784 00000100:00100000:2.0:1787560639.028292:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862822784 00000100:00100000:2.0:1787560639.028339:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862822912 00000100:00100000:2.0:1787560639.028351:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862822912 00000100:00100000:2.0:1787560639.028372:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787560639.028381:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862822784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787560639.028406:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787560639.028479:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862822784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560639.028487:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787560639.028504:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787560639.028511:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec39eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3626:x1874392862822912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787560639.028521:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787560639.028547:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec39eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3626:x1874392862822912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560639.028554:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:2.0:1787560639.028568:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787560639.028598:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec39ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862822912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787560639.028856:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862822784:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560639.029712:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3a18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862823168:0@lo:400:kworker.0 00000100:00100000:0.0:1787560639.029753:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560639.029792:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3a19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874392862823680:0@lo:400:kworker.0 00000100:00100000:0.0:1787560639.029822:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560639.029937:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862823040:0@lo:400:kworker.0 00000100:00100000:2.0:1787560639.029969:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560639.029989:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3a1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862823552:0@lo:400:kworker.0 00000100:00100000:2.0:1787560639.030011:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560639.030028:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862824064:0@lo:400:kworker.0 00000100:00100000:2.0:1787560639.030050:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560639.030067:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787560639.030073:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874392862823424:0@lo:400:kworker.0 00000100:00100000:2.0:1787560639.030094:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560639.030110:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862823936:0@lo:400:kworker.0 00000100:00100000:2.0:1787560639.030140:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560639.030168:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862823552 00000100:00100000:2.0:1787560639.030173:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862823552 00000100:00100000:0.0:1787560639.030292:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3a1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874392862824192:0@lo:400:kworker.0 00000100:00100000:0.0:1787560639.030319:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560639.030337:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787560639.030342:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3a18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862823296:0@lo:400:kworker.0 00000100:00100000:0.0:1787560639.030363:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560639.030377:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3a1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862823808:0@lo:400:kworker.0 00000100:00100000:0.0:1787560639.030394:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560639.030410:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862824320:0@lo:400:kworker.0 00000100:00100000:0.0:1787560639.030429:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560639.030555:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862823168 00000100:00100000:3.0:1787560639.030560:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862823168 00000100:00100000:3.0:1787560639.030584:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862823680 00000100:00100000:3.0:1787560639.030587:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862823680 00000100:00100000:3.0:1787560639.030607:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862823424 00000100:00100000:3.0:1787560639.030609:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862823424 00000100:00100000:3.0:1787560639.030621:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1787560639.030629:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862823168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560639.030672:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862823168:12345-0@lo:400:kworker.0 Request processed in 43us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560639.030685:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1787560639.030699:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862824192 00000100:00100000:3.0:1787560639.030702:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862824192 00000100:00100000:3.0:1787560639.030714:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862823808 00000100:00100000:3.0:1787560639.030717:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862823808 00000100:00100000:3.0:1787560639.030729:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1787560639.030734:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874392862823680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560639.030763:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874392862823680:12345-0@lo:400:kworker.0 Request processed in 28us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560639.030768:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1787560639.030780:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787560639.030786:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec39ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874392862823424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560639.030816:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec39ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874392862823424:12345-0@lo:400:kworker.0 Request processed in 30us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560639.030822:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787560639.030833:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1787560639.030839:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874392862824192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560639.031340:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3a18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862823168:0@lo:400:kworker.0 00000100:00100000:0.0:1787560639.031352:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3a19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874392862823680:0@lo:400:kworker.0 00000100:00100000:0.0:1787560639.031381:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862824320 00000100:00100000:0.0:1787560639.031385:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862824320 00000100:00100000:0.0:1787560639.031410:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1787560639.031416:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862823808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560639.031557:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862823296 00000100:00100000:2.0:1787560639.031561:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862823296 00000100:00100000:2.0:1787560639.031580:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787560639.031586:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec39ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862823552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560639.031622:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec39ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862823552:12345-0@lo:400:kworker.0 Request processed in 36us (1610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560639.031629:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787560639.031643:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787560639.031649:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862823296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560639.031678:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862823296:12345-0@lo:400:kworker.0 Request processed in 29us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560639.031684:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787560639.031701:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862824064 00000100:00100000:2.0:1787560639.031704:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862824064 00000100:00100000:2.0:1787560639.031723:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862823936 00000100:00100000:2.0:1787560639.031725:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862823936 00000100:00100000:2.0:1787560639.031742:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787560639.031761:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec39ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862824064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560639.031790:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec39ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862824064:12345-0@lo:400:kworker.0 Request processed in 30us (1739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560639.031797:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787560639.031808:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787560639.031813:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec39efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862823936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560639.031836:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec39efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862823936:12345-0@lo:400:kworker.0 Request processed in 23us (1695us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560639.031966:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874392862824192:12345-0@lo:400:kworker.0 Request processed in 1127us (1646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560639.031974:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1787560639.031986:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1787560639.031993:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874392862824320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560639.032015:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874392862824320:12345-0@lo:400:kworker.0 Request processed in 24us (1586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560639.032021:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1787560639.032169:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862823808:12345-0@lo:400:kworker.0 Request processed in 753us (1773us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560639.032182:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1787560639.032558:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862823040 00000100:00100000:0.0:1787560639.032564:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862823040 00000100:00100000:0.0:1787560639.032594:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1787560639.032601:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3626:x1874392862823040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560639.032634:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3626:x1874392862823040:12345-0@lo:400:kworker.0 Request processed in 34us (2665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560639.032641:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1787560639.032698:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3a18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862823296:0@lo:400:kworker.0 00010000:00080000:0.0:1787560639.032711:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3a1a300 x1874392862823808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560639.032722:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3a1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862823808:0@lo:400:kworker.0 00010000:00080000:0.0:1787560639.032731:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3a1b800 x1874392862824320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560639.032740:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862824320:0@lo:400:kworker.0 00000100:00100000:0.0:1787560639.032751:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3a1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874392862824192:0@lo:400:kworker.0 00000100:00080000:0.0:1787560639.032802:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787560639.032807:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560639.032833:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874392862823424:0@lo:400:kworker.0 00000100:00100000:2.0:1787560639.033008:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787560639.033952:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862823936:0@lo:400:kworker.0 00000100:00100000:0.0:1787560639.033976:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862823040:0@lo:400:kworker.0 00000100:00100000:0.0:1787560639.033988:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3a1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862823552:0@lo:400:kworker.0 00000100:00100000:0.0:1787560639.034009:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862824064:0@lo:400:kworker.0 00010000:00010000:2.0:1787560639.476449:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560640.510140:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560640.563719:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec39edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862824448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787560640.563841:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560640.563990:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862824448 00000100:00100000:3.0:1787560640.564002:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862824448 00000004:00080000:1.0:1787560640.571775:0:6478:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000100:00100000:0.0:1787560640.572307:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862824576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787560640.572382:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560640.572475:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862824576 00000100:00100000:0.0:1787560640.572483:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862824576 00000100:00100000:0.0:1787560640.572536:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787560640.572547:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3626:x1874392862824576:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787560640.572682:0:10171:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787560640.572686:0:10171:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1787560634 -> 1787560634 00002000:00010000:0.0:1787560640.572690:0:10171:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 1787560633 -> 1787560633 00002000:00010000:0.0:1787560640.572693:0:10171:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1787560634 -> 1787560634 00002000:00010000:0.0:1787560640.572695:0:10171:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000001:00080000:1.0:1787560640.573161:0:6478:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1787560640.573263:0:6478:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cafd8640b40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1787560640.573267:0:6478:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9caec1fc4e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cafd8640840 00000020:00080000:1.0:1787560640.573271:0:6478:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9caec1fc4000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9caec219a800 00000020:00080000:1.0:1787560640.573289:0:6478:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1787560640.573303:0:6530:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1787560640.573347:0:6530:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1787560640.573375:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34612 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560640.573385:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34612 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560640.573393:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34612 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560640.573399:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881000 already unused, calling callback (ffffffffc1a234f0) 00000100:00100000:0.0:1787560640.573539:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3626:x1874392862824576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 992us (1156us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1787560640.573548:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:2.0:1787560640.573603:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cafffe4f100/2, rc 0, transno 4294967313 00000100:00100000:2.0:1787560640.573611:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862824576:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1787560640.573654:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34612 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560640.573679:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34612 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560640.573697:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9caec3203300) 00010000:00010000:1.0:1787560640.573700:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560640.573704:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34612 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560640.573711:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34612 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787560640.574514:0:9491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:1.0:1787560640.574524:0:9491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000100:00100000:3.0:1787560640.577419:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787560640.577473:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862824448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787560640.577528:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1787560640.578064:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862824448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 609us (14220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560640.578075:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787560640.578158:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec39edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862824448:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787560641.526719:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560641.535471:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560641.535538:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560641.535572:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560641.535584:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853319552 00000100:00100000:0.0:1787560641.535586:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853319424 00000100:00100000:3.0:1787560641.535599:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853319552 00000100:00100000:0.0:1787560641.535600:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853319424 00000100:00100000:2.0:1787560641.535601:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560641.535629:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560641.535655:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560641.535674:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853320064 00000100:00100000:3.0:1787560641.535681:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853320064 00000100:00100000:0.0:1787560641.535681:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 381 00000100:00100000:2.0:1787560641.535689:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560641.535706:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+13:2404:x1874392853319424:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560641.535717:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853319680 00000100:00100000:3.0:1787560641.535721:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853319680 00000100:00100000:3.0:1787560641.535739:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853320192 00000100:00100000:3.0:1787560641.535742:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853320192 00000100:00100000:3.0:1787560641.535762:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 290 00000100:00100000:3.0:1787560641.535771:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec39edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+13:2405:x1874392853319552:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560641.535803:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+13:2404:x1874392853319424:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 109us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560641.535813:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 381 00000100:00080000:0.0:1787560641.535850:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787560641.535855:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560641.535873:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 291 00000100:00100000:0.0:1787560641.535881:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec39ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2405:x1874392853320064:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560641.535951:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec39ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2405:x1874392853320064:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 62us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560641.535958:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 291 00000100:00100000:0.0:1787560641.535975:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 292 00000100:00100000:3.0:1787560641.535983:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec39edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+13:2405:x1874392853319552:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 44us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560641.535984:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec39ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+5:2404:x1874392853319680:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560641.535999:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 290 00000100:00100000:3.0:1787560641.536017:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 293 00000100:00100000:0.0:1787560641.536023:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec39ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+5:2404:x1874392853319680:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 39us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560641.536031:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec39ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2404:x1874392853320192:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560641.536035:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 292 00000100:00100000:3.0:1787560641.536079:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec39ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2404:x1874392853320192:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 41us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560641.536100:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 293 00000100:00100000:2.0:1787560641.536591:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853319808 00000100:00100000:2.0:1787560641.536600:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853319808 00000100:00100000:2.0:1787560641.536674:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853319936 00000100:00100000:2.0:1787560641.536678:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853319936 00000100:00100000:2.0:1787560641.536707:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 111 00000100:00100000:2.0:1787560641.536717:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec39ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+5:2405:x1874392853319808:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560641.536727:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 112 00000100:00100000:3.0:1787560641.536739:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec39eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:2404:x1874392853319936:12345-192.168.203.29@tcp:400:kworker.0 00000100:00080000:0.0:1787560641.536802:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787560641.536807:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787560641.536893:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec39ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+5:2405:x1874392853319808:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 171us (1313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560641.536912:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 111 00000100:00100000:3.0:1787560641.537785:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec39eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:2404:x1874392853319936:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 1041us (2123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560641.537796:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 112 00000100:00100000:2.0:1787560641.588768:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862824704:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787560641.588874:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560641.589119:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862824704 00000100:00100000:0.0:1787560641.589129:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862824704 00000100:00100000:0.0:1787560641.589200:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787560641.589211:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862824704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787560641.589255:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787560641.589318:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862824704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560641.589326:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787560641.589376:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862824704:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1787560642.357121:0:13775:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787560642.357135:0:13775:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787560642.357161:0:13775:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787560642.357183:0:13775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787560642.549306:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787560642.742688:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787560643.123676:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862824832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787560643.123955:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560643.124087:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862824832 00000100:00100000:0.0:1787560643.124098:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862824832 00000100:00100000:0.0:1787560643.124177:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00080000:3.0:1787560643.124301:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560643.124346:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862824832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787560643.124387:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560643.124482:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862824832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 295us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560643.124499:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787560643.124599:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862824832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787560643.124974:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec38f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862824960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787560643.125016:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560643.125076:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862824960 00000100:00100000:2.0:1787560643.125090:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862824960 00000100:00080000:3.0:1787560643.125144:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787560643.125148:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787560643.125157:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3a19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862824960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787560643.125173:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787560643.125262:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec38f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862824960:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787560643.125726:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3a19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862824960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 569us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560643.125735:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787560643.511772:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560643.511856:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853320320 00000100:00100000:0.0:1787560643.511870:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853320320 00000100:00100000:0.0:1787560643.511979:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 147 00000100:00100000:0.0:1787560643.511994:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+13:11080:x1874392853320320:12345-192.168.203.29@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787560643.512126:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+13:11080:x1874392853320320:12345-192.168.203.29@tcp:60:lhsmtool_posix.0 Request processed in 136us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560643.512135:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 147 00000100:00080000:3.0:1787560643.512349:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560643.527825:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560643.527949:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853320448 00000100:00100000:3.0:1787560643.527962:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853320448 00000100:00100000:3.0:1787560643.528064:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 148 00000100:00100000:3.0:1787560643.528078:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+5:11080:x1874392853320448:12345-192.168.203.29@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787560643.528218:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+5:11080:x1874392853320448:12345-192.168.203.29@tcp:60:lhsmtool_posix.0 Request processed in 143us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560643.528246:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 148 00000100:00080000:0.0:1787560643.528761:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787560643.543101:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560643.543515:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853320704 00000100:00100000:0.0:1787560643.543530:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853320704 00000100:00100000:0.0:1787560643.543662:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 35 00000100:00100000:0.0:1787560643.543676:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+13:11080:x1874392853320704:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787560643.543994:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+14:11080:x1874392853320704:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 320us (908us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1787560643.544002:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 35 00010000:00010000:2.0:1787560643.571838:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560643.789354:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560643.792165:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853320832 00000100:00100000:3.0:1787560643.792189:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853320832 00000100:00100000:3.0:1787560643.792910:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 149 00000100:00100000:3.0:1787560643.792926:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:11886:x1874392853320832:12345-192.168.203.29@tcp:101:lsof.0 00010000:00010000:3.0:1787560643.792956:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560643.792997:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f3469e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fe12 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560643.793086:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f346a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560643.793104:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f346a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560643.793122:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f346a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560643.793187:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787560643.793192:0:6499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787560643.793257:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f346a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560643.793292:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f3469e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe12 expref: 7 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560643.793317:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f346a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe12 expref: 6 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560643.793354:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec2028000) 00010000:00010000:3.0:1787560643.793357:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787560643.793362:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f7000, rc 0) 00000100:00100000:3.0:1787560643.793501:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+6:11886:x1874392853320832:12345-192.168.203.29@tcp:101:lsof.0 Request processed in 578us (4162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560643.793508:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 149 00000100:00080000:0.0:1787560643.797651:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560644.147717:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787560644.147752:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862825088:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787560644.147755:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec38f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862825216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787560644.150393:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafe0687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862825344:0@lo:400:kworker.0 00000100:00100000:0.0:1787560644.151778:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1c2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862825600:0@lo:400:kworker.0 00000100:00100000:3.0:1787560644.153673:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560644.153794:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1c2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862825472:0@lo:400:kworker.0 00000100:00100000:3.0:1787560644.154328:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560644.154364:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862825984:0@lo:400:kworker.0 00000100:00100000:3.0:1787560644.154392:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560644.154425:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4065c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874392862826496:0@lo:400:kworker.0 00000100:00100000:3.0:1787560644.154477:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560644.154535:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862825088 00000100:00100000:3.0:1787560644.154547:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862825088 00000100:00100000:3.0:1787560644.154621:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787560644.154634:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3a19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862825088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787560644.154676:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787560644.155098:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560644.155147:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec1c2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862825728:0@lo:400:kworker.0 00000100:00100000:2.0:1787560644.155177:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560644.155199:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4065500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862826240:0@lo:400:kworker.0 00000100:00100000:2.0:1787560644.155225:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560644.155246:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4067100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862826752:0@lo:400:kworker.0 00000100:00100000:2.0:1787560644.155266:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560644.155300:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862825216 00000100:00100000:2.0:1787560644.155305:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862825216 00000100:00100000:2.0:1787560644.155335:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787560644.155343:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1874392862825216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787560644.155358:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787560644.155394:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1874392862825216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560644.155422:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787560644.155471:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862826240 00000100:00100000:2.0:1787560644.155475:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862826240 00000100:00100000:2.0:1787560644.155502:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862826752 00000100:00100000:2.0:1787560644.155505:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862826752 00000100:00100000:2.0:1787560644.158211:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787560644.158230:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862826240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560644.158354:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862826240:12345-0@lo:400:kworker.0 Request processed in 130us (3127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560644.158362:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787560644.158382:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787560644.158390:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3623:x1874392862826752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560644.158422:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3623:x1874392862826752:12345-0@lo:400:kworker.0 Request processed in 34us (3155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560644.158445:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787560644.159061:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4065500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862826240:0@lo:400:kworker.0 00000100:00100000:2.0:1787560644.159085:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4067100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862826752:0@lo:400:kworker.0 00000100:00100000:2.0:1787560644.159099:0:3623:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1787560644.159106:0:3623:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9caffcb09500, transno 4294967310 00000004:00080000:2.0:1787560644.159132:0:3623:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1787560644.159178:0:3623:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9cafffe4f100 x1874392862824576/t4294967313(4294967313) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787560656 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560644.159202:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec38f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862825216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560644.159411:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862825472 00000100:00100000:2.0:1787560644.159420:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862825472 00000100:00100000:2.0:1787560644.160065:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862825984 00000100:00100000:2.0:1787560644.160071:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862825984 00000100:00100000:2.0:1787560644.160097:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862826496 00000100:00100000:2.0:1787560644.160100:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862826496 00000100:00100000:2.0:1787560644.160116:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862825728 00000100:00100000:2.0:1787560644.160119:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862825728 00000100:00100000:2.0:1787560644.160138:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1787560644.160148:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862825472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560644.160231:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862825472:12345-0@lo:400:kworker.0 Request processed in 84us (5905us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560644.160237:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1787560644.160255:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787560644.160261:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862825984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560644.160288:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862825984:12345-0@lo:400:kworker.0 Request processed in 27us (5896us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560644.160295:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787560644.160307:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1787560644.160313:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3a1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874392862826496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560644.160327:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3a19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862825088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5691us (6662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560644.160341:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787560644.160345:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3a1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874392862826496:12345-0@lo:400:kworker.0 Request processed in 30us (5865us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560644.160354:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1787560644.160370:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1787560644.160376:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862825728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560644.160420:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862825728:12345-0@lo:400:kworker.0 Request processed in 44us (5242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560644.160427:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00080000:2.0:1787560644.160472:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787560644.160488:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787560644.160597:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1c2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862825472:0@lo:400:kworker.0 00000100:00100000:3.0:1787560644.160626:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862825984:0@lo:400:kworker.0 00000100:00100000:3.0:1787560644.160639:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4065c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874392862826496:0@lo:400:kworker.0 00000100:00100000:3.0:1787560644.160662:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862825088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560644.160727:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560644.160757:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862825600 00000100:00100000:3.0:1787560644.160763:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862825600 00000100:00100000:0.0:1787560644.160781:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4067800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874392862826112:0@lo:400:kworker.0 00000100:00100000:3.0:1787560644.160803:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787560644.160819:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560644.160845:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4065180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862826624:0@lo:400:kworker.0 00000100:00100000:0.0:1787560644.160868:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560644.160896:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862825600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560644.160926:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862826112 00000100:00100000:0.0:1787560644.160931:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862826112 00000100:00100000:3.0:1787560644.160952:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862825600:12345-0@lo:400:kworker.0 Request processed in 60us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560644.160961:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:3.0:1787560644.160993:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787560644.161003:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862826624 00000100:00100000:3.0:1787560644.161007:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862826624 00000100:00100000:3.0:1787560644.161033:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1787560644.161040:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874392862826112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560644.161070:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874392862826112:12345-0@lo:400:kworker.0 Request processed in 31us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560644.161076:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1787560644.161089:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1787560644.161096:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874392862826624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560644.161126:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874392862826624:12345-0@lo:400:kworker.0 Request processed in 30us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560644.161132:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00080000:3.0:1787560644.161145:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787560644.161261:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1c2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862825728:0@lo:400:kworker.0 00000100:00100000:0.0:1787560644.161368:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec1c2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862825600:0@lo:400:kworker.0 00010000:00080000:0.0:1787560644.161382:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec4067800 x1874392862826112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560644.161394:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4067800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874392862826112:0@lo:400:kworker.0 00010000:00080000:0.0:1787560644.161403:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec4065180 x1874392862826624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560644.161411:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4065180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862826624:0@lo:400:kworker.0 00000100:00100000:1.0:1787560644.161736:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560644.161784:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862825856:0@lo:400:kworker.0 00000100:00100000:1.0:1787560644.161899:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560644.161926:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862826368:0@lo:400:kworker.0 00000100:00100000:1.0:1787560644.161953:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560644.161982:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4064700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862826880:0@lo:400:kworker.0 00000100:00100000:1.0:1787560644.162005:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560644.162073:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862825856 00000100:00100000:2.0:1787560644.162081:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862825856 00000100:00100000:0.0:1787560644.162096:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862825344 00000100:00100000:0.0:1787560644.162102:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862825344 00000100:00100000:2.0:1787560644.162140:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787560644.162145:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1787560644.162154:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862825856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560644.162205:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862825856:12345-0@lo:400:kworker.0 Request processed in 56us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560644.162211:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787560644.162233:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862826368 00000100:00100000:2.0:1787560644.162237:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862826368 00000100:00100000:2.0:1787560644.162259:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862826880 00000100:00100000:2.0:1787560644.162262:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862826880 00000100:00100000:2.0:1787560644.162282:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787560644.162290:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3624:x1874392862825344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560644.162293:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862826368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560644.162344:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3624:x1874392862825344:12345-0@lo:400:kworker.0 Request processed in 190us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560644.162347:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862826368:12345-0@lo:400:kworker.0 Request processed in 56us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560644.162356:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1787560644.162360:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787560644.162378:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787560644.162385:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3baed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3624:x1874392862826880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560644.162472:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3baed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3624:x1874392862826880:12345-0@lo:400:kworker.0 Request processed in 88us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560644.162478:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787560644.162791:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafe0687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862825344:0@lo:400:kworker.0 00000100:00100000:1.0:1787560644.162805:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862825856:0@lo:400:kworker.0 00000100:00100000:1.0:1787560644.162815:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862826368:0@lo:400:kworker.0 00000100:00100000:1.0:1787560644.162847:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4064700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862826880:0@lo:400:kworker.0 00010000:00010000:1.0:1787560644.598577:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560645.619658:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560645.688369:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4065180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862827008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787560645.688486:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560645.688634:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862827008 00000100:00100000:2.0:1787560645.688643:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862827008 00000100:00100000:2.0:1787560645.688699:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787560645.688709:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862827008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787560645.688750:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1787560645.688804:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862827008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560645.688812:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787560645.688992:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4065180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862827008:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787560646.644273:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560646.656583:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560646.656629:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560646.656657:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560646.656690:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560646.656711:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560646.656731:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560646.656760:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560646.656803:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853321088 00000100:00100000:0.0:1787560646.656832:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853321088 00000100:00100000:0.0:1787560646.656916:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853321600 00000100:00100000:0.0:1787560646.656919:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853321600 00000100:00100000:0.0:1787560646.656935:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853321216 00000100:00100000:0.0:1787560646.656938:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853321216 00000100:00100000:0.0:1787560646.656953:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853321728 00000100:00100000:0.0:1787560646.656956:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853321728 00000100:00100000:0.0:1787560646.656977:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 300 00000100:00100000:0.0:1787560646.656989:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+14:2402:x1874392853321088:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560646.657084:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+14:2402:x1874392853321088:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 97us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560646.657092:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 300 00000100:00100000:0.0:1787560646.657109:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 301 00000100:00100000:0.0:1787560646.657115:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+6:2402:x1874392853321600:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560646.657239:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853321344 00000100:00100000:1.0:1787560646.657245:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853321344 00000100:00100000:1.0:1787560646.657284:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853321472 00000100:00100000:1.0:1787560646.657288:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853321472 00000100:00100000:2.0:1787560646.657300:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 302 00000100:00100000:2.0:1787560646.657313:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4065880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+5:2402:x1874392853321216:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560646.657318:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 117 00000100:00100000:1.0:1787560646.657331:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+5:2402:x1874392853321344:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560646.657386:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+6:2402:x1874392853321600:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 270us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560646.657393:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 301 00000100:00100000:0.0:1787560646.657406:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 303 00000100:00100000:0.0:1787560646.657411:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2402:x1874392853321728:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560646.660423:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4065880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+5:2402:x1874392853321216:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 3093us (3689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560646.660457:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 302 00000100:00080000:2.0:1787560646.660566:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787560646.660573:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787560646.660578:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787560646.660582:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560646.660624:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 118 00000100:00100000:2.0:1787560646.660641:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+6:2402:x1874392853321472:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560646.660708:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+6:2402:x1874392853321472:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 75us (3976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560646.660715:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 118 00000100:00100000:2.0:1787560646.660745:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853320960 00000100:00100000:2.0:1787560646.660755:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853320960 00000100:00100000:2.0:1787560646.660815:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 383 00000100:00100000:2.0:1787560646.660823:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdfe52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+13:2402:x1874392853320960:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560646.660856:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdfe52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+13:2402:x1874392853320960:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 34us (4165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560646.660872:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 383 00000100:00100000:1.0:1787560646.662079:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+5:2402:x1874392853321344:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 4738us (5435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560646.662094:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 117 00000100:00100000:0.0:1787560646.663403:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2402:x1874392853321728:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 5978us (6629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560646.663419:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 303 00000100:00100000:3.0:1787560646.707783:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4066300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862827136:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787560646.707936:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560646.712551:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862827136 00000100:00100000:0.0:1787560646.712572:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862827136 00000100:00100000:0.0:1787560646.712650:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787560646.712662:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3a18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862827136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787560646.712730:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000001:00080000:1.0:1787560646.714704:0:9491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:2.0:1787560646.714804:0:6478:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:2.0:1787560646.714820:0:6478:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1787560646.714917:0:6530:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1787560646.714942:0:6530:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1787560646.717675:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3a18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862827136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4996us (9728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560646.717698:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787560646.719047:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4066300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862827136:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1787560647.496730:0:14489:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 04:37:25 (1787560645) 00010000:00010000:0.0:1787560647.677646:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560648.243822:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787560648.243864:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4067480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862827264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787560648.243971:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560648.244064:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec38f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862827392:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787560648.244091:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560648.244349:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862827264 00000100:00100000:0.0:1787560648.244360:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862827264 00000100:00100000:0.0:1787560648.244461:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862827392 00000100:00100000:0.0:1787560648.244465:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862827392 00000100:00100000:0.0:1787560648.244486:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787560648.244497:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862827264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787560648.244531:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560648.244584:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862827264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560648.244592:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787560648.244611:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787560648.244617:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862827392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787560648.244627:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560648.244652:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862827392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560648.244658:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:1.0:1787560648.244783:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787560648.244829:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4067480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862827264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787560648.244844:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec38f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862827392:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787560648.691767:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560648.847132:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560648.847213:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853321984 00000100:00100000:0.0:1787560648.847229:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853321984 00000100:00100000:0.0:1787560648.847379:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 150 00000100:00100000:0.0:1787560648.847393:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3a19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+13:12154:x1874392853321984:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787560648.847428:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560648.847481:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f346ac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fe19 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560648.847552:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f346b3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560648.847565:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f346b3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560648.847576:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f346b3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560648.847589:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f346ba lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560648.847596:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f346ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560648.847602:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f346ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560648.847687:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f346c1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560648.847696:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f346c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560648.847704:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f346c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560648.847714:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1787560648.847802:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f346b3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560648.847810:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f346b3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560648.847817:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f346b3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560648.847834:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560648.847838:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f346b3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560648.847845:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f346b3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560648.847866:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cafef7ce000) 00010000:00010000:0.0:1787560648.847870:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560648.847875:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f346b3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560648.847881:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f346b3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560648.847904:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f346ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560648.847910:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f346ba lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560648.847916:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f346ba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560648.847931:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881000 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560648.847934:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f346ba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560648.847939:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f346ba lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560648.847947:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9cafc5393400) 00010000:00010000:0.0:1787560648.847949:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560648.847952:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f346ba lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560648.847957:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f346ba lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560648.848232:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f346ac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe19 expref: 16 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560648.848247:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f346c1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe19 expref: 15 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560648.848255:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9caec3207900) 00010000:00010000:0.0:1787560648.848257:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560648.848259:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881800, rc 0) 00000100:00100000:0.0:1787560648.848328:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3a19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+15:12154:x1874392853321984:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 939us (1210us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1787560648.848335:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 150 00000100:00080000:1.0:1787560648.848761:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560648.857787:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560648.858160:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853322112 00000100:00100000:2.0:1787560648.858175:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853322112 00000100:00100000:2.0:1787560648.858260:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 151 00000100:00100000:2.0:1787560648.858271:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+15:12154:x1874392853322112:12345-192.168.203.29@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787560648.858402:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+15:12154:x1874392853322112:12345-192.168.203.29@tcp:59:lhsmtool_posix.0 Request processed in 133us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560648.858410:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 151 00000100:00100000:3.0:1787560648.859509:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560648.859578:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853322240 00000100:00100000:0.0:1787560648.859615:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853322240 00000100:00100000:0.0:1787560648.859678:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:0.0:1787560648.859696:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+15:2402:x1874392853322240:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787560648.859714:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560648.859745:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f346c1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe19 expref: 15 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560648.859766:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9caec3207900) 00010000:00010000:0.0:1787560648.859781:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560648.865036:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+14:2402:x1874392853322240:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 4989us (5172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560648.865057:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:2.0:1787560648.868361:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560648.868710:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853322368 00000100:00100000:0.0:1787560648.868724:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853322368 00000100:00100000:0.0:1787560648.868927:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 152 00000100:00100000:0.0:1787560648.868940:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:12154:x1874392853322368:12345-192.168.203.29@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787560648.869068:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:12154:x1874392853322368:12345-192.168.203.29@tcp:59:lhsmtool_posix.0 Request processed in 132us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560648.869076:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 152 00000100:00080000:3.0:1787560648.869566:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:1.0:1787560648.887462:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787560649.273301:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787560649.273331:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862827520:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787560649.273420:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560649.273522:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862827520 00000100:00100000:3.0:1787560649.273531:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862827520 00000100:00100000:3.0:1787560649.273593:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787560649.273604:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862827520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787560649.273640:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787560649.273689:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862827520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560649.273696:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1787560649.273719:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787560649.273766:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862827520:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787560649.274212:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862828032:0@lo:400:kworker.0 00000100:00100000:1.0:1787560649.274253:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560649.274285:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec40ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862828544:0@lo:400:kworker.0 00000100:00100000:1.0:1787560649.274312:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560649.274334:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec40fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862829056:0@lo:400:kworker.0 00000100:00100000:1.0:1787560649.274357:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560649.274379:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787560649.274385:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862827904:0@lo:400:kworker.0 00000100:00100000:1.0:1787560649.274408:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560649.274445:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafe0687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862828416:0@lo:400:kworker.0 00000100:00100000:1.0:1787560649.274469:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560649.274487:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec40ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874392862828928:0@lo:400:kworker.0 00000100:00100000:1.0:1787560649.274506:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560649.274535:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862828032 00000100:00100000:1.0:1787560649.274540:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862828032 00000100:00100000:1.0:1787560649.274576:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862828416 00000100:00100000:1.0:1787560649.274578:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862828416 00000100:00100000:1.0:1787560649.274604:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862828928 00000100:00100000:1.0:1787560649.274607:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862828928 00000100:00100000:1.0:1787560649.274624:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1787560649.274632:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec40fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862828032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560649.274674:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec40fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862828032:12345-0@lo:400:kworker.0 Request processed in 44us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560649.274680:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1787560649.274695:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1787560649.274701:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec40fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862828416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560649.274739:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec40fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862828416:12345-0@lo:400:kworker.0 Request processed in 39us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560649.274746:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1787560649.274757:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1787560649.274763:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec40fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874392862828928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560649.274804:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec40fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874392862828928:12345-0@lo:400:kworker.0 Request processed in 41us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560649.274810:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1787560649.274830:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862828544 00000100:00100000:1.0:1787560649.274834:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862828544 00000100:00100000:1.0:1787560649.274872:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862829056 00000100:00100000:1.0:1787560649.274876:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862829056 00000100:00100000:1.0:1787560649.274899:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787560649.274906:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec40fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862828544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560649.274939:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec40fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862828544:12345-0@lo:400:kworker.0 Request processed in 33us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560649.274945:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787560649.274957:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787560649.274962:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec40fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862829056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560649.274990:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec40fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862829056:12345-0@lo:400:kworker.0 Request processed in 28us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560649.274995:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787560649.275019:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862827904 00000100:00100000:1.0:1787560649.275023:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862827904 00000100:00100000:1.0:1787560649.275050:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787560649.275057:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec40fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862827904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560649.275101:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec40fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862827904:12345-0@lo:400:kworker.0 Request processed in 44us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560649.275108:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:1.0:1787560649.275152:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787560649.275169:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787560649.275201:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862827904:0@lo:400:kworker.0 00010000:00080000:1.0:1787560649.275215:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cafe0687800 x1874392862828416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560649.275227:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafe0687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862828416:0@lo:400:kworker.0 00010000:00080000:1.0:1787560649.275237:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec40ff100 x1874392862828928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560649.275246:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec40ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874392862828928:0@lo:400:kworker.0 00000100:00100000:1.0:1787560649.275256:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862828032:0@lo:400:kworker.0 00000100:00100000:1.0:1787560649.275265:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec40ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862828544:0@lo:400:kworker.0 00000100:00100000:1.0:1787560649.275272:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1787560649.275278:0:3624:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cafffe4f100, transno 4294967313 00000100:00100000:1.0:1787560649.275291:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec40fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862829056:0@lo:400:kworker.0 00000100:00100000:3.0:1787560649.276523:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862827648:0@lo:400:kworker.0 00000100:00100000:3.0:1787560649.276590:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560649.276645:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862828160:0@lo:400:kworker.0 00000100:00100000:3.0:1787560649.276672:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560649.276690:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec40fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862828672:0@lo:400:kworker.0 00000100:00100000:3.0:1787560649.276729:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560649.276748:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4066680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862829184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787560649.276771:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560649.276811:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787560649.276819:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862827776:0@lo:400:kworker.0 00000100:00100000:3.0:1787560649.276855:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560649.276874:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862828288:0@lo:400:kworker.0 00000100:00100000:3.0:1787560649.276898:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560649.276912:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec40fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874392862828800:0@lo:400:kworker.0 00000100:00100000:3.0:1787560649.276932:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560649.276971:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862829184 00000100:00100000:3.0:1787560649.276979:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862829184 00000100:00100000:3.0:1787560649.277027:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787560649.277037:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862829184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787560649.277060:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787560649.277104:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862829184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560649.277112:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787560649.277162:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4066680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862829184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787560649.277309:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862828160 00000100:00100000:1.0:1787560649.277315:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862828160 00000100:00100000:1.0:1787560649.277354:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787560649.277362:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862828160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560649.277412:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862828160:12345-0@lo:400:kworker.0 Request processed in 51us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560649.277463:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787560649.277485:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862827776 00000100:00100000:1.0:1787560649.277489:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862827776 00000100:00100000:1.0:1787560649.277515:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862828288 00000100:00100000:1.0:1787560649.277518:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862828288 00000100:00100000:1.0:1787560649.277542:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862828800 00000100:00100000:1.0:1787560649.277545:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862828800 00000100:00100000:1.0:1787560649.277560:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1787560649.277566:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862827776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560649.277599:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862827776:12345-0@lo:400:kworker.0 Request processed in 34us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560649.277605:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1787560649.277617:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1787560649.277623:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862828288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560649.277650:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862828288:12345-0@lo:400:kworker.0 Request processed in 27us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560649.277656:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1787560649.277666:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1787560649.277672:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874392862828800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560649.277697:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874392862828800:12345-0@lo:400:kworker.0 Request processed in 26us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560649.277703:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00080000:1.0:1787560649.277730:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560649.277743:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862828672 00000100:00100000:1.0:1787560649.277747:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862828672 00000100:00100000:1.0:1787560649.280964:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787560649.281001:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec1c2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862828672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560649.281146:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec1c2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862828672:12345-0@lo:400:kworker.0 Request processed in 166us (4415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560649.281155:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787560649.281248:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862827776:0@lo:400:kworker.0 00000100:00100000:1.0:1787560649.281263:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862828288:0@lo:400:kworker.0 00000100:00100000:1.0:1787560649.281276:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec40fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874392862828800:0@lo:400:kworker.0 00000100:00100000:1.0:1787560649.281289:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862828160:0@lo:400:kworker.0 00000100:00100000:1.0:1787560649.281299:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec40fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862828672:0@lo:400:kworker.0 00000100:00100000:0.0:1787560649.281526:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862827648 00000100:00100000:0.0:1787560649.281535:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862827648 00000100:00100000:0.0:1787560649.281591:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1787560649.281599:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5802450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3625:x1874392862827648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560649.281659:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5802450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3625:x1874392862827648:12345-0@lo:400:kworker.0 Request processed in 60us (5069us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560649.281666:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1787560649.282995:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862827648:0@lo:400:kworker.0 00000040:00080000:3.0:1787560649.524565:0:13775:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787560649.524577:0:13775:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787560649.525270:0:13775:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787560649.525288:0:13775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787560649.717924:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560650.747264:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560650.803920:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787560650.803943:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec40fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862829312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787560650.804016:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560650.804083:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862829312 00000100:00100000:1.0:1787560650.804091:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862829312 00000100:00100000:1.0:1787560650.804137:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787560650.804146:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec40fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862829312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787560650.804178:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1787560650.804220:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec40fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862829312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560650.804226:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787560650.804273:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec40fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862829312:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787560650.991532:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560650.991608:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853322496 00000100:00100000:3.0:1787560650.991618:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853322496 00000100:00100000:3.0:1787560650.991691:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 153 00000100:00100000:3.0:1787560650.991712:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4066a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+14:12196:x1874392853322496:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1787560650.991734:0:13787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560650.991755:0:13787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f346cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fe20 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560650.991830:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f346d6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560650.991854:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f346d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560650.991865:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f346d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560650.991880:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f346dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560650.991887:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f346dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560650.991893:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f346dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560650.991933:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f346d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560650.991940:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f346d6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560650.991946:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f346d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560650.991962:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7c00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560650.991966:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f346d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560650.991973:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f346d6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560650.991986:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec2028000) 00010000:00010000:3.0:1787560650.991989:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560650.991993:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f346d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560650.991999:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f346d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560650.992011:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f346dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560650.992017:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f346dd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560650.992023:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f346dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560650.992029:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560650.992031:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f346dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560650.992037:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f346dd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560650.992055:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9cafe094aa00) 00010000:00010000:3.0:1787560650.992058:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560650.992060:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f346dd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560650.992066:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f346dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560650.992099:0:13787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f346cf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe20 expref: 15 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560650.992109:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec2028000) 00010000:00010000:3.0:1787560650.992111:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560650.992114:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f346cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe20 expref: 15 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560650.992122:0:13787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f6800, rc 0) 00000100:00100000:3.0:1787560650.992182:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4066a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+14:12196:x1874392853322496:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 472us (660us total) trans 0 rc 301/301 00000100:00100000:3.0:1787560650.992188:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 153 00000100:00080000:0.0:1787560650.992357:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560651.009829:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560651.010595:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853322752 00000100:00100000:0.0:1787560651.010606:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853322752 00000100:00100000:0.0:1787560651.010661:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 154 00000100:00100000:0.0:1787560651.010672:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+14:12196:x1874392853322752:12345-192.168.203.29@tcp:36:lfs.0 00010000:00010000:0.0:1787560651.010726:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560651.010752:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34023 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc44 expref: 14 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560651.010770:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec2028000) 00010000:00010000:0.0:1787560651.010775:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787560651.010844:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f346e4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560651.010858:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f346a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe12 expref: 5 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560651.010868:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f346e4 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560651.010902:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f346a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe12 expref: 5 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560651.010916:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f346a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe12 expref: 5 pid: 6499 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560651.010930:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4066680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6499:1874392862829440:192.168.203.29@tcp:104: 00000100:00100000:0.0:1787560651.011031:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec17c99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560651.021065:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560651.021164:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4066680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6499:1874392862829440:192.168.203.29@tcp:104: 00010000:00010000:1.0:1787560651.021201:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f346e4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560651.021418:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853322880 00000100:00100000:3.0:1787560651.021427:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853322880 00010000:00010000:3.0:1787560651.021503:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f346a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe12 expref: 6 pid: 6499 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560651.021543:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 81 00000100:00100000:3.0:1787560651.021552:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+6:2405:x1874392853322880:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560651.021573:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560651.021581:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f346a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe12 expref: 6 pid: 6499 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560651.021594:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f346a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe12 expref: 6 pid: 6499 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560651.021614:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f346a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe12 expref: 6 pid: 6499 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560651.021629:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec2028000) 00010000:00010000:3.0:1787560651.021634:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f346e4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560651.021643:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f346e4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560651.021649:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f346e4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560651.021668:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560651.021718:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2405:x1874392853322880:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 167us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560651.021727:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 81 00000100:00080000:1.0:1787560651.022018:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787560651.022032:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f346e4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.022039:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f346e4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.022064:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f346eb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.022074:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f346eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.022081:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f346eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.022603:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f346f2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.022613:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f346f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.022621:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f346f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787560651.022636:0:6499:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000230a32ca reply state 00000000876a9c0b transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f346f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.022647:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f346f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.022660:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:1.0:1787560651.022663:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787560651.022666:0:6499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787560651.022672:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1787560651.022679:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f346e4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.022685:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f346e4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.022691:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f346e4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.022697:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560651.022700:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f346e4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.022707:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f346e4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.022715:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec2028000) 00010000:00010000:1.0:1787560651.022718:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560651.022721:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f346e4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.022727:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f346e4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787560651.022741:0:6499:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000230a32ca reply state 00000000876a9c0b transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f346eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.022758:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f346eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.022877:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9caec3203300) 00010000:00010000:1.0:1787560651.022879:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787560651.022881:0:6499:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1787560651.022947:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+15:12196:x1874392853322752:12345-192.168.203.29@tcp:36:lfs.0 Request processed in 12276us (13129us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1787560651.022955:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 154 00000100:00100000:2.0:1787560651.176482:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560651.176604:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853323008 00000100:00100000:1.0:1787560651.176614:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853323008 00000100:00100000:1.0:1787560651.176666:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 155 00000100:00100000:1.0:1787560651.176676:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+15:12204:x1874392853323008:12345-192.168.203.29@tcp:101:lctl.0 00010000:00010000:1.0:1787560651.176697:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560651.176718:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f346f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fe27 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.176783:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f34700 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.176797:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f34700 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.176807:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f34700 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560651.176853:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787560651.176857:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787560651.176891:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f34700 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.176913:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f346f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe27 expref: 17 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.176930:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f34700 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe27 expref: 16 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.176939:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec3203400) 00010000:00010000:1.0:1787560651.176942:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787560651.176945:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbffe00, rc 0) 00000100:00100000:1.0:1787560651.177014:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+16:12204:x1874392853323008:12345-192.168.203.29@tcp:101:lctl.0 Request processed in 339us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560651.177020:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 155 00000100:00100000:3.0:1787560651.265689:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560651.266472:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853323136 00000100:00100000:1.0:1787560651.266484:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853323136 00000100:00100000:1.0:1787560651.266551:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 156 00000100:00100000:1.0:1787560651.266563:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+16:12210:x1874392853323136:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:1.0:1787560651.266583:0:10172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560651.266604:0:10172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f34707 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fe2e expref: -99 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.266668:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f3470e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.266683:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f3470e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.266695:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f3470e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.266722:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1657200/0x4642c20bf2f34715 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.266729:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1657200/0x4642c20bf2f34715 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.266735:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1657200/0x4642c20bf2f34715 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.266805:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1656800/0x4642c20bf2f3471c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.266813:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1656800/0x4642c20bf2f3471c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.266820:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1656800/0x4642c20bf2f3471c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560651.266864:0:10172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1787560651.266868:0:10172:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787560651.266886:0:10172:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1656800/0x4642c20bf2f3471c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.266898:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f3470e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.266904:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f3470e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.266911:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f3470e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.266927:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbff000 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560651.266932:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f3470e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.266939:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f3470e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.266965:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec3203400) 00010000:00010000:1.0:1787560651.266969:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560651.266974:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f3470e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.266980:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f3470e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.266994:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1657200/0x4642c20bf2f34715 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.267000:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1657200/0x4642c20bf2f34715 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.267006:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1657200/0x4642c20bf2f34715 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.267012:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafc1657200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560651.267014:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1657200/0x4642c20bf2f34715 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.267020:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1657200/0x4642c20bf2f34715 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.267038:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9caec3203300) 00010000:00010000:1.0:1787560651.267041:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560651.267044:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1657200/0x4642c20bf2f34715 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.267049:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1657200/0x4642c20bf2f34715 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.267077:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f34707 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe2e expref: 18 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.267200:0:10172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1656800/0x4642c20bf2f3471c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe2e expref: 17 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.267210:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:1.0:1787560651.267213:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787560651.267216:0:10172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafc1656800, rc 0) 00000100:00100000:1.0:1787560651.267288:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+17:12210:x1874392853323136:12345-192.168.203.29@tcp:101:bash.0 Request processed in 726us (1607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560651.267295:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 156 00000100:00100000:2.0:1787560651.274937:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560651.275101:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853323392 00000100:00100000:1.0:1787560651.275111:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853323392 00000100:00100000:1.0:1787560651.275178:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 157 00000100:00100000:1.0:1787560651.275189:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+17:12210:x1874392853323392:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:1.0:1787560651.275209:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560651.275229:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1657200/0x4642c20bf2f34723 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fe35 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.275348:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1656000/0x4642c20bf2f3472a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.275362:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1656000/0x4642c20bf2f3472a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.275374:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1656000/0x4642c20bf2f3472a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.275409:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f34731 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.275417:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f34731 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.275424:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f34731 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787560651.275761:0:6499:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:1.0:1787560651.275910:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f34738 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.275920:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f34738 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.275927:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f34738 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.275970:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1656000/0x4642c20bf2f3472a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.275989:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1656000/0x4642c20bf2f3472a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.275996:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1656000/0x4642c20bf2f3472a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.276003:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafc1656000 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560651.276007:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1656000/0x4642c20bf2f3472a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.276015:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1656000/0x4642c20bf2f3472a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.276027:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:1.0:1787560651.276030:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560651.276035:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1656000/0x4642c20bf2f3472a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.276042:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1656000/0x4642c20bf2f3472a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787560651.276057:0:6499:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000e77a020 reply state 00000000bd5488e9 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f34731 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.276069:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f34731 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.276075:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9caec3203600) 00010000:00010000:1.0:1787560651.276078:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787560651.276081:0:6499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787560651.276109:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1657200/0x4642c20bf2f34723 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe35 expref: 20 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.276135:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f34738 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe35 expref: 19 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.276142:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9caec3203c00) 00010000:00010000:1.0:1787560651.276145:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787560651.276147:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbff000, rc 0) 00000100:00100000:1.0:1787560651.276215:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+20:12210:x1874392853323392:12345-192.168.203.29@tcp:101:bash.0 Request processed in 1028us (1288us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1787560651.276224:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 157 00000100:00100000:3.0:1787560651.283519:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560651.287005:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853323520 00000100:00100000:1.0:1787560651.287021:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853323520 00000100:00100000:1.0:1787560651.287124:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 55 00000100:00100000:1.0:1787560651.287135:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+5:2404:x1874392853323520:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:1.0:1787560651.287152:0:10171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560651.287174:0:10171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073102f52/0x4642c20bf2f34746 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fe3c expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787560651.287199:0:10171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560651.287218:0:10171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=370s v=(0 0) 00010000:00010000:1.0:1787560651.287223:0:10171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560651.287232:0:10171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073102f52/0x4642c20bf2f34746 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe3c expref: 6 pid: 10171 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.287250:0:10171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000073102f52/0x4642c20bf2f34746 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe3c expref: 6 pid: 10171 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.287284:0:10171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafc1657200, rc 0) 00000100:00100000:1.0:1787560651.287360:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+6:2404:x1874392853323520:12345-192.168.203.29@tcp:101:bash.0 Request processed in 227us (3850us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560651.287367:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 55 00000100:00080000:0.0:1787560651.287545:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787560651.291261:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560651.291902:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853323648 00000100:00100000:1.0:1787560651.291912:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853323648 00000100:00100000:1.0:1787560651.292034:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 56 00000100:00100000:1.0:1787560651.292046:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+6:12210:x1874392853323648:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:1.0:1787560651.292065:0:8414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560651.292083:0:8414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000487d1956/0x4642c20bf2f3474d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fe43 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.292230:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000073102f52/0x4642c20bf2f34746 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe3c expref: 7 pid: 10171 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.292240:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560651.292245:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560651.292249:0:8414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000487d1956/0x4642c20bf2f3474d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe43 expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.292283:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000073102f52/0x4642c20bf2f34746 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe3c expref: 7 pid: 10171 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.292296:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000073102f52/0x4642c20bf2f34746 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe3c expref: 7 pid: 10171 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560651.292322:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec40fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8414:1874392862829568:192.168.203.29@tcp:104: 00000100:00100000:1.0:1787560651.292517:0:8414:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec31ec0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560651.303475:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec40fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8414:1874392862829568:192.168.203.29@tcp:104: 00010000:00010000:1.0:1787560651.303516:0:8414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000487d1956/0x4642c20bf2f3474d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe43 expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.303537:0:8414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafc1656000, rc 0) 00000100:00100000:1.0:1787560651.303609:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+7:12210:x1874392853323648:12345-192.168.203.29@tcp:101:bash.0 Request processed in 11564us (12358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560651.303618:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 56 00000100:00100000:3.0:1787560651.311187:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560651.311894:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853323776 00000100:00100000:1.0:1787560651.311904:0:9502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853323776 00010000:00010000:1.0:1787560651.311947:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000073102f52/0x4642c20bf2f34746 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe3c expref: 7 pid: 10171 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560651.312051:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 82 00000100:00100000:1.0:1787560651.312062:0:9502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3850a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+7:2405:x1874392853323776:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560651.312078:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560651.312106:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000073102f52/0x4642c20bf2f34746 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe3c expref: 7 pid: 10171 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.312120:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000073102f52/0x4642c20bf2f34746 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe3c expref: 7 pid: 10171 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.312162:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073102f52/0x4642c20bf2f34746 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe3c expref: 7 pid: 10171 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.312181:0:9502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560651.312186:0:9502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560651.312193:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000487d1956/0x4642c20bf2f3474d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe43 expref: 6 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.312204:0:9502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000487d1956/0x4642c20bf2f3474d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe43 expref: 6 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.312243:0:9502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000487d1956/0x4642c20bf2f3474d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe43 expref: 6 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560651.312258:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec40fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9502:1874392862829696:192.168.203.29@tcp:105: 00000100:00100000:1.0:1787560651.312390:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec31ec0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560651.324252:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec40fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9502:1874392862829696:192.168.203.29@tcp:105: 00010000:00010000:1.0:1787560651.324278:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560651.324340:0:9502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3850a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+6:2405:x1874392853323776:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 12278us (13160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560651.324352:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 82 00000100:00100000:3.0:1787560651.328540:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560651.328674:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853324032 00000100:00100000:0.0:1787560651.328685:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853324032 00000100:00100000:0.0:1787560651.328744:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 36 00000100:00100000:0.0:1787560651.328763:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+20:12210:x1874392853324032:12345-192.168.203.29@tcp:35:bash.0 00000100:00100000:0.0:1787560651.329024:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+21:12210:x1874392853324032:12345-192.168.203.29@tcp:35:bash.0 Request processed in 270us (492us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1787560651.329032:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 36 00000100:00100000:3.0:1787560651.417639:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560651.417750:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853324288 00000100:00100000:1.0:1787560651.417761:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853324288 00000100:00100000:1.0:1787560651.417847:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 158 00000100:00100000:1.0:1787560651.417872:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+21:12220:x1874392853324288:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:1.0:1787560651.417896:0:13787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560651.417917:0:13787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1657200/0x4642c20bf2f34754 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fe4a expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560651.418013:0:13787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1787560651.418326:0:13787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1657200/0x4642c20bf2f34754 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe4a expref: 23 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.418342:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec3203400) 00010000:00010000:1.0:1787560651.418346:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787560651.418351:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1657200/0x4642c20bf2f34754 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe4a expref: 23 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.418367:0:13787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafc1657200, rc 0) 00000100:00100000:1.0:1787560651.418930:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+22:12220:x1874392853324288:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 1058us (1298us total) trans 4294967421 rc 301/301 00000100:00100000:1.0:1787560651.418939:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 158 00000100:00100000:3.0:1787560651.424922:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560651.425017:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853324544 00000100:00100000:0.0:1787560651.425026:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853324544 00000100:00100000:0.0:1787560651.425084:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 37 00000100:00100000:0.0:1787560651.425095:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+22:12220:x1874392853324544:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:0.0:1787560651.425322:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+23:12220:x1874392853324544:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 228us (409us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1787560651.425331:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 37 00000100:00100000:3.0:1787560651.488607:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560651.488708:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853324672 00000100:00100000:2.0:1787560651.488718:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853324672 00000100:00100000:2.0:1787560651.488780:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 159 00000100:00100000:2.0:1787560651.488791:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+23:12226:x1874392853324672:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1787560651.489407:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560651.489466:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34762 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fe51 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.489540:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f34769 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.489554:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f34769 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.489566:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f34769 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560651.489625:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787560651.489630:0:6500:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787560651.489648:0:6500:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f34769 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.489674:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34762 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe51 expref: 25 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.489693:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f34769 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe51 expref: 24 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.489703:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:2.0:1787560651.489706:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787560651.489710:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2169e00, rc 0) 00000100:00100000:2.0:1787560651.489774:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+24:12226:x1874392853324672:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 985us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560651.489782:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 159 00000100:00100000:3.0:1787560651.493922:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560651.494187:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853324928 00000100:00100000:2.0:1787560651.494196:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853324928 00000100:00100000:2.0:1787560651.494257:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 160 00000100:00100000:2.0:1787560651.494268:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeabab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+24:12226:x1874392853324928:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1787560651.494288:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560651.494308:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34770 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fe58 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.494410:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f34777 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.494482:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f34777 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.494494:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f34777 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560651.494507:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787560651.494614:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34770 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe58 expref: 27 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.494633:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f34777 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe58 expref: 26 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.494642:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9caec3203c00) 00010000:00010000:2.0:1787560651.494645:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787560651.494648:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2168400, rc 0) 00000100:00100000:2.0:1787560651.495319:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeabab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+26:12226:x1874392853324928:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 1046us (1399us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1787560651.495329:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 160 00000100:00100000:3.0:1787560651.501485:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560651.502010:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560651.502067:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853325312 00000100:00100000:2.0:1787560651.502078:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853325312 00000100:00100000:2.0:1787560651.502145:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 161 00000100:00100000:2.0:1787560651.502155:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+26:12226:x1874392853325312:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1787560651.502178:0:13787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560651.502198:0:13787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34785 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fe5f expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560651.502527:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853325056 00000100:00100000:1.0:1787560651.502533:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853325056 00000100:00100000:1.0:1787560651.502573:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:1.0:1787560651.502580:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeabaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+28:2404:x1874392853325056:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560651.502589:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560651.502608:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f34777 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe58 expref: 28 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.502624:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9caec3203c00) 00010000:00010000:2.0:1787560651.502635:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f3478c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.502635:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787560651.502646:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f3478c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.502654:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f3478c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560651.502665:0:13787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00000100:00100000:1.0:1787560651.502692:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeabaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+27:2404:x1874392853325056:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 112us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560651.502707:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 11 00010000:00010000:2.0:1787560651.502765:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34785 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe5f expref: 28 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.502780:0:13787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f3478c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe5f expref: 27 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.502788:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9caec3203c00) 00010000:00010000:2.0:1787560651.502791:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787560651.502793:0:13787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2168800, rc 0) 00000100:00100000:2.0:1787560651.503159:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+27:12226:x1874392853325312:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 1004us (1148us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1787560651.503165:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 161 00000100:00100000:3.0:1787560651.510023:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560651.510110:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853325440 00000100:00100000:1.0:1787560651.510121:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853325440 00000100:00100000:1.0:1787560651.510182:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 57 00000100:00100000:1.0:1787560651.510193:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+6:2402:x1874392853325440:12345-192.168.203.29@tcp:1:lfs.0 00010000:00010000:1.0:1787560651.510233:0:10171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073102f52/0x4642c20bf2f3479a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.510252:0:10171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000487d1956/0x4642c20bf2f3474d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe43 expref: 6 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.510261:0:10171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560651.510265:0:10171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787560651.510269:0:10171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073102f52/0x4642c20bf2f3479a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.510300:0:10171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000487d1956/0x4642c20bf2f3474d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe43 expref: 6 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.510313:0:10171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000487d1956/0x4642c20bf2f3474d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe43 expref: 6 pid: 8414 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560651.510327:0:10171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec40fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10171:1874392862829824:192.168.203.29@tcp:104: 00000100:00100000:1.0:1787560651.510416:0:10171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec31ec0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560651.515119:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560651.515218:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853325568 00000100:00100000:0.0:1787560651.515227:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853325568 00002000:00100000:0.0:1787560651.515272:0:8419:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9caec2f4c380 x1874392853325568/t0(0) o4->9331bacf-6cfc-4379-8649-925e79b19df1@192.168.203.29@tcp:12/0 lens 504/0 e 0 to 0 dl 1787560662 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787560651.515283:0:8419:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9caec2f4c380 with x1874392853325568 ext(0->12) 00010000:00010000:0.0:1787560651.515293:0:8419:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000487d1956/0x4642c20bf2f3474d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe43 expref: 7 pid: 8414 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560651.515310:0:8419:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000487d1956/0x4642c20bf2f3474d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe43 expref: 7 pid: 8414 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787560651.515337:0:8419:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9caec2f4c380 00000100:00100000:0.0:1787560651.515370:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:0.0:1787560651.515379:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9331bacf-6cfc-4379-8649-925e79b19df1+7:2404:x1874392853325568:12345-192.168.203.29@tcp:4:lfs.0 00000100:00100000:1.0:1787560651.515980:0:10171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec40fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10171:1874392862829824:192.168.203.29@tcp:104: 00010000:00010000:1.0:1787560651.516004:0:10171:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000073102f52/0x4642c20bf2f3479a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560651.516533:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9331bacf-6cfc-4379-8649-925e79b19df1+9:2404:x1874392853325568:12345-192.168.203.29@tcp:4:lfs.0 Request processed in 1153us (1421us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787560651.516542:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 2 00002000:00100000:0.0:1787560651.516549:0:8419:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9caec2f4c380 x1874392853325568/t4294967306(0) o4->9331bacf-6cfc-4379-8649-925e79b19df1@192.168.203.29@tcp:12/0 lens 504/448 e 0 to 0 dl 1787560662 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787560651.516558:0:8419:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9caec2f4c380 with x1874392853325568 ext(0->12) 00010000:00010000:0.0:1787560651.516565:0:8419:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000487d1956/0x4642c20bf2f3474d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe43 expref: 9 pid: 8414 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560651.516578:0:8419:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000487d1956/0x4642c20bf2f3474d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe43 expref: 9 pid: 8414 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787560651.516585:0:8419:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9caec2f4c380 00000100:00100000:0.0:1787560651.519348:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560651.519469:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853325696 00000100:00100000:1.0:1787560651.519479:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853325696 00010000:00010000:1.0:1787560651.519517:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000487d1956/0x4642c20bf2f3474d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe43 expref: 9 pid: 8414 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560651.519556:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 83 00000100:00100000:1.0:1787560651.519566:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4067480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+9:2402:x1874392853325696:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560651.519579:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787560651.519596:0:6486:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787560651.519600:0:6486:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787560651 00002000:00010000:1.0:1787560651.519602:0:6486:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787560651 00002000:00010000:1.0:1787560651.519605:0:6486:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1787560651 00002000:00010000:1.0:1787560651.519607:0:6486:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787560651.519613:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000487d1956/0x4642c20bf2f3474d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe43 expref: 9 pid: 8414 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.519627:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000487d1956/0x4642c20bf2f3474d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe43 expref: 9 pid: 8414 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.519650:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000487d1956/0x4642c20bf2f3474d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe43 expref: 9 pid: 8414 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.519687:0:6486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787560651.519692:0:6486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787560651.519698:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000073102f52/0x4642c20bf2f3479a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.519719:0:6486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073102f52/0x4642c20bf2f3479a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.519751:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560651.519802:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4067480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+8:2402:x1874392853325696:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 236us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560651.519810:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 83 00010000:00010000:2.0:1787560651.519876:0:10171:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000073102f52/0x4642c20bf2f3479a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.519887:0:10171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073102f52/0x4642c20bf2f3479a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.519919:0:10171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073102f52/0x4642c20bf2f3479a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.519926:0:10171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073102f52/0x4642c20bf2f3479a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.519933:0:10171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073102f52/0x4642c20bf2f3479a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.519940:0:10171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafc1657200 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:2.0:1787560651.519944:0:10171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073102f52/0x4642c20bf2f3479a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.519952:0:10171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073102f52/0x4642c20bf2f3479a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.519963:0:10171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073102f52/0x4642c20bf2f3479a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.519971:0:10171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073102f52/0x4642c20bf2f3479a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560651.520018:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+7:2402:x1874392853325440:12345-192.168.203.29@tcp:1:lfs.0 Request processed in 9826us (10003us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560651.520025:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 57 00000100:00100000:2.0:1787560651.526760:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560651.526866:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853325952 00000100:00100000:0.0:1787560651.526875:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853325952 00000100:00100000:0.0:1787560651.526934:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 38 00000100:00100000:0.0:1787560651.526945:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd7c05c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+27:12226:x1874392853325952:12345-192.168.203.29@tcp:35:lfs.0 00000004:00010000:0.0:1787560651.527007:0:6501:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f3478c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe5f expref: 27 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787560651.527880:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1787560651.527922:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1787560651.528189:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:0.0:1787560651.528227:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f347a1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560651.528244:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f34738 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe35 expref: 31 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560651.528254:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f347a1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560651.528289:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f34738 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe35 expref: 31 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560651.528306:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f34738 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe35 expref: 31 pid: 6499 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560651.528320:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4066300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6501:1874392862829952:192.168.203.29@tcp:104: 00000100:00100000:0.0:1787560651.528817:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec17c93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560651.531611:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560651.531698:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853326080 00000100:00100000:1.0:1787560651.531707:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853326080 00010000:00010000:1.0:1787560651.531748:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f34738 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe35 expref: 32 pid: 6499 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560651.531799:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 84 00000100:00100000:1.0:1787560651.531809:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4064700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+32:2404:x1874392853326080:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560651.531842:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560651.531849:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f34738 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe35 expref: 32 pid: 6499 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.531864:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f34738 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe35 expref: 32 pid: 6499 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.531902:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9caec3203c00) 00010000:00010000:1.0:1787560651.531908:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f347a1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.531918:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f347a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.531926:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f347a1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.531943:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560651.531997:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4064700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+32:2404:x1874392853326080:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 189us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560651.532005:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 84 00010000:00010000:3.0:1787560651.534089:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f34738 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe35 expref: 31 pid: 6499 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560651.534185:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4066300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6501:1874392862829952:192.168.203.29@tcp:104: 00010000:00010000:3.0:1787560651.534209:0:6501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f347a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560651.534219:0:6501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f347a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560651.534224:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f347a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787560651.534335:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:3.0:1787560651.534547:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1787560651.534635:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f4ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6501:1874392862830080:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787560651.534700:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560651.534736:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc4cc4600 going to sleep for 11 seconds 00000100:00100000:1.0:1787560651.534919:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862830080 00000100:00100000:1.0:1787560651.534925:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862830080 00000100:00100000:1.0:1787560651.535016:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787560651.535026:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6501:x1874392862830080:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787560651.535114:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6501:x1874392862830080:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 79us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560651.535121:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:0.0:1787560651.535169:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787560651.535308:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f4ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6501:1874392862830080:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787560651.535408:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1787560651.535529:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f4ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6501:1874392862830208:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787560651.535556:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560651.535609:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc4cc46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560651.535650:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862830208 00000100:00100000:1.0:1787560651.535655:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862830208 00000100:00100000:1.0:1787560651.535708:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787560651.535716:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6501:x1874392862830208:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787560651.535840:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6501:x1874392862830208:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 115us (274us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787560651.535857:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787560651.535914:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f4ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6501:1874392862830208:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787560651.535946:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1787560651.535973:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f347a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.535982:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f347a1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.535990:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f347a1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.535998:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881c00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560651.536002:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f347a1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.536010:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f347a1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.536026:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9caec3203c00) 00010000:00010000:2.0:1787560651.536029:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787560651.536034:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f347a1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.536040:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f347a1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787560651.536131:0:6501:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787560651.536183:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1787560651.536193:0:6501:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 370875760853ns, next at 371875758956ns, rc = 0 00000001:00080000:2.0:1787560651.536199:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:2.0:1787560651.536226:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9caec3203c00) 00010000:00010000:2.0:1787560651.536229:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787560651.536235:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f3478c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe5f expref: 35 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560651.536315:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd7c05c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+34:12226:x1874392853325952:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 9372us (9566us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1787560651.536323:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 38 00000020:00080000:2.0:1787560651.536326:0:6501:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787560651.539647:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560651.539711:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853326208 00000100:00100000:2.0:1787560651.539720:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853326208 00000100:00100000:2.0:1787560651.539788:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 162 00000100:00100000:2.0:1787560651.539799:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+34:12226:x1874392853326208:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1787560651.539823:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560651.539855:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f347a8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fe66 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.539908:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f347a8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe66 expref: 35 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.539922:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f347a8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe66 expref: 35 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.539941:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:2.0:1787560651.539944:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787560651.539948:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2169600, rc 0) 00000100:00100000:2.0:1787560651.540006:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+35:12226:x1874392853326208:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 209us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560651.540030:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 162 00000100:00100000:3.0:1787560651.546470:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560651.546557:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853326464 00000100:00100000:1.0:1787560651.546567:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853326464 00000100:00100000:1.0:1787560651.546626:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 39 00000100:00100000:1.0:1787560651.546637:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+35:12226:x1874392853326464:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:1.0:1787560651.546878:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+36:12226:x1874392853326464:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 242us (445us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1787560651.546888:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 39 00000100:00100000:0.0:1787560651.642202:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560651.642277:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853326720 00000100:00100000:3.0:1787560651.642286:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853326720 00000100:00100000:3.0:1787560651.642339:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 163 00000100:00100000:3.0:1787560651.642348:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+36:12236:x1874392853326720:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1787560651.642372:0:10172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560651.642389:0:10172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f347af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fe6d expref: -99 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560651.642506:0:10172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787560651.642602:0:10172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f347af lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe6d expref: 38 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560651.642616:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec3203400) 00010000:00010000:3.0:1787560651.642619:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787560651.642623:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f347af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe6d expref: 38 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560651.642637:0:10172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafc0030200, rc 0) 00000100:00100000:3.0:1787560651.642687:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+37:12236:x1874392853326720:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 340us (494us total) trans 4294967435 rc 301/301 00000100:00100000:3.0:1787560651.642693:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 163 00000100:00100000:0.0:1787560651.646539:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560651.646628:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853326848 00000100:00100000:2.0:1787560651.646636:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853326848 00000100:00100000:2.0:1787560651.646699:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 164 00000100:00100000:2.0:1787560651.646710:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4067100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+37:12236:x1874392853326848:12345-192.168.203.29@tcp:34:lfs.0 00010000:00010000:2.0:1787560651.646794:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f347bd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.646810:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f347bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.646843:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f347bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.646856:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f347c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.646864:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f347c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.646870:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f347c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.646941:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f347cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.646949:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f347cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.646956:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f347cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787560651.647019:0:13787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f347cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.647031:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f347bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.647038:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f347bd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.647045:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f347bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.647051:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560651.647056:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f347bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.647063:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f347bd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.647075:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:2.0:1787560651.647078:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560651.647082:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f347bd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.647088:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f347bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.647101:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f347c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.647118:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f347c4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.647131:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f347c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.647137:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168a00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560651.647140:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f347c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.647146:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f347c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.647155:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9caec3203600) 00010000:00010000:2.0:1787560651.647158:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560651.647161:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f347c4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.647166:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f347c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.647176:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f347cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.647181:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f347cb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.647187:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f347cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.647192:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560651.647195:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f347cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.647212:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f347cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.647220:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:2.0:1787560651.647223:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560651.647226:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f347cb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560651.647232:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f347cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560651.647306:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4067100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+37:12236:x1874392853326848:12345-192.168.203.29@tcp:34:lfs.0 Request processed in 598us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560651.647314:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 164 00000100:00100000:1.0:1787560651.650329:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560651.650463:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853327104 00000100:00100000:2.0:1787560651.650472:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853327104 00000100:00100000:2.0:1787560651.650523:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 40 00000100:00100000:2.0:1787560651.650532:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec40fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+37:12236:x1874392853327104:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:2.0:1787560651.650719:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec40fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+38:12236:x1874392853327104:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 187us (399us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1787560651.650726:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 40 00000100:00100000:0.0:1787560651.689171:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560651.689256:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853327360 00000100:00100000:1.0:1787560651.689267:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853327360 00000100:00100000:1.0:1787560651.689323:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 165 00000100:00100000:1.0:1787560651.689333:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+38:12239:x1874392853327360:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:1.0:1787560651.689358:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560651.689379:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1656000/0x4642c20bf2f347d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fe74 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.689480:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1657200/0x4642c20bf2f347d9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.689493:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1657200/0x4642c20bf2f347d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.689506:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1657200/0x4642c20bf2f347d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.689518:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff800/0x4642c20bf2f347e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.689538:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff800/0x4642c20bf2f347e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.689546:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff800/0x4642c20bf2f347e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.689644:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fec00/0x4642c20bf2f347e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.689653:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fec00/0x4642c20bf2f347e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.689661:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fec00/0x4642c20bf2f347e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560651.689670:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787560651.689741:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1657200/0x4642c20bf2f347d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.689749:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1657200/0x4642c20bf2f347d9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.689768:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1657200/0x4642c20bf2f347d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.689774:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafc1657200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560651.689779:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1657200/0x4642c20bf2f347d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.689786:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1657200/0x4642c20bf2f347d9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.689809:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:1.0:1787560651.689812:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560651.689816:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1657200/0x4642c20bf2f347d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.689823:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1657200/0x4642c20bf2f347d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.689847:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff800/0x4642c20bf2f347e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.689853:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff800/0x4642c20bf2f347e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.689859:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff800/0x4642c20bf2f347e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.689864:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ff800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560651.689867:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff800/0x4642c20bf2f347e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.689873:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff800/0x4642c20bf2f347e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.689880:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9caec3203600) 00010000:00010000:1.0:1787560651.689882:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560651.689885:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff800/0x4642c20bf2f347e0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.689891:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff800/0x4642c20bf2f347e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.689934:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1656000/0x4642c20bf2f347d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe74 expref: 41 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.689949:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fec00/0x4642c20bf2f347e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe74 expref: 40 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.689957:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:1.0:1787560651.689959:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787560651.689962:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb0021fec00, rc 0) 00000100:00100000:1.0:1787560651.690029:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+40:12239:x1874392853327360:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 697us (867us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1787560651.690036:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 165 00000100:00100000:0.0:1787560651.693081:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560651.693353:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853327488 00000100:00100000:1.0:1787560651.693362:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853327488 00000100:00100000:1.0:1787560651.693415:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 166 00000100:00100000:1.0:1787560651.693423:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+40:12239:x1874392853327488:12345-192.168.203.29@tcp:54:lfs.0 00010000:00010000:1.0:1787560651.693502:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f347f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.693517:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f347f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.693527:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f347f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.693561:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f347f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.693578:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f347f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.693585:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f347f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.693590:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ffa00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560651.693595:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f347f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.693602:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f347f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.693614:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:1.0:1787560651.693616:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787560651.693621:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f347f5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560651.693627:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f347f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560651.693694:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+40:12239:x1874392853327488:12345-192.168.203.29@tcp:54:lfs.0 Request processed in 272us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560651.693701:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 166 00000100:00100000:2.0:1787560651.696572:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560651.696665:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853327744 00000100:00100000:1.0:1787560651.696675:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853327744 00000100:00100000:1.0:1787560651.696732:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 41 00000100:00100000:1.0:1787560651.696742:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+40:12239:x1874392853327744:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:1.0:1787560651.696994:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+41:12239:x1874392853327744:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 252us (430us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1787560651.697016:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 41 00010000:00010000:0.0:1787560651.763647:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560651.774407:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560651.774477:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853327872 00000100:00100000:0.0:1787560651.774486:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560651.774489:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853327872 00000100:00100000:0.0:1787560651.774534:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560651.774562:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 385 00000100:00100000:0.0:1787560651.774569:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560651.774576:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5801450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+13:2403:x1874392853327872:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560651.774607:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560651.774656:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5801450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+13:2403:x1874392853327872:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 83us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560651.774665:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 385 00000100:00100000:2.0:1787560651.774673:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853328128 00000100:00100000:2.0:1787560651.774679:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853328128 00000100:00100000:1.0:1787560651.774704:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853328256 00000100:00100000:1.0:1787560651.774709:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853328256 00000100:00100000:2.0:1787560651.774719:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 122 00000100:00100000:2.0:1787560651.774729:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4066680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+7:2403:x1874392853328128:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560651.774752:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 123 00000100:00100000:1.0:1787560651.774761:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+6:2403:x1874392853328256:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560651.779596:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560651.779646:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853328384 00000100:00100000:0.0:1787560651.779655:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853328384 00000100:00100000:0.0:1787560651.779705:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853328000 00000100:00100000:0.0:1787560651.779709:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853328000 00000100:00100000:0.0:1787560651.779732:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853328512 00000100:00100000:0.0:1787560651.779735:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853328512 00000100:00100000:0.0:1787560651.779767:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 310 00000100:00100000:0.0:1787560651.779777:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853328384:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560651.779853:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853328384:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 78us (5319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560651.779860:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 310 00000100:00100000:0.0:1787560651.779877:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 311 00000100:00100000:0.0:1787560651.779883:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853328000:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560651.779908:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853328000:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 26us (5340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560651.779915:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 311 00000100:00100000:0.0:1787560651.779927:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 312 00000100:00100000:0.0:1787560651.779932:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853328512:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560651.779952:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853328512:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 20us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560651.779968:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 312 00000100:00080000:0.0:1787560651.780003:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787560651.780007:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787560651.784182:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4066680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+7:2403:x1874392853328128:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 9443us (9684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560651.784210:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 122 00000100:00100000:1.0:1787560651.787711:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+6:2403:x1874392853328256:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 12939us (13103us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560651.787727:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 123 00000100:00100000:3.0:1787560651.828822:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec408e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862830336:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787560651.828903:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560651.829257:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862830336 00000100:00100000:0.0:1787560651.829265:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862830336 00000100:00100000:0.0:1787560651.829318:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787560651.829328:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862830336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787560651.829360:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787560651.829414:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862830336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560651.829422:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787560651.829584:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec408e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862830336:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787560652.057657:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560652.057868:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853328768 00000100:00100000:1.0:1787560652.057878:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853328768 00000100:00100000:1.0:1787560652.057959:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 167 00000100:00100000:1.0:1787560652.057972:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+41:12270:x1874392853328768:12345-192.168.203.29@tcp:101:cat.0 00010000:00010000:1.0:1787560652.057996:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560652.058019:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f347fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fe7b expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.058123:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff800/0x4642c20bf2f34803 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.058155:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff800/0x4642c20bf2f34803 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.058360:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff800/0x4642c20bf2f34803 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560652.058378:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787560652.058526:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f347fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe7b expref: 44 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.058545:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff800/0x4642c20bf2f34803 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe7b expref: 43 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.058551:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:1.0:1787560652.058553:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787560652.058556:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb0021ff800, rc 0) 00000100:00100000:1.0:1787560652.058620:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+43:12270:x1874392853328768:12345-192.168.203.29@tcp:101:cat.0 Request processed in 652us (985us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1787560652.058626:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 167 00000100:00080000:0.0:1787560652.059461:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560652.062879:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560652.063117:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853329024 00000100:00100000:1.0:1787560652.063127:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853329024 00000100:00100000:1.0:1787560652.063317:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 42 00000100:00100000:1.0:1787560652.063329:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+43:12270:x1874392853329024:12345-192.168.203.29@tcp:35:cat.0 00000100:00100000:1.0:1787560652.063601:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+44:12270:x1874392853329024:12345-192.168.203.29@tcp:35:cat.0 Request processed in 274us (730us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1787560652.063610:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 42 00000100:00100000:3.0:1787560652.065572:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560652.065843:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853329152 00000100:00100000:1.0:1787560652.065859:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853329152 00000100:00100000:1.0:1787560652.065917:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:1.0:1787560652.065927:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd7cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+44:2405:x1874392853329152:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560652.065942:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560652.065965:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff800/0x4642c20bf2f34803 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe7b expref: 44 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.065985:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:1.0:1787560652.065989:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560652.066041:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd7cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+43:2405:x1874392853329152:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 116us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560652.066048:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:0.0:1787560652.156521:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560652.156618:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853329408 00000100:00100000:1.0:1787560652.156628:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853329408 00000100:00100000:1.0:1787560652.156689:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 168 00000100:00100000:1.0:1787560652.156700:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+43:12276:x1874392853329408:12345-192.168.203.29@tcp:101:dd.0 00010000:00010000:1.0:1787560652.156724:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560652.156727:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787560652.156760:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f34769 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe51 expref: 43 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.156780:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:1.0:1787560652.156785:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787560652.156797:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff800/0x4642c20bf2f34811 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fe82 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.156903:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f34818 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.156928:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fec00/0x4642c20bf2f347e7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe74 expref: 43 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.156936:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f34818 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.156965:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fec00/0x4642c20bf2f347e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe74 expref: 43 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.156978:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fec00/0x4642c20bf2f347e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe74 expref: 43 pid: 6498 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560652.156991:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec40fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6499:1874392862830464:192.168.203.29@tcp:104: 00000100:00100000:1.0:1787560652.157085:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec31ec600 going to sleep for 11 seconds 00000100:00100000:0.0:1787560652.169114:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560652.169303:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853329536 00000100:00100000:3.0:1787560652.169314:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853329536 00010000:00010000:3.0:1787560652.169355:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fec00/0x4642c20bf2f347e7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe74 expref: 44 pid: 6498 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560652.169401:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 85 00000100:00100000:3.0:1787560652.169411:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+44:2404:x1874392853329536:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560652.169424:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560652.169476:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fec00/0x4642c20bf2f347e7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe74 expref: 44 pid: 6498 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.169489:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fec00/0x4642c20bf2f347e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe74 expref: 44 pid: 6498 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.169510:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:3.0:1787560652.169515:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f34818 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.169525:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f34818 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.169533:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f34818 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.169552:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560652.169598:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+44:2404:x1874392853329536:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 188us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560652.169605:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 85 00010000:00010000:1.0:1787560652.171120:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fec00/0x4642c20bf2f347e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe74 expref: 43 pid: 6498 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560652.171144:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec40fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6499:1874392862830464:192.168.203.29@tcp:104: 00010000:00010000:1.0:1787560652.171178:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f34818 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.171188:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f34818 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.171194:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f34818 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560652.171213:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787560652.171351:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff800/0x4642c20bf2f34811 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe82 expref: 44 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.171366:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f34818 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe82 expref: 43 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.171375:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:1.0:1787560652.171378:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787560652.171380:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb0021ffa00, rc 0) 00000100:00100000:1.0:1787560652.171478:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+43:12276:x1874392853329408:12345-192.168.203.29@tcp:101:dd.0 Request processed in 14779us (14966us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1787560652.171487:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 168 00000100:00100000:0.0:1787560652.178104:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560652.178189:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853329664 00000100:00100000:3.0:1787560652.178199:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853329664 00000100:00100000:3.0:1787560652.178262:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 169 00000100:00100000:3.0:1787560652.178273:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+43:12276:x1874392853329664:12345-192.168.203.29@tcp:101:dd.0 00010000:00010000:3.0:1787560652.178296:0:10172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560652.178316:0:10172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f34826 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fe89 expref: -99 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.178349:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f3482d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.178363:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f3482d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.178376:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f3482d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.178513:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f34826 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe89 expref: 45 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.178532:0:10172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f3482d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe89 expref: 44 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.178541:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:3.0:1787560652.178544:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787560652.178548:0:10172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafc0030400, rc 0) 00000100:00100000:3.0:1787560652.178608:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+44:12276:x1874392853329664:12345-192.168.203.29@tcp:101:dd.0 Request processed in 337us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560652.178615:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 169 00000100:00100000:3.0:1787560652.181320:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560652.181495:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853329920 00000100:00100000:2.0:1787560652.181504:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853329920 00000100:00100000:2.0:1787560652.181562:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 170 00000100:00100000:2.0:1787560652.181571:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+44:12276:x1874392853329920:12345-192.168.203.29@tcp:36:dd.0 00010000:00010000:2.0:1787560652.181792:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34834 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560652.181808:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34834 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560652.181818:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34834 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787560652.181869:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:2.0:1787560652.181892:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006aa0137a reply state 00000000a94cd5de transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34834 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560652.181904:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34834 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560652.181911:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:2.0:1787560652.181914:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787560652.181917:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787560652.182002:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+47:12276:x1874392853329920:12345-192.168.203.29@tcp:36:dd.0 Request processed in 431us (690us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1787560652.182009:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 170 00000020:00080000:2.0:1787560652.182013:0:6498:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787560652.532312:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560652.532423:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853330048 00000100:00100000:1.0:1787560652.532464:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853330048 00000100:00100000:1.0:1787560652.532519:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 171 00000100:00100000:1.0:1787560652.532531:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+47:12290:x1874392853330048:12345-192.168.203.29@tcp:101:stat.0 00010000:00010000:1.0:1787560652.532565:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560652.532586:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff800/0x4642c20bf2f3483b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fe90 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.532650:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fec00/0x4642c20bf2f34842 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.532664:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fec00/0x4642c20bf2f34842 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.532675:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fec00/0x4642c20bf2f34842 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.532703:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff000/0x4642c20bf2f34849 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.532711:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff000/0x4642c20bf2f34849 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.532718:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff000/0x4642c20bf2f34849 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.532782:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f34850 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.532792:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f34818 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe82 expref: 48 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.532800:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f34850 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.532856:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f34818 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe82 expref: 48 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.532869:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f34818 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe82 expref: 48 pid: 6499 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560652.532881:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec40fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6499:1874392862830592:192.168.203.29@tcp:104: 00000100:00100000:1.0:1787560652.532976:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec31ec600 going to sleep for 11 seconds 00000100:00100000:3.0:1787560652.536984:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560652.537624:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec40fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6499:1874392862830592:192.168.203.29@tcp:104: 00000100:00100000:2.0:1787560652.537660:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853330304 00000100:00100000:2.0:1787560652.537668:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853330304 00010000:00010000:1.0:1787560652.537718:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f34850 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560652.537732:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 43 00000100:00100000:2.0:1787560652.537746:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc87ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+49:6644:x1874392853330304:12345-192.168.203.29@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787560652.538052:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc87ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+50:6644:x1874392853330304:12345-192.168.203.29@tcp:35:ldlm_bl.0 Request processed in 308us (1076us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1787560652.538059:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 43 00000100:00100000:2.0:1787560652.541955:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560652.542031:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853330432 00000100:00100000:1.0:1787560652.542041:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853330432 00010000:00010000:1.0:1787560652.542083:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f34818 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe82 expref: 50 pid: 6499 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560652.542125:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 86 00000100:00100000:1.0:1787560652.542140:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+50:2404:x1874392853330432:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560652.542155:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560652.542161:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f34818 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe82 expref: 50 pid: 6499 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.542174:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f34818 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe82 expref: 50 pid: 6499 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.542196:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f34818 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe82 expref: 50 pid: 6499 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.542213:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:1.0:1787560652.542218:0:6486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f34850 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.542228:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f34850 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.542236:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f34850 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.542371:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560652.542477:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+49:2404:x1874392853330432:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 342us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560652.542485:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 86 00010000:00010000:0.0:1787560652.544355:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f34850 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.544373:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f34850 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560652.544518:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787560652.544523:0:6499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787560652.544551:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f34850 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.544589:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f34850 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.544599:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fec00/0x4642c20bf2f34842 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.544607:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fec00/0x4642c20bf2f34842 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.544614:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fec00/0x4642c20bf2f34842 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.544619:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021fec00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560652.544623:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fec00/0x4642c20bf2f34842 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.544629:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fec00/0x4642c20bf2f34842 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.544644:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:0.0:1787560652.544647:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560652.544651:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fec00/0x4642c20bf2f34842 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.544657:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fec00/0x4642c20bf2f34842 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.544675:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff000/0x4642c20bf2f34849 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.544682:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff000/0x4642c20bf2f34849 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.544694:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff000/0x4642c20bf2f34849 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.544699:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ff000 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560652.544702:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff000/0x4642c20bf2f34849 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.544708:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff000/0x4642c20bf2f34849 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.544716:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9caec3203600) 00010000:00010000:0.0:1787560652.544785:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560652.544789:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff000/0x4642c20bf2f34849 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.544796:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff000/0x4642c20bf2f34849 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.544847:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff800/0x4642c20bf2f3483b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe90 expref: 49 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.544862:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f34850 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe90 expref: 48 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.544869:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:0.0:1787560652.544871:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787560652.544874:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb0021fe800, rc 0) 00000100:00100000:0.0:1787560652.544946:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+48:12290:x1874392853330048:12345-192.168.203.29@tcp:101:stat.0 Request processed in 12417us (12642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560652.544965:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 171 00000040:00080000:3.0:1787560652.595739:0:13775:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787560652.595748:0:13775:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787560652.595874:0:13775:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1787560652.595882:0:13775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787560652.675570:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560652.678109:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853330688 00000100:00100000:1.0:1787560652.678124:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853330688 00000100:00100000:1.0:1787560652.678196:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 172 00000100:00100000:1.0:1787560652.678207:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+48:12296:x1874392853330688:12345-192.168.203.29@tcp:36:truncate.0 00010000:00010000:1.0:1787560652.678262:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560652.678291:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f34850 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe90 expref: 48 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.678311:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:1.0:1787560652.678315:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787560652.678523:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f34857 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.678538:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f34857 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.678548:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f34857 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787560652.678591:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:1.0:1787560652.678612:0:6500:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f77d6502 reply state 00000000f2a77644 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f34857 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.678624:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f34857 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.678630:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:1.0:1787560652.678647:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787560652.678650:0:6500:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787560652.678762:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+50:12296:x1874392853330688:12345-192.168.203.29@tcp:36:truncate.0 Request processed in 556us (3201us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1787560652.678770:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 172 00000020:00080000:1.0:1787560652.678774:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787560652.787884:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560652.962383:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560652.962474:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853330816 00000100:00100000:0.0:1787560652.962485:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853330816 00000100:00100000:0.0:1787560652.962549:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 173 00000100:00100000:0.0:1787560652.962560:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+50:12311:x1874392853330816:12345-192.168.203.29@tcp:101:stat.0 00010000:00010000:0.0:1787560652.962585:0:13787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560652.962605:0:13787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f3485e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fe97 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.962668:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34865 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.962682:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34865 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.962694:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34865 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.962705:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3486c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.962712:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3486c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.962718:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3486c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.962826:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34873 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.962855:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34873 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.962863:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34873 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560652.962906:0:13787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1787560652.962911:0:13787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787560652.962930:0:13787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34873 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.962941:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34873 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.962949:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34865 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.962955:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34865 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.962961:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34865 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.962967:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560652.962972:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34865 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.962979:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34865 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.962991:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:0.0:1787560652.962999:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560652.963004:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34865 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.963010:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34865 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.963024:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3486c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.963030:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3486c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.963036:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3486c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.963041:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881a00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560652.963043:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3486c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.963049:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3486c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.963056:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9caec3203600) 00010000:00010000:0.0:1787560652.963059:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560652.963061:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3486c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.963067:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f3486c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.963095:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f3485e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe97 expref: 52 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.963119:0:13787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34873 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe97 expref: 51 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.963126:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:0.0:1787560652.963128:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787560652.963130:0:13787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3880000, rc 0) 00000100:00100000:0.0:1787560652.963202:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+51:12311:x1874392853330816:12345-192.168.203.29@tcp:101:stat.0 Request processed in 643us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560652.963209:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 173 00000040:00080000:1.0:1787560652.980920:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787560653.092848:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560653.097424:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853331072 00000100:00100000:1.0:1787560653.097469:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853331072 00000100:00100000:1.0:1787560653.097552:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 174 00000100:00100000:1.0:1787560653.097563:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+51:12321:x1874392853331072:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:1.0:1787560653.097584:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560653.097603:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f3487a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fe9e expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560653.097699:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1787560653.097799:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f3487a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe9e expref: 53 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560653.097813:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec3203400) 00010000:00010000:1.0:1787560653.097825:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787560653.097830:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f3487a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe9e expref: 53 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560653.097847:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb0021fe800, rc 0) 00000100:00100000:1.0:1787560653.097918:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+52:12321:x1874392853331072:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 357us (5079us total) trans 4294967447 rc 301/301 00000100:00100000:1.0:1787560653.097940:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 174 00000100:00100000:2.0:1787560653.111917:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560653.112013:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853331328 00000100:00100000:3.0:1787560653.112025:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853331328 00000100:00100000:3.0:1787560653.112088:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 44 00000100:00100000:3.0:1787560653.112098:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd7c05050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+52:12321:x1874392853331328:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:3.0:1787560653.112343:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd7c05050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+53:12321:x1874392853331328:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 245us (434us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1787560653.112352:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 44 00000100:00100000:2.0:1787560653.191394:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560653.191548:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853331584 00000100:00100000:0.0:1787560653.191559:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853331584 00000100:00100000:0.0:1787560653.191622:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 175 00000100:00100000:0.0:1787560653.191634:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+53:12327:x1874392853331584:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:0.0:1787560653.191657:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560653.191678:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34888 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fea5 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.191799:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f3488f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.191831:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34873 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe97 expref: 54 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.191841:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f3488f lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.191894:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34873 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe97 expref: 54 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.191910:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34873 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe97 expref: 54 pid: 13787 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560653.191924:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec408d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6498:1874392862830720:192.168.203.29@tcp:104: 00000100:00100000:0.0:1787560653.192085:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec17c9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787560653.197560:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560653.197673:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec408d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6498:1874392862830720:192.168.203.29@tcp:104: 00010000:00010000:2.0:1787560653.197699:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f3488f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560653.199184:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853331712 00000100:00100000:3.0:1787560653.199197:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853331712 00010000:00010000:3.0:1787560653.199246:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34873 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe97 expref: 55 pid: 13787 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560653.199291:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 87 00000100:00100000:3.0:1787560653.199300:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+55:2404:x1874392853331712:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560653.199314:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560653.199321:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34873 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe97 expref: 55 pid: 13787 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560653.199334:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34873 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe97 expref: 55 pid: 13787 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560653.199373:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34873 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe97 expref: 55 pid: 13787 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560653.199390:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:3.0:1787560653.199396:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f3488f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560653.199405:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f3488f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560653.199413:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f3488f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560653.199655:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560653.199717:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+54:2404:x1874392853331712:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 417us (2167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560653.199726:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 87 00010000:00010000:1.0:1787560653.200338:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f3488f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560653.200349:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f3488f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560653.200369:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1787560653.200721:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34888 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fea5 expref: 55 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560653.200742:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f3488f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fea5 expref: 54 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560653.200750:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:1.0:1787560653.200753:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787560653.200756:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881800, rc 0) 00000100:00100000:1.0:1787560653.200927:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+54:12327:x1874392853331584:12345-192.168.203.29@tcp:101:bash.0 Request processed in 9294us (9542us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1787560653.200936:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 175 00000100:00100000:0.0:1787560653.213337:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560653.213465:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853331968 00000100:00100000:3.0:1787560653.213476:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853331968 00000100:00100000:3.0:1787560653.213542:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 176 00000100:00100000:3.0:1787560653.213553:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+54:12327:x1874392853331968:12345-192.168.203.29@tcp:36:bash.0 00010000:00010000:3.0:1787560653.213798:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f3489d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560653.213825:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f3489d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560653.213837:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f3489d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787560653.213899:0:10172:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:3.0:1787560653.213924:0:10172:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc9b5371 reply state 0000000090b155cd transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f3489d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560653.213938:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f3489d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560653.213944:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:3.0:1787560653.213947:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787560653.213951:0:10172:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787560653.214051:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+57:12327:x1874392853331968:12345-192.168.203.29@tcp:36:bash.0 Request processed in 499us (723us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1787560653.214058:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 176 00000020:00080000:3.0:1787560653.214063:0:10172:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787560653.241959:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560653.242265:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853332096 00000100:00100000:0.0:1787560653.242275:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853332096 00000100:00100000:0.0:1787560653.242338:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 177 00000100:00100000:0.0:1787560653.242353:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc87ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+57:12327:x1874392853332096:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:0.0:1787560653.242378:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560653.242401:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f348a4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605feac expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.242522:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f348ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.242552:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f3488f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fea5 expref: 58 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.242561:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f348ab lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.242612:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f3488f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fea5 expref: 58 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.242625:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f3488f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fea5 expref: 58 pid: 6498 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560653.242640:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec408ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6500:1874392862830848:192.168.203.29@tcp:104: 00000100:00100000:0.0:1787560653.242752:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec17c96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560653.246598:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec408ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6500:1874392862830848:192.168.203.29@tcp:104: 00010000:00010000:0.0:1787560653.246627:0:6500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f348ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560653.247935:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560653.248201:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853332224 00000100:00100000:1.0:1787560653.248210:0:9502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853332224 00010000:00010000:1.0:1787560653.248253:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f3488f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fea5 expref: 59 pid: 6498 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560653.248297:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 88 00000100:00100000:1.0:1787560653.248306:0:9502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc87aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+59:2405:x1874392853332224:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560653.248336:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560653.248344:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f3488f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fea5 expref: 59 pid: 6498 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560653.248357:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f3488f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fea5 expref: 59 pid: 6498 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560653.248379:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f3488f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fea5 expref: 59 pid: 6498 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560653.248395:0:9502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:1.0:1787560653.248400:0:9502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f348ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560653.248410:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f348ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560653.248418:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f348ab lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560653.248489:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560653.248557:0:9502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc87aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+58:2405:x1874392853332224:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 252us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560653.248566:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 88 00010000:00010000:2.0:1787560653.249019:0:6500:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f348ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.249029:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f348ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560653.249082:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787560653.249086:0:6500:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787560653.249106:0:6500:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f348ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.249138:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f348a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605feac expref: 58 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.249183:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f348ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605feac expref: 57 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.249192:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:2.0:1787560653.249195:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787560653.249197:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881600, rc 0) 00000100:00100000:2.0:1787560653.249240:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc87ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+57:12327:x1874392853332096:12345-192.168.203.29@tcp:101:bash.0 Request processed in 6891us (7290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560653.249247:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 177 00000100:00100000:3.0:1787560653.263078:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560653.269715:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853332480 00000100:00100000:2.0:1787560653.269733:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853332480 00000100:00100000:2.0:1787560653.269827:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 45 00000100:00100000:2.0:1787560653.269839:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+57:12327:x1874392853332480:12345-192.168.203.29@tcp:35:bash.0 00000100:00100000:2.0:1787560653.270070:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+58:12327:x1874392853332480:12345-192.168.203.29@tcp:35:bash.0 Request processed in 232us (7000us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1787560653.270079:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 45 00000100:00100000:3.0:1787560653.363886:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787560653.363911:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec38f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862830976:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787560653.363986:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560653.364291:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862830976 00000100:00100000:2.0:1787560653.364300:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862830976 00000100:00100000:2.0:1787560653.364374:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787560653.364384:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862830976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787560653.364417:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787560653.364491:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862830976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560653.364498:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000004:00080000:0.0:1787560653.364740:0:8606:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 372704307570ns, next at 373704305078ns, rc = 0 00000100:00100000:0.0:1787560653.364758:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787560653.364768:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec408ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862831104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787560653.364800:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560653.364977:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862831104 00000100:00100000:3.0:1787560653.364983:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862831104 00000100:00100000:3.0:1787560653.365023:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787560653.365030:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1874392862831104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787560653.365042:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787560653.365212:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec408ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862831104:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787560653.365249:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787560653.365278:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec38f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862830976:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787560653.365325:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1874392862831104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560653.365334:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787560653.385947:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560653.386055:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853332736 00000100:00100000:2.0:1787560653.386070:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853332736 00000100:00100000:2.0:1787560653.386197:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 178 00000100:00100000:2.0:1787560653.386209:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec40fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+58:12337:x1874392853332736:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1787560653.386235:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560653.386257:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f348b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605feb3 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560653.386351:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787560653.386475:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f348b2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605feb3 expref: 60 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.386491:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec3203400) 00010000:00010000:2.0:1787560653.386494:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787560653.386500:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f348b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605feb3 expref: 60 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.386514:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2169e00, rc 0) 00000100:00100000:2.0:1787560653.386845:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec40fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+59:12337:x1874392853332736:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 637us (906us total) trans 4294967453 rc 301/301 00000100:00100000:2.0:1787560653.386854:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 178 00000100:00100000:3.0:1787560653.391002:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560653.391079:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853332864 00000100:00100000:0.0:1787560653.391101:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853332864 00000100:00100000:0.0:1787560653.391163:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 179 00000100:00100000:0.0:1787560653.391174:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+59:12337:x1874392853332864:12345-192.168.203.29@tcp:34:lfs.0 00010000:00010000:0.0:1787560653.391252:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f348c0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.391271:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f348c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.391282:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f348c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.391310:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f348c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.391319:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f348c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.391328:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f348c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.391399:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f348ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.391409:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f348ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.391417:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f348ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787560653.391490:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f348ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.391504:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f348c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.391512:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f348c0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.391519:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f348c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.391975:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560653.391980:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f348c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.391994:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f348c0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.392007:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:0.0:1787560653.392009:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560653.392014:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f348c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.392020:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f348c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.392035:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f348c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.392041:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f348c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.392047:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f348c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.392052:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881c00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560653.392055:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f348c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.392060:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f348c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.392067:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9caec3203600) 00010000:00010000:0.0:1787560653.392069:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560653.392072:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f348c7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.392088:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f348c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.392097:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f348ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.392103:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f348ce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.392109:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f348ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.392114:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881a00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560653.392116:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f348ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.392122:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f348ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.392129:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:0.0:1787560653.392131:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560653.392134:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f348ce lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.392139:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f348ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560653.392716:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+59:12337:x1874392853332864:12345-192.168.203.29@tcp:34:lfs.0 Request processed in 1537us (1717us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560653.392726:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 179 00000100:00100000:3.0:1787560653.395363:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560653.398711:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853333120 00000100:00100000:2.0:1787560653.398726:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853333120 00000100:00100000:2.0:1787560653.398890:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 46 00000100:00100000:2.0:1787560653.398902:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+59:12337:x1874392853333120:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:2.0:1787560653.399361:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+60:12337:x1874392853333120:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 458us (4004us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1787560653.399371:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 46 00000100:00100000:3.0:1787560653.451937:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560653.452047:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853333376 00000100:00100000:2.0:1787560653.452057:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853333376 00000100:00100000:2.0:1787560653.452137:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 180 00000100:00100000:2.0:1787560653.452148:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+60:12340:x1874392853333376:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1787560653.452175:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560653.452196:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f348d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605feba expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.452269:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f348dc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.452282:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f348dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.452294:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f348dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.452303:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f348e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.452310:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f348e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.452314:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f348e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.452416:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f348ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.452426:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f348ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.452482:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f348ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560653.452492:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787560653.452874:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f348dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.452883:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f348dc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.452890:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f348dc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.452896:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560653.452901:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f348dc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.452908:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f348dc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.452922:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:2.0:1787560653.452925:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560653.452930:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f348dc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.452937:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f348dc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.452949:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f348e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.452955:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f348e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.452968:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f348e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.452974:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169400 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560653.452977:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f348e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.452983:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f348e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.452992:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9caec3203600) 00010000:00010000:2.0:1787560653.452995:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560653.452998:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f348e3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.453004:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f348e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.453041:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f348d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605feba expref: 63 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.453056:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f348ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605feba expref: 62 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.453064:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:2.0:1787560653.453066:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787560653.453069:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2168400, rc 0) 00000100:00100000:2.0:1787560653.453153:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+62:12340:x1874392853333376:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 1006us (1225us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1787560653.453170:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 180 00000100:00100000:1.0:1787560653.457492:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560653.457634:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853333504 00000100:00100000:2.0:1787560653.457643:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853333504 00000100:00100000:2.0:1787560653.457694:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 181 00000100:00100000:2.0:1787560653.457704:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec40ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+62:12340:x1874392853333504:12345-192.168.203.29@tcp:54:lfs.0 00010000:00010000:2.0:1787560653.457783:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f348f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.457799:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f348f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.457810:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f348f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.457850:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f348f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.457857:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f348f8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.457863:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f348f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.457868:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168a00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560653.457872:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f348f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.457878:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f348f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.457889:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:2.0:1787560653.457903:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787560653.457908:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f348f8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.457914:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f348f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560653.458201:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec40ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+62:12340:x1874392853333504:12345-192.168.203.29@tcp:54:lfs.0 Request processed in 497us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560653.458210:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 181 00000100:00100000:3.0:1787560653.461021:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560653.461333:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853333632 00000100:00100000:2.0:1787560653.461344:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853333632 00000100:00100000:2.0:1787560653.461400:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:2.0:1787560653.461410:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+62:2405:x1874392853333632:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560653.461424:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560653.461479:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f348ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605feba expref: 62 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.461499:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:2.0:1787560653.461503:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560653.461560:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+61:2405:x1874392853333632:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 150us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560653.461567:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:3.0:1787560653.467642:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560653.467853:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853333888 00000100:00100000:1.0:1787560653.467865:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853333888 00000100:00100000:1.0:1787560653.467920:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 47 00000100:00100000:1.0:1787560653.467932:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+61:12340:x1874392853333888:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:1.0:1787560653.468203:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+62:12340:x1874392853333888:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 272us (568us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1787560653.468211:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 47 00000100:00100000:1.0:1787560653.663524:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560653.663629:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853334144 00000100:00100000:0.0:1787560653.663639:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853334144 00000100:00100000:0.0:1787560653.663700:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 182 00000100:00100000:0.0:1787560653.663709:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec40ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+62:12358:x1874392853334144:12345-192.168.203.29@tcp:101:cat.0 00010000:00010000:0.0:1787560653.663732:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560653.663766:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f348ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fec1 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.663883:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34906 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.663897:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34906 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.663910:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34906 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560653.663921:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787560653.664029:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f348ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fec1 expref: 65 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.664048:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34906 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fec1 expref: 64 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.664057:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:0.0:1787560653.664060:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787560653.664063:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881c00, rc 0) 00000100:00100000:0.0:1787560653.664128:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec40ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+64:12358:x1874392853334144:12345-192.168.203.29@tcp:101:cat.0 Request processed in 419us (612us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1787560653.664153:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 182 00000100:00100000:1.0:1787560653.693780:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560653.693918:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853334272 00000100:00100000:3.0:1787560653.693926:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853334272 00000100:00100000:3.0:1787560653.693986:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 183 00000100:00100000:3.0:1787560653.693996:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec40fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+64:12359:x1874392853334272:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1787560653.694018:0:10172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560653.694036:0:10172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f34914 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fec8 expref: -99 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560653.694112:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f3491b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560653.694126:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f3491b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560653.694138:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f3491b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560653.694181:0:10172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1787560653.694186:0:10172:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787560653.694204:0:10172:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f3491b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560653.694228:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f34914 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fec8 expref: 66 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560653.694264:0:10172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f3491b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fec8 expref: 65 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560653.694273:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:3.0:1787560653.694277:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787560653.694280:0:10172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f7000, rc 0) 00000100:00100000:3.0:1787560653.694344:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec40fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+65:12359:x1874392853334272:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 348us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560653.694351:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 183 00000100:00100000:3.0:1787560653.705767:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560653.705862:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853334656 00000100:00100000:1.0:1787560653.705871:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853334656 00000100:00100000:1.0:1787560653.705928:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 48 00000100:00100000:1.0:1787560653.705939:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+65:12359:x1874392853334656:12345-192.168.203.29@tcp:35:lfs.0 00000001:00080000:1.0:1787560653.706152:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967458 00000100:00100000:1.0:1787560653.706249:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+67:12359:x1874392853334656:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 311us (502us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1787560653.706258:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 48 00000020:00080000:1.0:1787560653.706263:0:6502:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787560653.710098:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560653.710186:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853334784 00000100:00100000:3.0:1787560653.710196:0:9502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853334784 00000100:00100000:3.0:1787560653.710263:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:3.0:1787560653.710274:0:9502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec40fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+67:12359:x1874392853334784:12345-192.168.203.29@tcp:103:lfs.0 00010000:00010000:3.0:1787560653.710288:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787560653.710314:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f348ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605feac expref: 67 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560653.710338:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34906 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fec1 expref: 66 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560653.710351:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f347a8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe66 expref: 65 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560653.710361:0:9502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:3.0:1787560653.710380:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560653.710490:0:9502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec40fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+64:12359:x1874392853334784:12345-192.168.203.29@tcp:103:lfs.0 Request processed in 217us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560653.710498:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:3.0:1787560653.712774:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560653.712904:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853334912 00000100:00100000:2.0:1787560653.712914:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853334912 00000100:00100000:2.0:1787560653.712971:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 184 00000100:00100000:2.0:1787560653.712981:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+64:12359:x1874392853334912:12345-192.168.203.29@tcp:58:lfs.0 00010000:00010000:2.0:1787560653.713105:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34922 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.713135:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34922 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560653.713147:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34922 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787560653.713239:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1787560653.713320:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+64:12359:x1874392853334912:12345-192.168.203.29@tcp:58:lfs.0 Request processed in 339us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560653.713328:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 184 00000100:00100000:2.0:1787560653.749820:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560653.750651:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853335040 00000100:00100000:0.0:1787560653.750662:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853335040 00000100:00100000:0.0:1787560653.750838:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 185 00000100:00100000:0.0:1787560653.750849:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+64:12361:x1874392853335040:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:0.0:1787560653.750870:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560653.750891:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34929 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fecf expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.750956:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34930 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.750970:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34930 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.750980:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34930 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.750989:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34937 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.750996:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34937 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.751002:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34937 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.751067:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f3493e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.752245:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f3493e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.752256:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f3493e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560653.752306:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787560653.752310:0:6500:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787560653.752330:0:6500:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f3493e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.752341:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f3493e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.752350:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34930 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.752356:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34930 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.752364:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34930 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.752369:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560653.752373:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34930 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.752379:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34930 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.752391:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:0.0:1787560653.752394:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560653.752413:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34930 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.752419:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34930 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.752451:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34937 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.752459:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34937 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.752464:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34937 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.752468:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880000 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560653.752471:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34937 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.752476:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34937 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.752484:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9caec3203600) 00010000:00010000:0.0:1787560653.752486:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560653.752490:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34937 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.752496:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34937 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.752543:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34929 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fecf expref: 66 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.752569:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f3493e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fecf expref: 65 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.752576:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:0.0:1787560653.752578:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787560653.752581:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3880c00, rc 0) 00000100:00100000:0.0:1787560653.752723:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+65:12361:x1874392853335040:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 1874us (2977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560653.752732:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 185 00010000:00010000:2.0:1787560653.811606:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560654.387600:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787560654.387622:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3af2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862831232:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787560654.387711:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560654.388003:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862831232 00000100:00100000:1.0:1787560654.388011:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862831232 00000100:00100000:1.0:1787560654.388075:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787560654.388086:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4043100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862831232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787560654.388112:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787560654.388157:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4043100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862831232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560654.388174:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787560654.388200:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec38f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862831488:0@lo:400:kworker.0 00000100:00100000:1.0:1787560654.388231:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560654.388251:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862832000:0@lo:400:kworker.0 00000100:00100000:1.0:1787560654.388270:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560654.388286:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec39ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874392862832512:0@lo:400:kworker.0 00000100:00100000:1.0:1787560654.388313:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560654.388332:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787560654.388338:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec38f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862831360:0@lo:400:kworker.0 00000100:00100000:1.0:1787560654.388365:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560654.388388:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3a18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862831872:0@lo:400:kworker.0 00000100:00100000:1.0:1787560654.388412:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560654.388455:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec39ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862832384:0@lo:400:kworker.0 00000100:00100000:1.0:1787560654.388481:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560654.388506:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec38f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874392862831744:0@lo:400:kworker.0 00000100:00100000:1.0:1787560654.388531:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560654.388549:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862832256:0@lo:400:kworker.0 00000100:00100000:1.0:1787560654.388570:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560654.388586:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862832768:0@lo:400:kworker.0 00000100:00100000:1.0:1787560654.388606:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560654.388624:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787560654.388629:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec38f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862831616:0@lo:400:kworker.0 00000100:00100000:1.0:1787560654.388650:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560654.388676:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec38ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874392862832128:0@lo:400:kworker.0 00000100:00100000:1.0:1787560654.388696:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560654.388712:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862832640:0@lo:400:kworker.0 00000100:00100000:1.0:1787560654.388732:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560654.388755:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862831488 00000100:00100000:1.0:1787560654.388759:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862831488 00000100:00100000:1.0:1787560654.388781:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862832000 00000100:00100000:1.0:1787560654.388784:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862832000 00000100:00100000:1.0:1787560654.388798:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862832512 00000100:00100000:1.0:1787560654.388800:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862832512 00000100:00100000:1.0:1787560654.388823:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862831744 00000100:00100000:1.0:1787560654.388826:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862831744 00000100:00100000:1.0:1787560654.388850:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862832128 00000100:00100000:1.0:1787560654.388854:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862832128 00000100:00100000:1.0:1787560654.388866:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862832640 00000100:00100000:1.0:1787560654.388868:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862832640 00000100:00100000:1.0:1787560654.388881:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1787560654.388887:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec40ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862831488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560654.388926:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec40ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862831488:12345-0@lo:400:kworker.0 Request processed in 39us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560654.388933:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1787560654.388946:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1787560654.388952:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec40fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862832000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560654.388978:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec40fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862832000:12345-0@lo:400:kworker.0 Request processed in 27us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560654.388984:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1787560654.388995:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1787560654.389001:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec40fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874392862832512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560654.389039:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec40fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874392862832512:12345-0@lo:400:kworker.0 Request processed in 38us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560654.389045:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1787560654.389057:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1787560654.389063:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec40fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874392862831744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560654.389090:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec40fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874392862831744:12345-0@lo:400:kworker.0 Request processed in 27us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560654.389095:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1787560654.389106:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1787560654.389111:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874392862832128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560654.389135:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874392862832128:12345-0@lo:400:kworker.0 Request processed in 24us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560654.389142:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1787560654.389151:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1787560654.389157:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874392862832640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560654.389182:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874392862832640:12345-0@lo:400:kworker.0 Request processed in 25us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560654.389188:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1787560654.389211:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862831360 00000100:00100000:1.0:1787560654.389215:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862831360 00000100:00100000:1.0:1787560654.389240:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1787560654.389246:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5801850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3624:x1874392862831360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560654.389276:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5801850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3624:x1874392862831360:12345-0@lo:400:kworker.0 Request processed in 30us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560654.389281:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1787560654.389318:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862831872 00000100:00100000:1.0:1787560654.389322:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862831872 00000100:00100000:1.0:1787560654.389345:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862831616 00000100:00100000:1.0:1787560654.389348:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862831616 00000100:00100000:1.0:1787560654.389360:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787560654.389366:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec40ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862831872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560654.389397:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec40ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862831872:12345-0@lo:400:kworker.0 Request processed in 30us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560654.389404:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787560654.389415:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787560654.389420:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4067480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862831616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560654.389471:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4067480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862831616:12345-0@lo:400:kworker.0 Request processed in 50us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560654.389477:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787560654.389492:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862832384 00000100:00100000:1.0:1787560654.389495:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862832384 00000100:00100000:1.0:1787560654.389516:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862832256 00000100:00100000:1.0:1787560654.389518:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862832256 00000100:00100000:1.0:1787560654.389527:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862832768 00000100:00100000:1.0:1787560654.389530:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862832768 00000100:00100000:1.0:1787560654.389543:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787560654.389549:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec40fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3624:x1874392862832384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560654.389578:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec40fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3624:x1874392862832384:12345-0@lo:400:kworker.0 Request processed in 29us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560654.389584:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787560654.389595:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787560654.389601:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862832256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560654.389625:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862832256:12345-0@lo:400:kworker.0 Request processed in 24us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560654.389637:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787560654.389649:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787560654.389654:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeabaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862832768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560654.389694:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeabaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862832768:12345-0@lo:400:kworker.0 Request processed in 39us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560654.389700:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787560654.389749:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec38f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862831360:0@lo:400:kworker.0 00000100:00100000:1.0:1787560654.389762:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3a18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862831872:0@lo:400:kworker.0 00000100:00100000:1.0:1787560654.389773:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec39ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862832384:0@lo:400:kworker.0 00000100:00100000:1.0:1787560654.389783:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec38f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862831488:0@lo:400:kworker.0 00000100:00100000:1.0:1787560654.389793:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862832000:0@lo:400:kworker.0 00000100:00100000:1.0:1787560654.389802:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec39ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874392862832512:0@lo:400:kworker.0 00000100:00100000:1.0:1787560654.389859:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec38f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862831616:0@lo:400:kworker.0 00010000:00080000:1.0:1787560654.389871:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec38ebb80 x1874392862832128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560654.389883:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec38ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874392862832128:0@lo:400:kworker.0 00010000:00080000:1.0:1787560654.389892:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3bead80 x1874392862832640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560654.389901:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862832640:0@lo:400:kworker.0 00000100:00100000:1.0:1787560654.389910:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec38f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874392862831744:0@lo:400:kworker.0 00000100:00100000:1.0:1787560654.389930:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862832256:0@lo:400:kworker.0 00000100:00100000:1.0:1787560654.389939:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862832768:0@lo:400:kworker.0 00000100:00080000:2.0:1787560654.390085:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787560654.390091:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787560654.390093:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787560654.390305:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3af2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862831232:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787560654.390519:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec408ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862832896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787560654.390555:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560654.392071:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862832896 00000100:00100000:0.0:1787560654.392082:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862832896 00000100:00100000:0.0:1787560654.392126:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787560654.392136:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862832896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787560654.392155:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787560654.392213:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862832896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (1657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560654.392220:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787560654.392306:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec408ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862832896:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1787560654.392626:0:6478:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:2.0:1787560654.392645:0:6478:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:2.0:1787560654.392688:0:6478:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1787560654.392698:0:6478:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cafc4cc4600 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1787560654.392702:0:6478:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cafc8744f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cafc4cc43c0 00000020:00080000:2.0:1787560654.392706:0:6478:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cafc8744c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9caec22d8800 00000100:00100000:3.0:1787560654.392863:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787560654.392873:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862833024:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787560654.392906:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1787560654.393014:0:6530:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1787560654.393058:0:6530:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1787560654.393068:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862833024 00000100:00100000:1.0:1787560654.393072:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862833024 00000100:00100000:1.0:1787560654.393135:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787560654.393143:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3623:x1874392862833024:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787560654.393164:0:8415:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:1.0:1787560654.393192:0:8415:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a8c02cb, atime: 0x6a8c02cb, ctime: 0x6a8c02cb, blocks: 0x8 00010000:00010000:1.0:1787560654.393200:0:8415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b1f6e53/0x4642c20bf2f34945 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.393216:0:8415:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=373s v=(0 0) 00010000:00010000:1.0:1787560654.393220:0:8415:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560654.393226:0:8415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b1f6e53/0x4642c20bf2f34945 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.393242:0:8415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b1f6e53/0x4642c20bf2f34945 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.393252:0:8415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b1f6e53/0x4642c20bf2f34945 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.393260:0:8415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b1f6e53/0x4642c20bf2f34945 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.393298:0:8415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787560654.393400:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3623:x1874392862833024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 258us (492us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787560654.393407:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:3.0:1787560654.393455:0:9500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560654.393461:0:9500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b1f6e53/0x4642c20bf2f34945 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.393469:0:9500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ff400 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560654.393473:0:9500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b1f6e53/0x4642c20bf2f34945 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.393482:0:9500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b1f6e53/0x4642c20bf2f34945 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.393509:0:9500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b1f6e53/0x4642c20bf2f34945 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.393516:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b1f6e53/0x4642c20bf2f34945 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.393531:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560654.393533:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560654.393534:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560654.393604:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f346eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393612:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f346eb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393619:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f346eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393624:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbff800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560654.393633:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f346eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393640:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f346eb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393651:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9caec3203300) 00010000:00010000:0.0:1787560654.393654:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560654.393657:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f346eb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393663:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f346eb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393676:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f346f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393681:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f346f2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393687:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f346f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393692:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbfec00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560654.393695:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f346f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393701:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f346f2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393707:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:0.0:1787560654.393709:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560654.393715:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f346f2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393721:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f346f2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393732:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f34731 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393747:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f34731 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393753:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f34731 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393758:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbfe200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560654.393761:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f34731 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393767:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f34731 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393774:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9caec3203600) 00010000:00010000:0.0:1787560654.393776:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560654.393779:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f34731 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393784:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f34731 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393797:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34834 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393818:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34834 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393825:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34834 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393830:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560654.393833:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34834 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393839:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34834 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393847:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:0.0:1787560654.393849:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560654.393852:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34834 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393857:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34834 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393867:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f34857 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393873:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f34857 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393879:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f34857 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393884:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ffa00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560654.393891:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f34857 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393897:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f34857 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393904:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:0.0:1787560654.393906:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560654.393908:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f34857 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393914:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f34857 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393923:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f3489d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393928:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f3489d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393934:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f3489d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393939:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbff000 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560654.393941:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f3489d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393947:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f3489d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393953:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:0.0:1787560654.393955:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560654.393961:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f3489d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.393967:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f3489d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787560654.394701:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9caec4040a80/2, rc 0, transno 4294967308 00000100:00100000:0.0:1787560654.394709:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862833024:0@lo:6:osp-syn-0-0.0 00000040:00080000:3.0:1787560654.647052:0:13775:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787560654.647061:0:13775:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787560654.647093:0:13775:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787560654.647103:0:13775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787560654.647233:0:13775:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4040e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13775:1874392862833152:192.168.203.29@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787560654.647320:0:13775:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc59570c0 going to sleep for 11 seconds 00000040:00080000:0.0:1787560654.657591:0:14636:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787560654.657600:0:14636:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787560654.657621:0:14636:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787560654.657627:0:14636:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787560654.659460:0:13775:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4040e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13775:1874392862833152:192.168.203.29@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787560654.666681:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560654.666720:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853335168 00000100:00100000:3.0:1787560654.666731:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853335168 00000100:00100000:3.0:1787560654.666802:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 186 00000100:00100000:3.0:1787560654.666821:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+17:12372:x1874392853335168:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787560654.666856:0:13787:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787560654.666962:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+17:12372:x1874392853335168:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 Request processed in 143us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560654.666970:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 186 00000100:00080000:3.0:1787560654.666990:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560654.673462:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560654.674071:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853335296 00000100:00100000:0.0:1787560654.674081:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853335296 00000100:00100000:0.0:1787560654.674138:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 187 00000100:00100000:0.0:1787560654.674148:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+17:12372:x1874392853335296:12345-192.168.203.29@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787560654.674220:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f3494c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.674236:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f3494c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.674249:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f3494c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.674296:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34953 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.674305:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34953 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.674324:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34953 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.674351:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f3495a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.674360:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f3495a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.674367:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f3495a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560654.674410:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787560654.674414:0:6499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787560654.674427:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f3495a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.674559:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f3494c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.674566:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f3494c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.674573:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f3494c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.674579:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881000 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560654.674584:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f3494c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.674591:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f3494c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.674609:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9caec3207900) 00010000:00010000:0.0:1787560654.674612:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560654.674617:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f3494c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.674624:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f3494c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.674634:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34953 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.674641:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34953 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.674648:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34953 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.674653:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560654.674656:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34953 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.674662:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34953 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.674669:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9cafc5393700) 00010000:00010000:0.0:1787560654.674672:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560654.674675:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34953 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.674681:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34953 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.674704:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f3495a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.674710:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f3495a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.674716:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f3495a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.674722:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560654.674725:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f3495a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.674731:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f3495a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.674738:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:0.0:1787560654.674740:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560654.674743:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f3495a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.674749:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f3495a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560654.675419:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+17:12372:x1874392853335296:12345-192.168.203.29@tcp:34:lhsmtool_posix.0 Request processed in 1268us (1990us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560654.675450:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 187 00000100:00100000:0.0:1787560654.683180:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560654.683564:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853335552 00000100:00100000:1.0:1787560654.683575:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853335552 00000100:00100000:1.0:1787560654.683629:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 188 00000100:00100000:1.0:1787560654.683639:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+17:12372:x1874392853335552:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787560654.683658:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560654.683679:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffc00/0x4642c20bf2f34961 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fed6 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.683795:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe600/0x4642c20bf2f34968 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.683821:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe600/0x4642c20bf2f34968 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.683833:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe600/0x4642c20bf2f34968 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560654.683845:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787560654.684419:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe600/0x4642c20bf2f34968 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.684468:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe600/0x4642c20bf2f34968 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.684476:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe600/0x4642c20bf2f34968 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.684483:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021fe600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560654.684488:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe600/0x4642c20bf2f34968 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.684496:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe600/0x4642c20bf2f34968 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.684510:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:0.0:1787560654.684514:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787560654.684519:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe600/0x4642c20bf2f34968 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.684526:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe600/0x4642c20bf2f34968 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.684577:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffc00/0x4642c20bf2f34961 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fed6 expref: 19 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.684587:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9caec3207900) 00010000:00010000:0.0:1787560654.684590:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787560654.684593:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffc00/0x4642c20bf2f34961 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fed6 expref: 19 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.684603:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb0021ffc00, rc 0) 00000100:00100000:0.0:1787560654.684681:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+18:12372:x1874392853335552:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 1043us (1510us total) trans 4294967460 rc 301/301 00000100:00100000:0.0:1787560654.684689:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 188 00000100:00100000:3.0:1787560654.699342:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560654.699736:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853335680 00000100:00100000:1.0:1787560654.699746:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853335680 00000100:00100000:1.0:1787560654.699819:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 189 00000100:00100000:1.0:1787560654.699840:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+18:12372:x1874392853335680:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787560654.699881:0:6498:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787560654.699986:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+18:12372:x1874392853335680:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 Request processed in 150us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560654.699994:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 189 00000100:00100000:2.0:1787560654.715671:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560654.717685:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853335936 00000100:00100000:1.0:1787560654.717700:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853335936 00000100:00100000:1.0:1787560654.717760:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 190 00000100:00100000:1.0:1787560654.717770:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+18:12372:x1874392853335936:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787560654.717791:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560654.717793:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787560654.717833:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f3491b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fec8 expref: 18 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.717851:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:1.0:1787560654.717856:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787560654.717870:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f34976 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fedd expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787560654.718232:0:6499:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:1.0:1787560654.718380:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff800/0x4642c20bf2f3497d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.718394:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff800/0x4642c20bf2f3497d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.718404:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff800/0x4642c20bf2f3497d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.718490:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f34976 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fedd expref: 20 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.718506:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff800/0x4642c20bf2f3497d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fedd expref: 19 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.718514:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9caec3203900) 00010000:00010000:1.0:1787560654.718516:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787560654.718519:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb0021ff800, rc 0) 00000100:00100000:1.0:1787560654.718667:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+19:12372:x1874392853335936:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 897us (3003us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1787560654.718675:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 190 00000100:00100000:0.0:1787560654.723147:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560654.723188:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853336192 00000100:00100000:0.0:1787560654.723197:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853336192 00000100:00100000:0.0:1787560654.723250:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 191 00000100:00100000:0.0:1787560654.723262:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+19:12372:x1874392853336192:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787560654.723699:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560654.723727:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff800/0x4642c20bf2f3497d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fedd expref: 19 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.723745:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9caec3203900) 00010000:00010000:0.0:1787560654.723756:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787560654.723776:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f3498b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.723789:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f3498b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.723799:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f3498b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.723824:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34992 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x6483de68 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.723831:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34992 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6483de68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.723838:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34992 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6483de68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.723886:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f3498b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.723893:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f3498b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.723900:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f3498b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.723906:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560654.723911:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f3498b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.723918:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f3498b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.723927:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:0.0:1787560654.723930:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560654.723933:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f3498b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.723939:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f3498b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.723948:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34992 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6483de68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.723954:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34992 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6483de68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.723959:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34992 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6483de68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.723971:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881000 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560654.723974:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34992 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6483de68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.723980:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34992 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6483de68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.723987:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x6483de68 (ffff9cafc5393700) 00010000:00010000:0.0:1787560654.723990:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560654.723992:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34992 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x6483de68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.724011:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34992 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x6483de68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560654.724087:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+18:12372:x1874392853336192:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 828us (948us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787560654.724095:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 191 00000100:00100000:2.0:1787560654.737005:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560654.737043:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853336320 00000100:00100000:2.0:1787560654.737052:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853336320 00000100:00100000:2.0:1787560654.737102:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 192 00000100:00100000:2.0:1787560654.737111:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+18:12372:x1874392853336320:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787560654.737141:0:10172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560654.737165:0:10172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f34999 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fee4 expref: -99 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560654.737213:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f349a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560654.737226:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f349a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560654.737237:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f349a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560654.737337:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f34999 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fee4 expref: 20 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560654.737352:0:10172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f349a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fee4 expref: 19 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560654.737361:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9cafef7d0c00) 00010000:00010000:2.0:1787560654.737363:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787560654.737366:0:10172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2169000, rc 0) 00000100:00100000:2.0:1787560654.737418:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+19:12372:x1874392853336320:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 308us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560654.737425:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 192 00000100:00100000:0.0:1787560654.741751:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560654.741909:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853336576 00000100:00100000:1.0:1787560654.741920:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853336576 00000100:00100000:1.0:1787560654.741979:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 193 00000100:00100000:1.0:1787560654.741990:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+19:12372:x1874392853336576:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787560654.742082:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f349a7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.742098:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f349a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.742110:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f349a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787560654.742265:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1787560654.742275:0:6499:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 374081843368ns, next at 375081841144ns, rc = 0 00000004:00010000:1.0:1787560654.742334:0:6499:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000bb83234 reply state 000000009ef794f0 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f349a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.742359:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f349a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.742368:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9cafef7d0c00) 00010000:00010000:1.0:1787560654.742370:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787560654.742374:0:6499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787560654.742498:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+21:12372:x1874392853336576:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 508us (754us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1787560654.742506:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 193 00000100:00100000:2.0:1787560654.751637:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560654.762783:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853336704 00000100:00100000:0.0:1787560654.762798:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853336704 00000100:00100000:0.0:1787560654.762879:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 194 00000100:00100000:0.0:1787560654.762891:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+21:12372:x1874392853336704:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787560654.762915:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560654.762936:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f349ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605feeb expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.762994:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f349ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605feeb expref: 22 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.763016:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f349ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605feeb expref: 22 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.763036:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9cafef7d0c00) 00010000:00010000:0.0:1787560654.763039:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787560654.763042:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881000, rc 0) 00000100:00100000:0.0:1787560654.763106:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+22:12372:x1874392853336704:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 217us (11476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560654.763113:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 194 00000100:00100000:3.0:1787560654.767047:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560654.767656:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853336832 00000100:00100000:1.0:1787560654.767666:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853336832 00000100:00100000:1.0:1787560654.767734:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 59 00000100:00100000:1.0:1787560654.767745:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:2405:x1874392853336832:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787560654.767983:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+7:2405:x1874392853336832:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 Request processed in 240us (946us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787560654.767990:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 59 00000100:00080000:3.0:1787560654.769630:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787560654.774019:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560654.774153:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853337088 00000100:00100000:3.0:1787560654.774163:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853337088 00000100:00100000:3.0:1787560654.774217:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 49 00000100:00100000:3.0:1787560654.774228:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+22:12372:x1874392853337088:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787560654.774477:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+23:12372:x1874392853337088:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 249us (466us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1787560654.774485:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 49 00000100:00100000:1.0:1787560654.777548:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560654.777604:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853337344 00000100:00100000:2.0:1787560654.777614:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853337344 00000100:00100000:2.0:1787560654.777774:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 195 00000100:00100000:2.0:1787560654.777794:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec39ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+23:12372:x1874392853337344:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787560654.777927:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec39ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+23:12372:x1874392853337344:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 134us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560654.777935:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 195 00000100:00100000:3.0:1787560654.780102:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560654.780170:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853337472 00000100:00100000:2.0:1787560654.780180:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853337472 00000100:00100000:2.0:1787560654.780229:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 196 00000100:00100000:2.0:1787560654.780238:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+23:12372:x1874392853337472:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787560654.780253:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560654.780280:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f349b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fef2 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560654.780370:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f349bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560654.780385:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f349bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560654.780396:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f349bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560654.780458:0:6500:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787560654.780476:0:6500:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f349bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560654.781799:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f349b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fef2 expref: 25 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560654.781844:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f349bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fef2 expref: 24 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560654.781877:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9cafef7d0c00) 00010000:00010000:2.0:1787560654.781880:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787560654.781884:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2168200, rc 0) 00000100:00100000:2.0:1787560654.781962:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+24:12372:x1874392853337472:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 1723us (1866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560654.781970:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 196 00000100:00100000:0.0:1787560654.790699:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560654.790746:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853337600 00000100:00100000:0.0:1787560654.790754:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853337600 00000100:00100000:0.0:1787560654.790803:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 60 00000100:00100000:0.0:1787560654.790822:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+7:2404:x1874392853337600:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787560654.790839:0:10171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560654.790858:0:10171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007bc0c534/0x4642c20bf2f349c3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fef9 expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787560654.790882:0:10171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c02ce, blocks: 0x0 00010000:00010000:0.0:1787560654.790899:0:10171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=374s v=(0 0) 00010000:00010000:0.0:1787560654.790904:0:10171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560654.790912:0:10171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bc0c534/0x4642c20bf2f349c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fef9 expref: 8 pid: 10171 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.790928:0:10171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007bc0c534/0x4642c20bf2f349c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fef9 expref: 8 pid: 10171 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.790948:0:10171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881a00, rc 0) 00000100:00100000:0.0:1787560654.791384:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+8:2404:x1874392853337600:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 561us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560654.791391:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 60 00000100:00100000:1.0:1787560654.802599:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560654.802692:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853337856 00000100:00100000:3.0:1787560654.802703:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853337856 00000100:00100000:3.0:1787560654.802853:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 197 00000100:00100000:3.0:1787560654.802865:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec39ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+24:12372:x1874392853337856:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787560654.803006:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec39ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+24:12372:x1874392853337856:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 142us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560654.803013:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 197 00000100:00100000:3.0:1787560654.806559:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560654.807296:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853337984 00000100:00100000:2.0:1787560654.807306:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853337984 00000100:00100000:2.0:1787560654.807370:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 61 00000100:00100000:2.0:1787560654.807382:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+8:12372:x1874392853337984:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787560654.807398:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560654.807416:0:8412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053c29c68/0x4642c20bf2f349ca lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ff00 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560654.807469:0:8412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007bc0c534/0x4642c20bf2f349c3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fef9 expref: 9 pid: 10171 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560654.807479:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560654.807483:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560654.807489:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053c29c68/0x4642c20bf2f349ca lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff00 expref: 9 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560654.807521:0:8412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007bc0c534/0x4642c20bf2f349c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fef9 expref: 9 pid: 10171 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560654.808662:0:8412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007bc0c534/0x4642c20bf2f349c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fef9 expref: 9 pid: 10171 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560654.808678:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3beaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8412:1874392862833280:192.168.203.29@tcp:104: 00000100:00100000:3.0:1787560654.810725:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc5955c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787560654.815164:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3beaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8412:1874392862833280:192.168.203.29@tcp:104: 00010000:00010000:3.0:1787560654.815199:0:8412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000053c29c68/0x4642c20bf2f349ca lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff00 expref: 9 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.815219:0:8412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2168e00, rc 0) 00000100:00100000:3.0:1787560654.815383:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+9:12372:x1874392853337984:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 8002us (8831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560654.815399:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 61 00000100:00100000:0.0:1787560654.820678:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560654.820867:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853338112 00000100:00100000:2.0:1787560654.820877:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853338112 00010000:00010000:2.0:1787560654.820919:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007bc0c534/0x4642c20bf2f349c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fef9 expref: 9 pid: 10171 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560654.820964:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 89 00000100:00100000:2.0:1787560654.820975:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd7cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+9:2402:x1874392853338112:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560654.820990:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560654.821010:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007bc0c534/0x4642c20bf2f349c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fef9 expref: 9 pid: 10171 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560654.821024:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007bc0c534/0x4642c20bf2f349c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fef9 expref: 9 pid: 10171 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560654.821046:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007bc0c534/0x4642c20bf2f349c3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fef9 expref: 9 pid: 10171 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560654.821061:0:6484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560654.821066:0:6484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560654.821081:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000053c29c68/0x4642c20bf2f349ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff00 expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560654.821091:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053c29c68/0x4642c20bf2f349ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff00 expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560654.821130:0:6484:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000053c29c68/0x4642c20bf2f349ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff00 expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560654.821143:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3beb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6484:1874392862833408:192.168.203.29@tcp:105: 00000100:00100000:2.0:1787560654.821222:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc5955c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787560654.834909:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560654.834958:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3beb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6484:1874392862833408:192.168.203.29@tcp:105: 00010000:00010000:1.0:1787560654.834979:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560654.835027:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd7cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+8:2402:x1874392853338112:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 14053us (14355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560654.835048:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 89 00000100:00100000:0.0:1787560654.835750:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853338240 00000100:00100000:0.0:1787560654.835758:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853338240 00002000:00100000:0.0:1787560654.835798:0:8418:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9caec3a19c00 x1874392853338240/t0(0) o4->9331bacf-6cfc-4379-8649-925e79b19df1@192.168.203.29@tcp:15/0 lens 504/0 e 0 to 0 dl 1787560665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787560654.835822:0:8418:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9caec3a19c00 with x1874392853338240 ext(0->8) 00002000:00010000:0.0:1787560654.835828:0:8418:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9caec3a19c00 00000100:00100000:0.0:1787560654.835870:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:0.0:1787560654.835880:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3a19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9331bacf-6cfc-4379-8649-925e79b19df1+8:2404:x1874392853338240:12345-192.168.203.29@tcp:4:lhsmtool_posix.0 00010000:00010000:0.0:1787560654.840013:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560654.841548:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3a19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9331bacf-6cfc-4379-8649-925e79b19df1+10:2404:x1874392853338240:12345-192.168.203.29@tcp:4:lhsmtool_posix.0 Request processed in 5647us (6627us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787560654.841568:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 4 00002000:00100000:1.0:1787560654.841581:0:8418:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9caec3a19c00 x1874392853338240/t4294967315(0) o4->9331bacf-6cfc-4379-8649-925e79b19df1@192.168.203.29@tcp:15/0 lens 504/448 e 0 to 0 dl 1787560665 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787560654.841593:0:8418:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9caec3a19c00 with x1874392853338240 ext(0->8) 00002000:00010000:1.0:1787560654.841599:0:8418:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9caec3a19c00 00000100:00100000:3.0:1787560654.847977:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560654.848014:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853338368 00000100:00100000:3.0:1787560654.848023:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853338368 00000100:00100000:3.0:1787560654.848071:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 198 00000100:00100000:3.0:1787560654.848081:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+24:12372:x1874392853338368:12345-192.168.203.29@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787560654.849581:0:6478:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967463 is committed 00000004:00080000:3.0:1787560654.849593:0:6478:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:3.0:1787560654.849605:0:6478:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:3.0:1787560654.849744:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+20:12372:x1874392853338368:12345-192.168.203.29@tcp:44:lhsmtool_posix.0 Request processed in 1661us (1774us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560654.849754:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 198 00010000:00010000:1.0:1787560654.851263:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f349a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.851279:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f349a7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.851288:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f349a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.851294:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021fe800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560654.851300:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f349a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.851308:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f349a7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.851325:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9cafef7d0c00) 00010000:00010000:1.0:1787560654.851328:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787560654.851333:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f349a7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.851353:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f349a7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787560654.851475:0:6530:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787560654.851481:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3a18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862833536:0@lo:2:osp-syn-1-0.0 00000020:00080000:1.0:1787560654.851486:0:6530:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787560654.851545:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560654.851598:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862833536 00000100:00100000:3.0:1787560654.851605:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862833536 00000100:00100000:3.0:1787560654.851643:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787560654.851650:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862833536:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787560654.853614:0:10171:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787560654.853622:0:10171:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787560654 00002000:00010000:3.0:1787560654.853625:0:10171:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787560654.853627:0:10171:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1787560654 -> 1787560654 00002000:00010000:3.0:1787560654.853629:0:10171:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787560654.853701:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3625:x1874392862833536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2047us (2153us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787560654.853711:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:1.0:1787560654.853891:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9caec3a18e00/2, rc 0, transno 4294967316 00000100:00100000:1.0:1787560654.853899:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3a18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862833536:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787560654.858003:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560654.858092:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853338496 00000100:00100000:3.0:1787560654.858102:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853338496 00000100:00100000:3.0:1787560654.858163:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 63 00000100:00100000:3.0:1787560654.858175:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+10:2405:x1874392853338496:12345-192.168.203.29@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787560654.868024:0:9491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:0.0:1787560654.868036:0:9491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1787560654.868361:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+7:2405:x1874392853338496:12345-192.168.203.29@tcp:16:lhsmtool_posix.0 Request processed in 10183us (10361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560654.868371:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 63 00000100:00100000:1.0:1787560654.885584:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560654.887373:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853338752 00000100:00100000:2.0:1787560654.887385:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853338752 00000100:00100000:1.0:1787560654.887533:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 199 00000100:00100000:1.0:1787560654.887561:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc87aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+19:12372:x1874392853338752:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787560654.887615:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560654.887647:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f349bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fef2 expref: 19 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.887666:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9cafef7d0c00) 00010000:00010000:1.0:1787560654.887671:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787560654.887813:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f349d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.887829:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f349d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.887839:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f349d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787560654.887957:0:6499:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a72a3fb reply state 00000000456eacfe transno 4294967464 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f349d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.887987:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f349d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.887993:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9cafef7d0c00) 00010000:00010000:1.0:1787560654.887996:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787560654.887999:0:6499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787560654.888084:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc87aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+20:12372:x1874392853338752:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 526us (2510us total) trans 4294967464 rc 0/0 00000100:00100000:1.0:1787560654.888091:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 199 00000100:00100000:2.0:1787560654.913517:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560654.913661:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853338880 00000100:00100000:1.0:1787560654.913671:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853338880 00000100:00100000:1.0:1787560654.913728:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 64 00000100:00100000:1.0:1787560654.913748:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3be9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+7:2405:x1874392853338880:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787560654.913914:0:8415:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787560654.913918:0:8415:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1787560654 -> 1787560653 00002000:00010000:1.0:1787560654.913921:0:8415:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787560651 00002000:00010000:1.0:1787560654.913923:0:8415:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1787560654 -> 1787560653 00002000:00010000:1.0:1787560654.913925:0:8415:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1787560654.913978:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3be9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+8:2405:x1874392853338880:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 Request processed in 232us (470us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787560654.913986:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 64 00000100:00100000:0.0:1787560654.919047:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560654.919143:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853339136 00000100:00100000:3.0:1787560654.919153:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853339136 00000100:00100000:3.0:1787560654.919214:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 200 00000100:00100000:3.0:1787560654.919225:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+20:12372:x1874392853339136:12345-192.168.203.29@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787560654.919289:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f349d8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.919304:0:10172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f349a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fee4 expref: 20 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.919313:0:10172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f349d8 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.919346:0:10172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f349a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fee4 expref: 20 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.919361:0:10172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f349a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fee4 expref: 20 pid: 10172 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560654.919376:0:10172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4042a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10172:1874392862833664:192.168.203.29@tcp:104: 00000100:00100000:2.0:1787560654.919868:0:10172:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc5957600 going to sleep for 11 seconds 00000100:00100000:1.0:1787560654.925270:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560654.925366:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853339264 00000100:00100000:3.0:1787560654.925388:0:9502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853339264 00010000:00010000:3.0:1787560654.925500:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f349a0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fee4 expref: 21 pid: 10172 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560654.925585:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 90 00000100:00100000:3.0:1787560654.925597:0:9502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+21:2405:x1874392853339264:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560654.925613:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560654.925621:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f349a0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fee4 expref: 21 pid: 10172 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560654.925639:0:10172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4042a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10172:1874392862833664:192.168.203.29@tcp:104: 00010000:00010000:3.0:1787560654.925647:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f349a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fee4 expref: 21 pid: 10172 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.925675:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f349a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fee4 expref: 21 pid: 10172 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560654.930402:0:10172:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f349d8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.930557:0:9502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9cafef7d0c00) 00010000:00010000:3.0:1787560654.930565:0:9502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f349d8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.930578:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f349d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.930586:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f349d8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.930633:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787560654.930667:0:10172:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f349d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560654.930677:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f349d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560654.930719:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f349d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560654.930794:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f349d8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560654.930824:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f349d8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560654.930830:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560654.930836:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f349d8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560654.930844:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f349d8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560654.930857:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9cafef7d0c00) 00010000:00010000:2.0:1787560654.930860:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787560654.930863:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f349d8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560654.930870:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f349d8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560654.930971:0:9502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+20:2405:x1874392853339264:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 5372us (5705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560654.930992:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 90 00000100:00100000:2.0:1787560654.935071:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+19:12372:x1874392853339136:12345-192.168.203.29@tcp:55:lhsmtool_posix.0 Request processed in 15834us (16021us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787560654.935087:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 200 00000100:00100000:2.0:1787560654.938318:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560654.938766:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853339392 00000100:00100000:1.0:1787560654.938778:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853339392 00000100:00100000:1.0:1787560654.938849:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 65 00000100:00100000:1.0:1787560654.939026:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+8:2404:x1874392853339392:12345-192.168.203.29@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787560654.939086:0:8412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b24b114b/0x4642c20bf2f349df lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.939107:0:8412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000053c29c68/0x4642c20bf2f349ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff00 expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.939116:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560654.939121:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787560654.939126:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b24b114b/0x4642c20bf2f349df lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.939162:0:8412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000053c29c68/0x4642c20bf2f349ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff00 expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.939177:0:8412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000053c29c68/0x4642c20bf2f349ca lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff00 expref: 8 pid: 8412 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560654.939193:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec40fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8412:1874392862833792:192.168.203.29@tcp:104: 00000100:00100000:1.0:1787560654.939894:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffcbddf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787560654.954176:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec40fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8412:1874392862833792:192.168.203.29@tcp:104: 00010000:00010000:3.0:1787560654.954208:0:8412:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b24b114b/0x4642c20bf2f349df lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560654.955602:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560654.955731:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853339520 00000100:00100000:1.0:1787560654.955747:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853339520 00010000:00010000:1.0:1787560654.955787:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000053c29c68/0x4642c20bf2f349ca lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff00 expref: 9 pid: 8412 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560654.955839:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 91 00000100:00100000:1.0:1787560654.955849:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3be9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+9:2404:x1874392853339520:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560654.955888:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560654.955911:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000053c29c68/0x4642c20bf2f349ca lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff00 expref: 9 pid: 8412 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.955925:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000053c29c68/0x4642c20bf2f349ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff00 expref: 9 pid: 8412 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.955949:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053c29c68/0x4642c20bf2f349ca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff00 expref: 9 pid: 8412 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.955966:0:6485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787560654.955971:0:6485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787560654.955977:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b24b114b/0x4642c20bf2f349df lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.955987:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b24b114b/0x4642c20bf2f349df lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.956021:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560654.956080:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3be9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+8:2404:x1874392853339520:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 231us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560654.956087:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 91 00010000:00010000:3.0:1787560654.956261:0:8412:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b24b114b/0x4642c20bf2f349df lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.956271:0:8412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b24b114b/0x4642c20bf2f349df lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.956290:0:8412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b24b114b/0x4642c20bf2f349df lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.956298:0:8412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b24b114b/0x4642c20bf2f349df lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.956305:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b24b114b/0x4642c20bf2f349df lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.956312:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021fee00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560654.956316:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b24b114b/0x4642c20bf2f349df lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.956325:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b24b114b/0x4642c20bf2f349df lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.956345:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b24b114b/0x4642c20bf2f349df lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.956352:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b24b114b/0x4642c20bf2f349df lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560654.956395:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+7:2404:x1874392853339392:12345-192.168.203.29@tcp:1:lhsmtool_posix.0 Request processed in 17538us (18088us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560654.956403:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 65 00000100:00100000:1.0:1787560654.962113:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560654.962244:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853339776 00000100:00100000:3.0:1787560654.962253:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853339776 00000100:00100000:3.0:1787560654.962313:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 201 00000100:00100000:3.0:1787560654.962323:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec40fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+19:12372:x1874392853339776:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787560654.962394:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f349e6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.962410:0:13787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f3482d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe89 expref: 19 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.962462:0:13787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f349e6 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.962499:0:13787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f3482d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe89 expref: 19 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.962513:0:13787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f3482d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe89 expref: 19 pid: 10172 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560654.962540:0:13787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4043800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13787:1874392862833920:192.168.203.29@tcp:104: 00000100:00100000:3.0:1787560654.962614:0:13787:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc59570c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560654.968359:0:13787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4043800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13787:1874392862833920:192.168.203.29@tcp:104: 00010000:00010000:3.0:1787560654.968392:0:13787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f349e6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560654.972236:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560654.972528:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853339904 00000100:00100000:0.0:1787560654.972538:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853339904 00010000:00010000:0.0:1787560654.972581:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f3482d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe89 expref: 20 pid: 10172 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560654.972619:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 92 00000100:00100000:0.0:1787560654.972629:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+20:2404:x1874392853339904:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787560654.972668:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560654.972676:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f3482d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe89 expref: 20 pid: 10172 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.972688:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f3482d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe89 expref: 20 pid: 10172 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.972708:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f3482d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe89 expref: 20 pid: 10172 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.972725:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:0.0:1787560654.972851:0:6486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f349e6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.972874:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f349e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.972881:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f349e6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560654.972917:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560654.972976:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+19:2404:x1874392853339904:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 348us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560654.972984:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 92 00010000:00010000:1.0:1787560654.973567:0:13787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f349e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.973591:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f349e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.973935:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffc00/0x4642c20bf2f349ed lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.973949:0:13787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f349ae lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605feeb expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.973957:0:13787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffc00/0x4642c20bf2f349ed lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.973986:0:13787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f349ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605feeb expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.974000:0:13787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f349ae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605feeb expref: 19 pid: 6498 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560654.974013:0:13787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec38f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13787:1874392862834048:192.168.203.29@tcp:104: 00000100:00100000:1.0:1787560654.974087:0:13787:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc4cc4600 going to sleep for 11 seconds 00000100:00100000:3.0:1787560654.977771:0:13787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec38f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13787:1874392862834048:192.168.203.29@tcp:104: 00010000:00010000:3.0:1787560654.977819:0:13787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffc00/0x4642c20bf2f349ed lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560654.978345:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560654.979024:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853340032 00000100:00100000:1.0:1787560654.979035:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853340032 00010000:00010000:1.0:1787560654.979075:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f349ae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605feeb expref: 20 pid: 6498 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560654.979160:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 93 00000100:00100000:1.0:1787560654.979170:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3be9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+20:2405:x1874392853340032:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560654.979199:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560654.979207:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f349ae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605feeb expref: 20 pid: 6498 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.979220:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f349ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605feeb expref: 20 pid: 6498 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.979241:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f349ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605feeb expref: 20 pid: 6498 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.979257:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9cafef7d0c00) 00010000:00010000:1.0:1787560654.979262:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffc00/0x4642c20bf2f349ed lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.979272:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffc00/0x4642c20bf2f349ed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.979281:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffc00/0x4642c20bf2f349ed lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.979318:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560654.979377:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3be9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+19:2405:x1874392853340032:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 208us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560654.979384:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 93 00010000:00010000:3.0:1787560654.979473:0:13787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffc00/0x4642c20bf2f349ed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.979481:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffc00/0x4642c20bf2f349ed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787560654.979583:0:13787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1787560654.979721:0:13787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000001:00080000:3.0:1787560654.979775:0:13787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1787560654.979872:0:13787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4043800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13787:1874392862834176:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787560654.979924:0:13787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560654.979956:0:13787:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc12ed900 going to sleep for 11 seconds 00000100:00100000:0.0:1787560654.980509:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862834176 00000100:00100000:0.0:1787560654.980516:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862834176 00000100:00100000:0.0:1787560654.980559:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787560654.980569:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:13787:x1874392862834176:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787560654.980652:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:13787:x1874392862834176:12345-0@lo:1000:mdt00_004.0 Request processed in 85us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560654.980673:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787560654.981252:0:13787:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1787560654.981260:0:13787:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9caec3a18e00, transno 4294967316 00000100:00100000:3.0:1787560654.981283:0:13787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4043800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13787:1874392862834176:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1787560654.981413:0:13787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00000100:00100000:3.0:1787560654.981517:0:13787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4043800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13787:1874392862834304:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787560654.981554:0:13787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560654.981576:0:13787:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec22aaa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787560654.982295:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862834304 00000100:00100000:1.0:1787560654.982303:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862834304 00000100:00100000:1.0:1787560654.982385:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787560654.982396:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:13787:x1874392862834304:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787560654.982562:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13787:x1874392862834304:12345-0@lo:1000:mdt00_004.0 Request processed in 168us (1007us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1787560654.982581:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787560654.982666:0:13787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4043800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13787:1874392862834304:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1787560654.982704:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffc00/0x4642c20bf2f349ed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.982716:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffc00/0x4642c20bf2f349ed lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.982723:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffc00/0x4642c20bf2f349ed lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.982729:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ffc00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560654.982745:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffc00/0x4642c20bf2f349ed lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.982753:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffc00/0x4642c20bf2f349ed lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.982768:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9cafef7d0c00) 00010000:00010000:3.0:1787560654.982771:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787560654.982777:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffc00/0x4642c20bf2f349ed lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.982783:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffc00/0x4642c20bf2f349ed lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.982815:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34922 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.982821:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34922 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.982833:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34922 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.982838:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168a00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560654.982841:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34922 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.982847:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34922 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.982864:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:3.0:1787560654.982867:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787560654.982870:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34922 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.982876:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34922 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.982898:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f349f4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.982912:0:13787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f3493e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fecf expref: 22 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.982920:0:13787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f349f4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.982948:0:13787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f3493e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fecf expref: 22 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.982972:0:13787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f3493e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fecf expref: 22 pid: 6500 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560654.982983:0:13787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4041c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13787:1874392862834432:192.168.203.29@tcp:104: 00000100:00100000:3.0:1787560654.983057:0:13787:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec22aaa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787560654.986360:0:13787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4041c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13787:1874392862834432:192.168.203.29@tcp:104: 00010000:00010000:3.0:1787560654.986387:0:13787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f349f4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560654.991568:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560654.991690:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853340160 00000100:00100000:1.0:1787560654.991700:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853340160 00010000:00010000:1.0:1787560654.991749:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f3493e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fecf expref: 23 pid: 6500 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560654.991789:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 94 00000100:00100000:1.0:1787560654.991799:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+23:2403:x1874392853340160:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560654.991831:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560654.991843:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f3493e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fecf expref: 23 pid: 6500 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.992073:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f3493e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fecf expref: 23 pid: 6500 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.992100:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f3493e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fecf expref: 23 pid: 6500 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.992117:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:1.0:1787560654.992122:0:6486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f349f4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.992132:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f349f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.992140:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f349f4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560654.992476:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560654.992540:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+22:2403:x1874392853340160:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 741us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560654.992549:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 94 00010000:00010000:3.0:1787560654.994024:0:13787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f349f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.994041:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f349f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.994055:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f349f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.994063:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f349f4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.994071:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f349f4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.994077:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7c00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560654.994591:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f349f4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.994601:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f349f4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.994635:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:3.0:1787560654.994638:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560654.994643:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f349f4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.994650:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7c00/0x4642c20bf2f349f4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.994939:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f349e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.994951:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f349e6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.994957:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f349e6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.994963:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560654.994966:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f349e6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.994973:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f349e6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.994982:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7ce100) 00010000:00010000:3.0:1787560654.994985:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787560654.994989:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f349e6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.994995:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f349e6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560654.995395:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec40fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+21:12372:x1874392853339776:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 33068us (33286us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1787560654.995406:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 201 00000020:00080000:3.0:1787560654.995412:0:13787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787560654.997034:0:13775:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787560654.997045:0:13775:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787560654.998556:0:13775:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1787560654.998574:0:13775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787560655.005600:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560655.005690:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853340416 00000100:00100000:3.0:1787560655.005700:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853340416 00000100:00100000:3.0:1787560655.005771:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 50 00000100:00100000:3.0:1787560655.005783:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd7c04850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+21:12372:x1874392853340416:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787560655.008209:0:6502:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787560655.008267:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967470 00010000:00010000:2.0:1787560655.008341:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f349fb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560655.008358:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f349fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560655.008382:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f349fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560655.009301:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f349fb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560655.009313:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f349fb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560655.009320:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f349fb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560655.009346:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787560655.009519:0:9501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560655.009525:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f349fb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560655.009533:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168200 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560655.009537:0:9501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f349fb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560655.009545:0:9501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f349fb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560655.009559:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9cafef7d0c00) 00010000:00010000:1.0:1787560655.009562:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787560655.009566:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f349fb lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560655.009572:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f349fb lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560655.009586:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560655.009588:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560655.009590:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560655.010001:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd7c04850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+23:12372:x1874392853340416:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 4215us (4405us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1787560655.010013:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 50 00000020:00080000:2.0:1787560655.010020:0:6502:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787560655.859579:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560655.923587:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787560655.923620:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec38f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862834560:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787560655.923691:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560655.924031:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862834560 00000100:00100000:1.0:1787560655.924040:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862834560 00000100:00100000:1.0:1787560655.924104:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787560655.924114:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862834560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787560655.924147:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1787560655.924195:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862834560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560655.924202:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787560655.924255:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec38f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862834560:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1787560656.653041:0:14687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787560656.653051:0:14687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787560656.653362:0:14687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787560656.653369:0:14687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787560656.778166:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560656.778258:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853340672 00000100:00100000:1.0:1787560656.778267:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853340672 00000100:00100000:1.0:1787560656.778329:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 202 00000100:00100000:1.0:1787560656.778338:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3beb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+23:12390:x1874392853340672:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:1.0:1787560656.778358:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560656.778377:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff400/0x4642c20bf2f34a02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ff07 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560656.778481:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f34a09 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560656.778492:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f34a09 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560656.778503:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f34a09 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560656.778523:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1787560656.778608:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff400/0x4642c20bf2f34a02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff07 expref: 26 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560656.778624:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f34a09 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff07 expref: 25 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560656.778632:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:1.0:1787560656.778634:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787560656.778638:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb0021ffa00, rc 0) 00000100:00100000:1.0:1787560656.778695:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3beb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+25:12390:x1874392853340672:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 358us (538us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1787560656.778702:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 202 00000100:00080000:3.0:1787560656.779273:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560656.783631:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560656.785593:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853340800 00000100:00100000:2.0:1787560656.785606:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853340800 00000100:00100000:2.0:1787560656.785701:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 203 00000100:00100000:2.0:1787560656.785712:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3a18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+25:12390:x1874392853340800:12345-192.168.203.29@tcp:34:lfs.0 00010000:00010000:2.0:1787560656.785806:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34a17 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.785822:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34a17 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.785834:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34a17 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.785857:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34a1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.785865:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34a1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.785871:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34a1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.785943:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34a25 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.785950:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34a25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.785957:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34a25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787560656.786001:0:10172:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34a25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.786014:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34a17 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.786019:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34a17 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.786025:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34a17 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.786031:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169a00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560656.786034:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34a17 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.786048:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34a17 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.786059:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:2.0:1787560656.786062:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560656.786067:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34a17 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.786074:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34a17 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.786085:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34a1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.786090:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34a1e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.786095:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34a1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.786100:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560656.786102:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34a1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.786108:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34a1e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.786114:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cafef7d0700) 00010000:00010000:2.0:1787560656.786117:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560656.786119:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34a1e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.786134:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34a1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.786149:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34a25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.786155:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34a25 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.786160:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34a25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.786165:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169400 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560656.786168:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34a25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.786174:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34a25 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.786182:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:2.0:1787560656.786184:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560656.786186:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34a25 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.786191:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34a25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560656.786275:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3a18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+25:12390:x1874392853340800:12345-192.168.203.29@tcp:34:lfs.0 Request processed in 564us (2653us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560656.786283:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 203 00000100:00100000:3.0:1787560656.835653:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560656.835805:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853341056 00000100:00100000:0.0:1787560656.835814:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853341056 00000100:00100000:0.0:1787560656.835875:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 204 00000100:00100000:0.0:1787560656.835885:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+25:12393:x1874392853341056:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:0.0:1787560656.835904:0:13787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560656.835925:0:13787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34a2c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ff0e expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560656.835992:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34a33 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560656.836006:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34a33 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560656.836016:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34a33 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560656.836030:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34a3a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560656.836037:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34a3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560656.836049:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34a3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560656.836158:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34a41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560656.836167:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34a41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560656.836174:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34a41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560656.836184:0:13787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787560656.836254:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34a33 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560656.836263:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34a33 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560656.836269:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34a33 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560656.836274:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560656.836278:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34a33 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560656.836284:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34a33 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560656.836296:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:0.0:1787560656.836299:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560656.836309:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34a33 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560656.836316:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34a33 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560656.836326:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34a3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560656.836332:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34a3a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560656.836338:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34a3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560656.836343:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881c00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560656.836346:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34a3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560656.836352:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34a3a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560656.836360:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cafc5393a00) 00010000:00010000:0.0:1787560656.836363:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560656.836365:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34a3a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560656.836371:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34a3a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560656.836409:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34a2c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff0e expref: 28 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560656.836451:0:13787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34a41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff0e expref: 27 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560656.836458:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafc5393800) 00010000:00010000:0.0:1787560656.836461:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787560656.836463:0:13787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3880000, rc 0) 00000100:00100000:0.0:1787560656.836519:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+27:12393:x1874392853341056:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 635us (874us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1787560656.836526:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 204 00000100:00100000:2.0:1787560656.846350:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560656.846419:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853341184 00000100:00100000:3.0:1787560656.846448:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853341184 00000100:00100000:3.0:1787560656.846500:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 205 00000100:00100000:3.0:1787560656.846510:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+27:12393:x1874392853341184:12345-192.168.203.29@tcp:54:lfs.0 00010000:00010000:3.0:1787560656.846572:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34a4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560656.846588:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34a4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560656.846598:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34a4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560656.846631:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34a4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560656.846637:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34a4f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560656.846667:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34a4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560656.846673:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560656.846678:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34a4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560656.846685:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34a4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560656.846698:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafc5393800) 00010000:00010000:3.0:1787560656.846701:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787560656.846706:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34a4f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560656.846712:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34a4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560656.846932:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+27:12393:x1874392853341184:12345-192.168.203.29@tcp:54:lfs.0 Request processed in 422us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560656.846940:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 205 00000100:00100000:0.0:1787560656.856146:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560656.856860:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853341440 00000100:00100000:2.0:1787560656.856871:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853341440 00000100:00100000:2.0:1787560656.856976:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 51 00000100:00100000:2.0:1787560656.856988:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+27:12393:x1874392853341440:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:2.0:1787560656.857228:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+28:12393:x1874392853341440:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 241us (1091us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1787560656.857236:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 51 00010000:00010000:3.0:1787560656.885237:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560656.887669:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560656.887884:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853341696 00000100:00100000:2.0:1787560656.887894:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853341696 00000100:00100000:2.0:1787560656.887955:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 206 00000100:00100000:2.0:1787560656.887966:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+28:11916:x1874392853341696:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:2.0:1787560656.887992:0:10172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560656.888013:0:10172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34a56 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ff15 expref: -99 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.888114:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34a5d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.888128:0:10172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34a41 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff0e expref: 29 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.888137:0:10172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34a5d lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.888167:0:10172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34a41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff0e expref: 29 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.888199:0:10172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34a41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff0e expref: 29 pid: 13787 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560656.888213:0:10172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10172:1874392862834688:192.168.203.29@tcp:104: 00000100:00100000:2.0:1787560656.888316:0:10172:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe0a65540 going to sleep for 11 seconds 00000100:00100000:3.0:1787560656.892270:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560656.892601:0:10172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10172:1874392862834688:192.168.203.29@tcp:104: 00010000:00010000:2.0:1787560656.892629:0:10172:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34a5d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560656.892822:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853341824 00000100:00100000:1.0:1787560656.892839:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853341824 00010000:00010000:1.0:1787560656.892889:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34a41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff0e expref: 30 pid: 13787 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560656.892930:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 95 00000100:00100000:1.0:1787560656.892940:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4042a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+30:2404:x1874392853341824:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560656.892953:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560656.892965:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34a41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff0e expref: 30 pid: 13787 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560656.892978:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34a41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff0e expref: 30 pid: 13787 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560656.893019:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34a41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff0e expref: 30 pid: 13787 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560656.893036:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafc5393800) 00010000:00010000:1.0:1787560656.893041:0:6484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34a5d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560656.893050:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34a5d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560656.893069:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34a5d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560656.893096:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560656.893149:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4042a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+29:2404:x1874392853341824:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 210us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560656.893157:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 95 00000100:00100000:3.0:1787560656.894385:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560656.894477:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853341952 00000100:00100000:1.0:1787560656.894485:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853341952 00000100:00100000:3.0:1787560656.894523:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560656.894526:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 387 00000100:00100000:1.0:1787560656.894534:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5803450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+13:2403:x1874392853341952:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560656.894545:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560656.894563:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00010000:00010000:2.0:1787560656.894622:0:10172:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34a5d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560656.894623:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5803450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+13:2403:x1874392853341952:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 51us (204us total) trans 0 rc 0/0 00010000:00010000:2.0:1787560656.894632:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34a5d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560656.894632:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 387 00000004:00200000:2.0:1787560656.894651:0:10172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787560656.894774:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34a56 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff15 expref: 30 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.894803:0:10172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34a5d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff15 expref: 29 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.894812:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafc5393800) 00010000:00010000:2.0:1787560656.894815:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787560656.894818:0:10172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2168800, rc 0) 00000100:00100000:3.0:1787560656.896589:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560656.896742:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560656.896788:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853342080 00000100:00100000:3.0:1787560656.896805:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853342080 00000100:00100000:3.0:1787560656.896855:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853342592 00000100:00100000:3.0:1787560656.896858:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853342592 00000100:00100000:3.0:1787560656.896874:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853342464 00000100:00100000:3.0:1787560656.896876:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853342464 00000100:00100000:3.0:1787560656.896892:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 319 00000100:00100000:3.0:1787560656.896901:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:2402:x1874392853342080:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560656.896959:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+5:2402:x1874392853342080:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 59us (2435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560656.896966:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 319 00000100:00100000:3.0:1787560656.896982:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 320 00000100:00100000:3.0:1787560656.896988:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2402:x1874392853342592:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560656.897019:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2402:x1874392853342592:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 31us (2455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560656.897025:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 320 00000100:00100000:3.0:1787560656.897038:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 321 00000100:00100000:3.0:1787560656.897045:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec398ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2402:x1874392853342464:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560656.897068:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec398ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2402:x1874392853342464:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 24us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560656.897074:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 321 00000100:00100000:3.0:1787560656.897093:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853342336 00000100:00100000:3.0:1787560656.897096:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853342336 00000100:00100000:3.0:1787560656.897117:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853342208 00000100:00100000:3.0:1787560656.897119:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853342208 00000100:00100000:3.0:1787560656.897151:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 127 00000100:00100000:3.0:1787560656.897164:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+7:2402:x1874392853342336:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560656.897188:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+7:2402:x1874392853342336:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 26us (2643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560656.897194:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 127 00000100:00100000:3.0:1787560656.897204:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 128 00000100:00100000:3.0:1787560656.897209:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+7:2402:x1874392853342208:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560656.897227:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+7:2402:x1874392853342208:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 17us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560656.897232:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 128 00000100:00080000:3.0:1787560656.897245:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787560656.897248:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787560656.897251:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787560656.897253:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787560656.899987:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+29:11916:x1874392853341696:12345-192.168.203.29@tcp:101:bash.0 Request processed in 12011us (12326us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1787560656.900015:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 206 00000100:00100000:1.0:1787560656.903772:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560656.903845:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853342720 00000100:00100000:2.0:1787560656.903855:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853342720 00000100:00100000:2.0:1787560656.903915:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 207 00000100:00100000:2.0:1787560656.903926:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+29:11916:x1874392853342720:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:2.0:1787560656.903948:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560656.903967:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34a6b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ff1c expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.904002:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f34a72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.904015:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f34a72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.904025:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f34a72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.904161:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34a6b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff1c expref: 31 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.904179:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f34a72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff1c expref: 30 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.904188:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafc5393800) 00010000:00010000:2.0:1787560656.904191:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787560656.904195:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2169e00, rc 0) 00000100:00100000:2.0:1787560656.904258:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+30:11916:x1874392853342720:12345-192.168.203.29@tcp:101:bash.0 Request processed in 334us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560656.904274:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 207 00000100:00100000:0.0:1787560656.907558:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560656.907639:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853342976 00000100:00100000:3.0:1787560656.907648:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853342976 00000100:00100000:3.0:1787560656.907740:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 208 00000100:00100000:3.0:1787560656.907751:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+30:11916:x1874392853342976:12345-192.168.203.29@tcp:36:bash.0 00010000:00010000:3.0:1787560656.907988:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34a79 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560656.908004:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34a79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560656.908015:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34a79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787560656.908069:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000004:00010000:3.0:1787560656.908093:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000785b2dbc reply state 00000000b95b0ee1 transno 4294967477 ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34a79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560656.908118:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34a79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560656.908127:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafc5393800) 00010000:00010000:3.0:1787560656.908129:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787560656.908133:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787560656.908202:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000100:00100000:3.0:1787560656.908299:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+34:11916:x1874392853342976:12345-192.168.203.29@tcp:36:bash.0 Request processed in 549us (747us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1787560656.908307:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 208 00000020:00080000:3.0:1787560656.908312:0:6498:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787560656.911407:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560656.911483:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853343104 00000100:00100000:2.0:1787560656.911493:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853343104 00000100:00100000:2.0:1787560656.911553:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 209 00000100:00100000:2.0:1787560656.911566:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+34:11916:x1874392853343104:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:2.0:1787560656.911591:0:10172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560656.911610:0:10172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34a80 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ff23 expref: -99 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.911677:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34a80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff23 expref: 35 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.911692:0:10172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34a80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff23 expref: 35 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560656.911710:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafc5393800) 00010000:00010000:2.0:1787560656.911713:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787560656.911717:0:10172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2169400, rc 0) 00000100:00100000:2.0:1787560656.911786:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+35:11916:x1874392853343104:12345-192.168.203.29@tcp:101:bash.0 Request processed in 222us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560656.911807:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 209 00000100:00100000:1.0:1787560656.914935:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560656.916558:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853343232 00000100:00100000:3.0:1787560656.916570:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853343232 00000100:00100000:3.0:1787560656.916702:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 66 00000100:00100000:3.0:1787560656.916772:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+7:11916:x1874392853343232:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:3.0:1787560656.916789:0:10171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560656.916823:0:10171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000783c6363/0x4642c20bf2f34a87 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ff2a expref: -99 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787560656.916917:0:10171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a8c02cd, atime: 0x6a8c02cb, ctime: 0x6a8c02cd, blocks: 0x8 00010000:00010000:3.0:1787560656.916942:0:10171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=376s v=(0 0) 00010000:00010000:3.0:1787560656.916948:0:10171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560656.916956:0:10171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000783c6363/0x4642c20bf2f34a87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff2a expref: 8 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560656.916975:0:10171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000783c6363/0x4642c20bf2f34a87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff2a expref: 8 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560656.917018:0:10171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f7c00, rc 0) 00000100:00100000:3.0:1787560656.917193:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+8:11916:x1874392853343232:12345-192.168.203.29@tcp:101:bash.0 Request processed in 481us (2265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560656.917200:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 66 00000100:00100000:1.0:1787560656.919818:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560656.919878:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853343360 00000100:00100000:0.0:1787560656.919887:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853343360 00002000:00010000:0.0:1787560656.919923:0:8419:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:0.0:1787560656.919928:0:8419:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cafe0687800 with x1874392853343360 ext(0->18446744073709551615) 00002000:00010000:0.0:1787560656.919940:0:8419:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cafe0687800. 00000100:00100000:0.0:1787560656.919969:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:0.0:1787560656.919978:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9331bacf-6cfc-4379-8649-925e79b19df1+8:2405:x1874392853343360:12345-192.168.203.29@tcp:10:bash.0 00002000:00010000:0.0:1787560656.920214:0:8419:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787560656.920217:0:8419:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1787560653 -> 1787560656 00002000:00010000:0.0:1787560656.920220:0:8419:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1787560651 -> 1787560651 00002000:00010000:0.0:1787560656.920222:0:8419:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1787560653 -> 1787560656 00002000:00010000:0.0:1787560656.920223:0:8419:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1787560656.920285:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9331bacf-6cfc-4379-8649-925e79b19df1+9:2405:x1874392853343360:12345-192.168.203.29@tcp:10:bash.0 Request processed in 306us (474us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1787560656.920306:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 5 00002000:00010000:0.0:1787560656.920310:0:8419:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:0.0:1787560656.920312:0:8419:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cafe0687800 with x1874392853343360 ext(0->18446744073709551615) 00002000:00010000:0.0:1787560656.920317:0:8419:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cafe0687800. 00000100:00100000:2.0:1787560656.948098:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787560656.948572:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862834816:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787560656.948647:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560656.949066:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862834816 00000100:00100000:0.0:1787560656.949074:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862834816 00000100:00100000:0.0:1787560656.949123:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787560656.949133:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3be8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862834816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787560656.949168:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787560656.949227:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3be8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862834816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560656.949236:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787560656.949500:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862834816:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787560657.030901:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560657.034000:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853343488 00000100:00100000:2.0:1787560657.034034:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853343488 00000100:00100000:2.0:1787560657.034097:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 210 00000100:00100000:2.0:1787560657.034108:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+35:12407:x1874392853343488:12345-192.168.203.29@tcp:34:lfs.0 00010000:00010000:2.0:1787560657.034180:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34a8e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.034197:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34a8e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.034209:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34a8e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.034224:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34a95 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.034232:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34a95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.034239:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34a95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.034308:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34a9c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.034317:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34a9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.034323:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34a9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787560657.034366:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34a9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.034389:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34a8e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.034395:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34a8e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.034401:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34a8e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.034406:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169a00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560657.034410:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34a8e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.034417:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34a8e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.034461:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:2.0:1787560657.034465:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560657.034469:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34a8e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.034475:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34a8e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.034489:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34a95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.034495:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34a95 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.034500:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34a95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.034510:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560657.034513:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34a95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.034519:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34a95 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.034528:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cafef7d0d00) 00010000:00010000:2.0:1787560657.034531:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560657.034533:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34a95 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.034539:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34a95 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.034552:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34a9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.034558:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34a9c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.034563:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34a9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.034567:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560657.034570:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34a9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.034575:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34a9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.034593:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafc5393800) 00010000:00010000:2.0:1787560657.034596:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560657.034599:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34a9c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.034604:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34a9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560657.034682:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+35:12407:x1874392853343488:12345-192.168.203.29@tcp:34:lfs.0 Request processed in 575us (3790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560657.034689:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 210 00000100:00100000:3.0:1787560657.096369:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560657.096484:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853343744 00000100:00100000:0.0:1787560657.096493:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853343744 00000100:00100000:0.0:1787560657.096555:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 211 00000100:00100000:0.0:1787560657.096566:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+35:12410:x1874392853343744:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:0.0:1787560657.096585:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560657.096606:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34aa3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ff31 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.096680:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34aaa lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.096696:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34aaa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.096707:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34aaa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.096747:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34ab1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.096756:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.096762:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.097050:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34ab8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.097061:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.097068:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560657.097079:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787560657.097157:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34aaa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.097165:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34aaa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.097171:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34aaa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.097177:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881000 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560657.097181:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34aaa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.097199:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34aaa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.097211:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:0.0:1787560657.097214:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560657.097218:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34aaa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.097224:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34aaa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.097238:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.097244:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34ab1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.097250:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.097255:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560657.097257:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.097262:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34ab1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.097269:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cafc5393a00) 00010000:00010000:0.0:1787560657.097271:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560657.097274:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34ab1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.097289:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34ab1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.097331:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34aa3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff31 expref: 38 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.097343:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff31 expref: 37 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.097351:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafc5393800) 00010000:00010000:0.0:1787560657.097354:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787560657.097356:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3880200, rc 0) 00000100:00100000:0.0:1787560657.097517:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+37:12410:x1874392853343744:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 953us (1158us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1787560657.097525:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 211 00000100:00100000:1.0:1787560657.105755:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560657.105867:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853343872 00000100:00100000:0.0:1787560657.105880:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853343872 00000100:00100000:0.0:1787560657.105952:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 212 00000100:00100000:0.0:1787560657.105965:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+37:12410:x1874392853343872:12345-192.168.203.29@tcp:54:lfs.0 00010000:00010000:0.0:1787560657.106049:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34ac6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.106069:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34a5d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff15 expref: 37 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.106081:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34ac6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.106154:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34a5d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff15 expref: 37 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.106170:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34a5d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff15 expref: 37 pid: 10172 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560657.106187:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6500:1874392862834944:192.168.203.29@tcp:104: 00000100:00100000:0.0:1787560657.106310:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec31ec540 going to sleep for 11 seconds 00000100:00100000:0.0:1787560657.110755:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6500:1874392862834944:192.168.203.29@tcp:104: 00010000:00010000:0.0:1787560657.110813:0:6500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34ac6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560657.117371:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560657.118001:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853344128 00000100:00100000:2.0:1787560657.118015:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853344128 00000100:00100000:2.0:1787560657.118084:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 52 00000100:00100000:2.0:1787560657.118096:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3baea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+38:6644:x1874392853344128:12345-192.168.203.29@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787560657.118509:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3baea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+39:6644:x1874392853344128:12345-192.168.203.29@tcp:35:ldlm_bl.0 Request processed in 412us (1151us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1787560657.118518:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 52 00000100:00100000:1.0:1787560657.145673:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560657.149323:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853344256 00000100:00100000:3.0:1787560657.149344:0:9502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853344256 00010000:00010000:3.0:1787560657.149415:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34a5d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff15 expref: 39 pid: 10172 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560657.149598:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 96 00000100:00100000:3.0:1787560657.149612:0:9502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd7cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+39:2405:x1874392853344256:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560657.149630:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560657.149639:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34a5d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff15 expref: 39 pid: 10172 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560657.149657:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34a5d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff15 expref: 39 pid: 10172 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560657.149691:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168800/0x4642c20bf2f34a5d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff15 expref: 39 pid: 10172 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560657.149714:0:9502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafc5393800) 00010000:00010000:3.0:1787560657.149721:0:9502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34ac6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560657.149758:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560657.149767:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34ac6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560657.149817:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560657.149897:0:9502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd7cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+38:2405:x1874392853344256:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 287us (4238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560657.149905:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 96 00010000:00010000:2.0:1787560657.150299:0:6500:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.150310:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.150359:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.150367:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34ac6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.150384:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.150391:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560657.150396:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.150405:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34ac6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.150417:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafc5393800) 00010000:00010000:2.0:1787560657.150420:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787560657.150424:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34ac6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.150448:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34ac6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560657.150500:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+37:12410:x1874392853343872:12345-192.168.203.29@tcp:54:lfs.0 Request processed in 44537us (44760us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560657.150510:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 212 00000100:00100000:1.0:1787560657.164840:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560657.165097:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853344512 00000100:00100000:3.0:1787560657.165844:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853344512 00000100:00100000:3.0:1787560657.165939:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 53 00000100:00100000:3.0:1787560657.165952:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+37:12410:x1874392853344512:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:3.0:1787560657.167005:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+38:12410:x1874392853344512:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 1046us (2170us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1787560657.167017:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 53 00000100:00100000:3.0:1787560657.267846:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560657.267928:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853344768 00000100:00100000:0.0:1787560657.267941:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853344768 00000100:00100000:0.0:1787560657.268015:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 213 00000100:00100000:0.0:1787560657.268027:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec398a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+38:12421:x1874392853344768:12345-192.168.203.29@tcp:101:cat.0 00010000:00010000:0.0:1787560657.268060:0:13787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560657.268085:0:13787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34acd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ff38 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.268182:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34ad4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.268201:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34ad4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.268218:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34ad4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.268281:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff000/0x4642c20bf2f34adb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.268294:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff000/0x4642c20bf2f34adb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.268304:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff000/0x4642c20bf2f34adb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.268477:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff800/0x4642c20bf2f34ae2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.268488:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff800/0x4642c20bf2f34ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.268496:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff800/0x4642c20bf2f34ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560657.268509:0:13787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:1.0:1787560657.268622:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34ad4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.268631:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34ad4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.268640:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34ad4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.268668:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560657.268675:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34ad4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.268683:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34ad4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.268699:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:1.0:1787560657.268702:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560657.268708:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34ad4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.268714:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34ad4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.268728:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff000/0x4642c20bf2f34adb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.268735:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff000/0x4642c20bf2f34adb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.268742:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff000/0x4642c20bf2f34adb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.268747:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ff000 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560657.268749:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff000/0x4642c20bf2f34adb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.268755:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff000/0x4642c20bf2f34adb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.268775:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9caec3203200) 00010000:00010000:1.0:1787560657.268777:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560657.268780:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff000/0x4642c20bf2f34adb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.268785:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff000/0x4642c20bf2f34adb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.268846:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34acd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff38 expref: 41 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.268863:0:13787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff800/0x4642c20bf2f34ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff38 expref: 40 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.268872:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafc5393800) 00010000:00010000:1.0:1787560657.268874:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787560657.268877:0:13787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb0021ff800, rc 0) 00000100:00100000:1.0:1787560657.268965:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec398a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+40:12421:x1874392853344768:12345-192.168.203.29@tcp:101:cat.0 Request processed in 938us (1132us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1787560657.268974:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 213 00000100:00100000:1.0:1787560657.279264:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560657.279397:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853345024 00000100:00100000:2.0:1787560657.279411:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853345024 00000100:00100000:2.0:1787560657.279528:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 54 00000100:00100000:2.0:1787560657.279541:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+40:12421:x1874392853345024:12345-192.168.203.29@tcp:35:cat.0 00000100:00100000:2.0:1787560657.279948:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+41:12421:x1874392853345024:12345-192.168.203.29@tcp:35:cat.0 Request processed in 408us (696us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1787560657.279957:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 54 00000100:00100000:3.0:1787560657.319586:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560657.321277:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853345280 00000100:00100000:0.0:1787560657.321297:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853345280 00000100:00100000:0.0:1787560657.324297:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 214 00000100:00100000:0.0:1787560657.324333:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec398b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+41:12422:x1874392853345280:12345-192.168.203.29@tcp:36:rm.0 00010000:00010000:0.0:1787560657.324445:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1787560657.324485:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34a80 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff23 expref: 41 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.324516:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff800/0x4642c20bf2f34ae2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff38 expref: 40 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.324531:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34ab8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff31 expref: 39 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.324544:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f34a72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff1c expref: 38 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.324556:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafc5393800) 00010000:00010000:0.0:1787560657.324562:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787560657.324591:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34af0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.324608:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34af0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.324619:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34af0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.325256:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34af7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.325266:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34af7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.325275:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34af7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.325384:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34afe lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.325393:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34afe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.325401:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34afe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787560657.326972:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1787560657.326993:0:6498:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 376666561002ns, next at 377666556798ns, rc = 0 00010000:00010000:0.0:1787560657.327076:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34b05 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.327094:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34b05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.329272:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34b05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.329300:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34b05 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.329336:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34b05 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.329343:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34b05 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.329502:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787560657.329540:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34afe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.329546:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34afe lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.329552:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34afe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.329558:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881c00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560657.329564:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34afe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.329572:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34afe lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.329591:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafc5393800) 00010000:00010000:0.0:1787560657.329595:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787560657.329600:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34afe lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.329607:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34afe lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.329636:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34af0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.329663:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34af0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.329669:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34af0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.329675:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881000 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560657.329678:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34af0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.329685:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34af0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.329695:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:0.0:1787560657.329697:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560657.329700:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34af0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.329706:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34af0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787560657.329718:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb29f778 reply state 00000000c2d4ddf8 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34af7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.329733:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34af7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.329741:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cafc5393a00) 00010000:00010000:0.0:1787560657.329743:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787560657.329747:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787560657.329882:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec398b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+39:12422:x1874392853345280:12345-192.168.203.29@tcp:36:rm.0 Request processed in 5563us (10305us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1787560657.329900:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 214 00010000:00010000:2.0:1787560657.333864:0:6487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560657.333884:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34b05 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.333898:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881a00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:2.0:1787560657.333904:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34b05 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.333915:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34b05 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.333941:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafc5393800) 00010000:00010000:2.0:1787560657.333944:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787560657.333950:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34b05 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.333957:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34b05 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.334017:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560657.334019:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560657.334021:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560657.379571:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560657.383892:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853345536 00000100:00100000:2.0:1787560657.383915:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853345536 00000100:00100000:2.0:1787560657.384090:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 215 00000100:00100000:2.0:1787560657.384115:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+39:12428:x1874392853345536:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:2.0:1787560657.384150:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560657.384175:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34b0c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ff3f expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.384313:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34b13 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.384364:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34b13 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.384379:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34b13 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.384394:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34b1a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.384403:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34b1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.384410:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34b1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787560657.390422:0:6500:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1787560657.391487:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34b21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.391511:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34b21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.391526:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34b21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.391577:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34b13 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.391607:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34b13 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.391615:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34b13 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.391641:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560657.391828:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34b13 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.391839:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34b13 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.391855:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:2.0:1787560657.391858:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560657.391865:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34b13 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.391871:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34b13 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787560657.391891:0:6500:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b91406c8 reply state 000000000437eb92 transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34b1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.391905:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34b1a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.391911:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cafc5393a00) 00010000:00010000:2.0:1787560657.391913:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787560657.391917:0:6500:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787560657.391968:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34b0c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff3f expref: 42 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.391986:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34b21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff3f expref: 41 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.392007:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0d00) 00010000:00010000:2.0:1787560657.392009:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787560657.392012:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2168a00, rc 0) 00000100:00100000:2.0:1787560657.392407:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+42:12428:x1874392853345536:12345-192.168.203.29@tcp:101:bash.0 Request processed in 8303us (12850us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1787560657.392419:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 215 00000100:00100000:1.0:1787560657.413867:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560657.414859:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853345664 00000100:00100000:3.0:1787560657.414876:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853345664 00000100:00100000:3.0:1787560657.414964:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 67 00000100:00100000:3.0:1787560657.414978:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4050a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+7:2405:x1874392853345664:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:3.0:1787560657.415002:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560657.415029:0:8412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f34b2f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ff46 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787560657.415095:0:8412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787560657.415195:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=376s v=(0 0) 00010000:00010000:3.0:1787560657.415201:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560657.415213:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f34b2f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff46 expref: 8 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560657.415237:0:8412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f34b2f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff46 expref: 8 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560657.415254:0:8412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f6800, rc 0) 00000100:00100000:3.0:1787560657.415348:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4050a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+8:2405:x1874392853345664:12345-192.168.203.29@tcp:101:bash.0 Request processed in 372us (1759us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560657.415357:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 67 00000100:00100000:1.0:1787560657.421594:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560657.421926:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853345792 00000100:00100000:0.0:1787560657.421940:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853345792 00000100:00100000:0.0:1787560657.422020:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 68 00000100:00100000:0.0:1787560657.422033:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4050380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+8:12428:x1874392853345792:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:0.0:1787560657.422057:0:8414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560657.422081:0:8414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6e0e1f9/0x4642c20bf2f34b36 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ff4d expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.422192:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f34b2f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff46 expref: 9 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.422204:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560657.422209:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560657.422215:0:8414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6e0e1f9/0x4642c20bf2f34b36 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff4d expref: 9 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.422260:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f34b2f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff46 expref: 9 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.422278:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f34b2f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff46 expref: 9 pid: 8412 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560657.422297:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8414:1874392862835072:192.168.203.29@tcp:104: 00000100:00100000:0.0:1787560657.422916:0:8414:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec31ecc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787560657.427915:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560657.428145:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853345920 00000100:00100000:1.0:1787560657.428159:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853345920 00010000:00010000:1.0:1787560657.428213:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f34b2f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff46 expref: 10 pid: 8412 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560657.428286:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 97 00000100:00100000:1.0:1787560657.428299:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+10:2405:x1874392853345920:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560657.428319:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560657.428349:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f34b2f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff46 expref: 10 pid: 8412 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.428366:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f34b2f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff46 expref: 10 pid: 8412 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.428396:0:6485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560657.428401:0:6485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560657.428410:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e6e0e1f9/0x4642c20bf2f34b36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff4d expref: 10 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.428421:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6e0e1f9/0x4642c20bf2f34b36 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff4d expref: 10 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.428511:0:6485:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e6e0e1f9/0x4642c20bf2f34b36 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff4d expref: 10 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560657.428529:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4050e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6485:1874392862835200:192.168.203.29@tcp:105: 00010000:00010000:3.0:1787560657.428783:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f34b2f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff46 expref: 10 pid: 8412 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560657.428811:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8414:1874392862835072:192.168.203.29@tcp:104: 00010000:00010000:3.0:1787560657.428847:0:8414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e6e0e1f9/0x4642c20bf2f34b36 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff4d expref: 9 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560657.428858:0:8414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881c00, rc 0) 00000100:00100000:3.0:1787560657.428893:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4050380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+9:12428:x1874392853345792:12345-192.168.203.29@tcp:101:bash.0 Request processed in 6862us (7317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560657.428902:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 68 00000100:00100000:1.0:1787560657.434877:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc8af8240 going to sleep for 11 seconds 00000100:00100000:3.0:1787560657.437534:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4050e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6485:1874392862835200:192.168.203.29@tcp:105: 00010000:00010000:3.0:1787560657.437572:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560657.437644:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+8:2405:x1874392853345920:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 9346us (9742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560657.437657:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 97 00000100:00100000:0.0:1787560657.448297:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560657.451214:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853346176 00000100:00100000:2.0:1787560657.451237:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853346176 00000100:00100000:2.0:1787560657.451405:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 55 00000100:00100000:2.0:1787560657.451419:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+42:12428:x1874392853346176:12345-192.168.203.29@tcp:35:bash.0 00000100:00100000:2.0:1787560657.451901:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+43:12428:x1874392853346176:12345-192.168.203.29@tcp:35:bash.0 Request processed in 482us (3615us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1787560657.451910:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 55 00000001:00080000:1.0:1787560657.461763:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:1.0:1787560657.461797:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:0.0:1787560657.633569:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560657.633814:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853346304 00000100:00100000:1.0:1787560657.633824:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853346304 00000100:00100000:1.0:1787560657.633891:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 216 00000100:00100000:1.0:1787560657.633902:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+43:12444:x1874392853346304:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:1.0:1787560657.633926:0:13787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560657.633947:0:13787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff400/0x4642c20bf2f34b3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ff54 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.634007:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff600/0x4642c20bf2f34b44 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.634018:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff600/0x4642c20bf2f34b44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.634029:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff600/0x4642c20bf2f34b44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560657.634069:0:13787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1787560657.634073:0:13787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787560657.634092:0:13787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff600/0x4642c20bf2f34b44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.634129:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff400/0x4642c20bf2f34b3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff54 expref: 45 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.634148:0:13787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff600/0x4642c20bf2f34b44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff54 expref: 44 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.634157:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:1.0:1787560657.634173:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787560657.634177:0:13787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb0021ff600, rc 0) 00000100:00100000:1.0:1787560657.634240:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+44:12444:x1874392853346304:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 339us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560657.634247:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 216 00000100:00100000:1.0:1787560657.653834:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560657.654402:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853346560 00000100:00100000:0.0:1787560657.654412:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853346560 00000100:00100000:0.0:1787560657.654503:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 217 00000100:00100000:0.0:1787560657.654515:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+44:12444:x1874392853346560:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:0.0:1787560657.654534:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560657.654553:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34b4b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ff5b expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.654669:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34b52 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.654682:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34b52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.654693:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34b52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560657.654705:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787560657.654839:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34b4b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff5b expref: 47 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.654859:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34b52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff5b expref: 46 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.654868:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0d00) 00010000:00010000:0.0:1787560657.654871:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787560657.654888:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881000, rc 0) 00000100:00100000:0.0:1787560657.654955:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+46:12444:x1874392853346560:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 442us (1130us total) trans 4294967487 rc 0/0 00000100:00100000:0.0:1787560657.654962:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 217 00000100:00100000:0.0:1787560657.659572:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560657.659628:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560657.659740:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853346944 00000100:00100000:2.0:1787560657.659754:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853346944 00000100:00100000:2.0:1787560657.659845:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 218 00000100:00100000:2.0:1787560657.659858:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+46:12444:x1874392853346944:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1787560657.659908:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560657.659935:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34b60 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ff62 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.660079:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34b67 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.660096:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34b67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.660133:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34b67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560657.660150:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00000100:00100000:3.0:1787560657.661271:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853346816 00000100:00100000:3.0:1787560657.661282:0:9502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853346816 00010000:00010000:2.0:1787560657.661379:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34b60 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff62 expref: 50 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.661408:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34b67 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff62 expref: 49 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.661419:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0d00) 00010000:00010000:2.0:1787560657.661422:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787560657.661426:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2168200, rc 0) 00000100:00100000:2.0:1787560657.661523:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+49:12444:x1874392853346944:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 1666us (1893us total) trans 4294967488 rc 0/0 00000100:00100000:2.0:1787560657.661532:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 218 00000100:00100000:3.0:1787560657.662181:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00100000:3.0:1787560657.662197:0:9502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+48:2403:x1874392853346816:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560657.662217:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560657.662244:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34b52 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff5b expref: 48 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560657.662260:0:9502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0d00) 00010000:00010000:3.0:1787560657.662264:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560657.662296:0:9502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+47:2403:x1874392853346816:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 105us (2739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560657.662303:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00100000:1.0:1787560657.675774:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560657.675924:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853347072 00000100:00100000:3.0:1787560657.675938:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853347072 00000100:00100000:3.0:1787560657.676016:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 69 00000100:00100000:3.0:1787560657.676031:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4051880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+6:2405:x1874392853347072:12345-192.168.203.29@tcp:1:lfs.0 00010000:00010000:3.0:1787560657.676105:0:8412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f34b75 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560657.676132:0:8412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e6e0e1f9/0x4642c20bf2f34b36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff4d expref: 6 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560657.676490:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787560657.676496:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787560657.676501:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f34b75 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560657.676550:0:8412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e6e0e1f9/0x4642c20bf2f34b36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff4d expref: 6 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560657.676569:0:8412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e6e0e1f9/0x4642c20bf2f34b36 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff4d expref: 6 pid: 8414 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560657.676587:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec398a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1874392862835328:192.168.203.29@tcp:104: 00000100:00100000:3.0:1787560657.676771:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec22aa180 going to sleep for 11 seconds 00000100:00100000:3.0:1787560657.679771:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec398a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1874392862835328:192.168.203.29@tcp:104: 00010000:00010000:3.0:1787560657.679820:0:8412:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f34b75 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560657.681827:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560657.681920:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853347200 00000100:00100000:0.0:1787560657.681932:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853347200 00002000:00100000:0.0:1787560657.682000:0:8418:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9caec4052d80 x1874392853347200/t0(0) o4->9331bacf-6cfc-4379-8649-925e79b19df1@192.168.203.29@tcp:18/0 lens 504/0 e 0 to 0 dl 1787560668 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787560657.682013:0:8418:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9caec4052d80 with x1874392853347200 ext(0->8) 00010000:00010000:0.0:1787560657.682024:0:8418:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e6e0e1f9/0x4642c20bf2f34b36 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff4d expref: 7 pid: 8414 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.682044:0:8418:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e6e0e1f9/0x4642c20bf2f34b36 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff4d expref: 7 pid: 8414 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787560657.682052:0:8418:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9caec4052d80 00000100:00100000:0.0:1787560657.682101:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:0.0:1787560657.682114:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4052d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9331bacf-6cfc-4379-8649-925e79b19df1+7:2404:x1874392853347200:12345-192.168.203.29@tcp:4:lfs.0 00000100:00100000:0.0:1787560657.687159:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4052d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9331bacf-6cfc-4379-8649-925e79b19df1+9:2404:x1874392853347200:12345-192.168.203.29@tcp:4:lfs.0 Request processed in 5028us (5323us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787560657.687179:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 3 00002000:00100000:0.0:1787560657.687197:0:8418:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9caec4052d80 x1874392853347200/t4294967309(0) o4->9331bacf-6cfc-4379-8649-925e79b19df1@192.168.203.29@tcp:18/0 lens 504/448 e 0 to 0 dl 1787560668 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787560657.687210:0:8418:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9caec4052d80 with x1874392853347200 ext(0->8) 00010000:00010000:0.0:1787560657.687245:0:8418:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e6e0e1f9/0x4642c20bf2f34b36 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff4d expref: 9 pid: 8414 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.687272:0:8418:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e6e0e1f9/0x4642c20bf2f34b36 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff4d expref: 9 pid: 8414 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787560657.687282:0:8418:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9caec4052d80 00000100:00100000:1.0:1787560657.690558:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560657.690667:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853347328 00000100:00100000:2.0:1787560657.690680:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853347328 00010000:00010000:2.0:1787560657.690733:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e6e0e1f9/0x4642c20bf2f34b36 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff4d expref: 9 pid: 8414 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560657.690796:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 98 00000100:00100000:2.0:1787560657.690809:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4051f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+9:2405:x1874392853347328:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560657.690828:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787560657.690850:0:6484:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787560657.690854:0:6484:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787560657 00002000:00010000:2.0:1787560657.690888:0:6484:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787560657 00002000:00010000:2.0:1787560657.690891:0:6484:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1787560657 00002000:00010000:2.0:1787560657.690893:0:6484:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1787560657.690901:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e6e0e1f9/0x4642c20bf2f34b36 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff4d expref: 9 pid: 8414 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.690918:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e6e0e1f9/0x4642c20bf2f34b36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff4d expref: 9 pid: 8414 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.690950:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6e0e1f9/0x4642c20bf2f34b36 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff4d expref: 9 pid: 8414 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.690972:0:6484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787560657.690977:0:6484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787560657.690984:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f34b75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.690997:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f34b75 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.691042:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560657.691111:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4051f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+8:2405:x1874392853347328:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 304us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560657.691120:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 98 00010000:00010000:0.0:1787560657.691241:0:8412:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f34b75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.691252:0:8412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f34b75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.691278:0:8412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f34b75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.691287:0:8412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f34b75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.691296:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f34b75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.691304:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6800 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560657.691309:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f34b75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.691319:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f34b75 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.691341:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f34b75 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.691350:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cbf8db7/0x4642c20bf2f34b75 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560657.691405:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4051880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+7:2405:x1874392853347072:12345-192.168.203.29@tcp:1:lfs.0 Request processed in 15378us (15646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560657.691414:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 69 00000100:00100000:1.0:1787560657.701541:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560657.701948:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853347584 00000100:00100000:3.0:1787560657.701958:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853347584 00000100:00100000:3.0:1787560657.702023:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 56 00000100:00100000:3.0:1787560657.702033:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd7c06450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+47:12444:x1874392853347584:12345-192.168.203.29@tcp:35:lfs.0 00000004:00010000:3.0:1787560657.702114:0:6501:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34b67 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff62 expref: 47 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787560657.702323:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1787560657.702358:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:3.0:1787560657.702666:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:3.0:1787560657.702718:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34b7c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560657.702733:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34b21 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff3f expref: 51 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560657.702742:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34b7c lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560657.702772:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34b21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff3f expref: 51 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560657.704687:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34b21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff3f expref: 51 pid: 6500 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560657.704953:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec398a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6501:1874392862835456:192.168.203.29@tcp:104: 00000100:00100000:3.0:1787560657.705123:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec22aa180 going to sleep for 11 seconds 00000100:00100000:1.0:1787560657.714217:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560657.714300:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853347712 00000100:00100000:0.0:1787560657.714309:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853347712 00010000:00010000:0.0:1787560657.714349:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34b21 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff3f expref: 52 pid: 6500 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560657.714393:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 99 00000100:00100000:0.0:1787560657.714403:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4052300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+52:2404:x1874392853347712:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787560657.714417:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560657.714423:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34b21 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff3f expref: 52 pid: 6500 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.714470:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34b21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff3f expref: 52 pid: 6500 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.714492:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0d00) 00010000:00010000:0.0:1787560657.714498:0:6486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34b7c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.714522:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34b7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.714529:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34b7c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.714548:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787560657.714887:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34b21 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff3f expref: 52 pid: 6500 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560657.714904:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec398a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6501:1874392862835456:192.168.203.29@tcp:104: 00010000:00010000:3.0:1787560657.714923:0:6501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34b7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560657.714943:0:6501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34b7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560657.714950:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34b7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787560657.715050:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000001:00080000:3.0:1787560657.715171:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:3.0:1787560657.715262:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec398a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6501:1874392862835584:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787560657.715311:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560657.715337:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec22aa240 going to sleep for 11 seconds 00000100:00100000:3.0:1787560657.715356:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862835584 00000100:00100000:3.0:1787560657.715360:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862835584 00000100:00100000:3.0:1787560657.715399:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787560657.715407:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec398aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6501:x1874392862835584:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787560657.715508:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec398aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6501:x1874392862835584:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 101us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560657.715515:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00080000:3.0:1787560657.715536:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787560657.715555:0:6501:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:3.0:1787560657.715560:0:6501:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:3.0:1787560657.715574:0:6501:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9caec4040a80, transno 4294967308 00000100:00100000:0.0:1787560657.717655:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4052300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+53:2404:x1874392853347712:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 3244us (3438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560657.717667:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 99 00000100:00100000:3.0:1787560657.719039:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec398a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6501:1874392862835584:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787560657.719257:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:3.0:1787560657.720348:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec398a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6501:1874392862835712:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787560657.720413:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560657.720489:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec22aab40 going to sleep for 11 seconds 00000100:00100000:0.0:1787560657.721193:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862835712 00000100:00100000:0.0:1787560657.721201:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862835712 00000100:00100000:0.0:1787560657.721262:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787560657.721273:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec398b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6501:x1874392862835712:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787560657.721428:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec398b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6501:x1874392862835712:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 155us (1014us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787560657.721456:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787560657.721552:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec398a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6501:1874392862835712:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787560657.721618:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1787560657.721657:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34b7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.721677:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34b7c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.721684:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34b7c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.721691:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7000 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560657.721696:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34b7c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.721714:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34b7c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.721731:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0d00) 00010000:00010000:2.0:1787560657.721734:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787560657.721738:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34b7c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.721744:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34b7c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787560657.721858:0:6501:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787560657.721915:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1787560657.721927:0:6501:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 377061494940ns, next at 378061492239ns, rc = 0 00000001:00080000:2.0:1787560657.721934:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:2.0:1787560657.721959:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0d00) 00010000:00010000:2.0:1787560657.721961:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787560657.721967:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34b67 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff62 expref: 55 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560657.722143:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd7c06450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+54:12444:x1874392853347584:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 20110us (20609us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1787560657.722152:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 56 00000020:00080000:2.0:1787560657.722157:0:6501:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787560657.723985:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560657.724042:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853347840 00000100:00100000:2.0:1787560657.724049:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853347840 00000100:00100000:2.0:1787560657.724089:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 219 00000100:00100000:2.0:1787560657.724095:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+54:12444:x1874392853347840:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1787560657.724114:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560657.724135:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34b83 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ff69 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.724185:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34b83 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff69 expref: 55 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.724200:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34b83 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff69 expref: 55 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.724223:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:2.0:1787560657.724227:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787560657.724229:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2169000, rc 0) 00000100:00100000:2.0:1787560657.724279:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+55:12444:x1874392853347840:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 183us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560657.724286:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 219 00000100:00100000:1.0:1787560657.731067:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560657.731848:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853348096 00000100:00100000:2.0:1787560657.731860:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853348096 00000100:00100000:2.0:1787560657.731938:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 57 00000100:00100000:2.0:1787560657.731949:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+55:12444:x1874392853348096:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:2.0:1787560657.732239:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+56:12444:x1874392853348096:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 290us (1190us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1787560657.732248:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 57 00000100:00100000:0.0:1787560657.798926:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560657.799016:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853348224 00000100:00100000:2.0:1787560657.799026:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853348224 00000100:00100000:2.0:1787560657.799087:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 220 00000100:00100000:2.0:1787560657.799097:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+56:12454:x1874392853348224:12345-192.168.203.29@tcp:34:lfs.0 00010000:00010000:2.0:1787560657.799178:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34b8a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.799195:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34b8a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.799207:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34b8a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.799221:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f34b91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.799228:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f34b91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.799235:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f34b91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.799303:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f34b98 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.799328:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f34b98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.799336:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f34b98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787560657.799397:0:10172:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f34b98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.799409:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34b8a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.799415:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34b8a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.799422:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34b8a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.799427:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560657.799469:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34b8a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.799476:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34b8a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.799488:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:2.0:1787560657.799491:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560657.799496:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34b8a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.799510:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34b8a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.799529:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f34b91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.799535:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f34b91 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.799541:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f34b91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.799546:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168400 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560657.799549:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f34b91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.799556:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f34b91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.799564:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cafc5393a00) 00010000:00010000:2.0:1787560657.799566:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560657.799569:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f34b91 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.799575:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f34b91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.799583:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f34b98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.799589:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f34b98 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.799594:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f34b98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.799605:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168e00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560657.799608:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f34b98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.799614:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f34b98 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.799622:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:2.0:1787560657.799624:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560657.799626:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f34b98 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.799631:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f34b98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560657.799707:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+56:12454:x1874392853348224:12345-192.168.203.29@tcp:34:lfs.0 Request processed in 611us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560657.799715:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 220 00000100:00100000:1.0:1787560657.834872:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560657.835081:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853348480 00000100:00100000:2.0:1787560657.835090:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853348480 00000100:00100000:2.0:1787560657.835149:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 221 00000100:00100000:2.0:1787560657.835160:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+56:12457:x1874392853348480:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1787560657.835179:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560657.835200:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f34b9f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ff70 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.835270:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f34ba6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.835302:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f34ba6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.835313:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f34ba6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.835325:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34bad lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.835332:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34bad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.835339:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34bad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.835546:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34bb4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.835555:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.835562:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560657.835571:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787560657.835639:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f34ba6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.835645:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f34ba6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.835652:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f34ba6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.835665:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168400 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560657.835670:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f34ba6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.835675:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f34ba6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.835686:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:2.0:1787560657.835689:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560657.835693:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f34ba6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.835698:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168400/0x4642c20bf2f34ba6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.835935:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34bad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.835944:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34bad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.835950:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34bad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.835955:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560657.835958:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34bad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.835964:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34bad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.835983:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cafc5393a00) 00010000:00010000:2.0:1787560657.835986:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560657.835989:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34bad lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.835995:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168200/0x4642c20bf2f34bad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.836030:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f34b9f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff70 expref: 59 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.836044:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34bb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff70 expref: 58 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.836051:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:2.0:1787560657.836053:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787560657.836056:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2168a00, rc 0) 00000100:00100000:2.0:1787560657.836121:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+58:12457:x1874392853348480:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 963us (1259us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1787560657.836129:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 221 00000100:00100000:1.0:1787560657.843618:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560657.843903:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853348608 00000100:00100000:0.0:1787560657.843913:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853348608 00000100:00100000:0.0:1787560657.843967:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 222 00000100:00100000:0.0:1787560657.843976:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+58:12457:x1874392853348608:12345-192.168.203.29@tcp:54:lfs.0 00010000:00010000:0.0:1787560657.844037:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34bc2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.844052:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.844080:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.844112:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.844232:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34bc2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.844240:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.844245:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880c00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560657.844249:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.844256:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34bc2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.844268:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:0.0:1787560657.844271:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787560657.844276:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34bc2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.844282:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34bc2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560657.844366:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+58:12457:x1874392853348608:12345-192.168.203.29@tcp:54:lfs.0 Request processed in 389us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560657.844373:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 222 00000100:00100000:0.0:1787560657.848853:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560657.848949:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853348864 00000100:00100000:3.0:1787560657.848967:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853348864 00000100:00100000:3.0:1787560657.849054:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 58 00000100:00100000:3.0:1787560657.849076:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+58:12457:x1874392853348864:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:3.0:1787560657.849396:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+59:12457:x1874392853348864:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 322us (552us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1787560657.849405:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 58 00010000:00010000:1.0:1787560657.907869:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560657.929936:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560657.930153:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853349120 00000100:00100000:0.0:1787560657.930338:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853349120 00000100:00100000:0.0:1787560657.930414:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 223 00000100:00100000:0.0:1787560657.930428:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+59:12467:x1874392853349120:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:0.0:1787560657.930517:0:10172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560657.930521:0:10172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787560657.930553:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff600/0x4642c20bf2f34b44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff54 expref: 59 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.930576:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:0.0:1787560657.930582:0:10172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787560657.930599:0:10172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34bc9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ff77 expref: -99 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.930737:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34bd0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.930755:0:10172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34bb4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff70 expref: 59 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.930764:0:10172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34bd0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.930819:0:10172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34bb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff70 expref: 59 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.930835:0:10172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34bb4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff70 expref: 59 pid: 6500 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560657.930877:0:10172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10172:1874392862835840:192.168.203.29@tcp:104: 00000100:00100000:0.0:1787560657.931016:0:10172:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec31ec600 going to sleep for 11 seconds 00000100:00100000:0.0:1787560657.935752:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560657.936666:0:10172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10172:1874392862835840:192.168.203.29@tcp:104: 00010000:00010000:2.0:1787560657.936704:0:10172:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34bd0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560657.936875:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853349248 00000100:00100000:1.0:1787560657.936884:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853349248 00010000:00010000:1.0:1787560657.936935:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34bb4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff70 expref: 60 pid: 6500 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560657.936981:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 100 00000100:00100000:1.0:1787560657.936993:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+60:2405:x1874392853349248:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560657.937023:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560657.937031:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34bb4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff70 expref: 60 pid: 6500 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.937045:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34bb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff70 expref: 60 pid: 6500 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.937322:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168a00/0x4642c20bf2f34bb4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff70 expref: 60 pid: 6500 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.937347:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:1.0:1787560657.937353:0:6484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34bd0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.937364:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34bd0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.937372:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34bd0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.937406:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560657.937522:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+59:2405:x1874392853349248:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 529us (1784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560657.937531:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 100 00010000:00010000:2.0:1787560657.939926:0:10172:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34bd0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.939974:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34bd0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560657.940563:0:10172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787560657.940899:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34bc9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff77 expref: 60 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.940926:0:10172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34bd0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff77 expref: 59 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.940937:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:2.0:1787560657.940940:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787560657.940944:0:10172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881600, rc 0) 00000100:00100000:2.0:1787560657.941263:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+59:12467:x1874392853349120:12345-192.168.203.29@tcp:101:bash.0 Request processed in 10836us (11339us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1787560657.941273:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 223 00000100:00100000:0.0:1787560657.946338:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560657.946460:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853349376 00000100:00100000:3.0:1787560657.946474:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853349376 00000100:00100000:3.0:1787560657.946558:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 224 00000100:00100000:3.0:1787560657.946570:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+59:12467:x1874392853349376:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:3.0:1787560657.946601:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560657.946627:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34bde lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ff7e expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560657.946678:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f34be5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560657.946704:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f34be5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560657.946717:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f34be5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560657.947279:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34bde lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff7e expref: 61 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560657.947305:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f34be5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff7e expref: 60 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560657.947326:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:3.0:1787560657.947329:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787560657.947334:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f6800, rc 0) 00000100:00100000:3.0:1787560657.947675:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+60:12467:x1874392853349376:12345-192.168.203.29@tcp:101:bash.0 Request processed in 1104us (1350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560657.947736:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 224 00000100:00100000:1.0:1787560657.951288:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560657.951542:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853349632 00000100:00100000:3.0:1787560657.951556:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853349632 00000100:00100000:3.0:1787560657.951635:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 225 00000100:00100000:3.0:1787560657.951648:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+60:12467:x1874392853349632:12345-192.168.203.29@tcp:36:bash.0 00010000:00010000:3.0:1787560657.952382:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f34bec lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560657.952407:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f34bec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560657.952832:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f34bec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787560657.953815:0:13787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:3.0:1787560657.954071:0:13787:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f090ff08 reply state 0000000014678fe0 transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f34bec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560657.954094:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f34bec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560657.954171:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:3.0:1787560657.954174:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787560657.954198:0:13787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787560657.955076:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+63:12467:x1874392853349632:12345-192.168.203.29@tcp:36:bash.0 Request processed in 3422us (3793us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1787560657.955090:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 225 00000020:00080000:3.0:1787560657.955107:0:13787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787560657.959765:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560657.959984:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853349760 00000100:00100000:0.0:1787560657.959996:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853349760 00000100:00100000:0.0:1787560657.960176:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 226 00000100:00100000:0.0:1787560657.960189:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3be8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+63:12467:x1874392853349760:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:0.0:1787560657.960224:0:10172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560657.960250:0:10172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34bf3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ff85 expref: -99 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.960407:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34bfa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.960426:0:10172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34bd0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff77 expref: 64 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.960493:0:10172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34bfa lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.960540:0:10172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34bd0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff77 expref: 64 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560657.960556:0:10172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34bd0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff77 expref: 64 pid: 10172 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560657.960593:0:10172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10172:1874392862835968:192.168.203.29@tcp:104: 00000100:00100000:0.0:1787560657.960699:0:10172:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec31eccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560657.968597:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560657.969202:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853349888 00000100:00100000:1.0:1787560657.969216:0:9502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853349888 00010000:00010000:1.0:1787560657.969272:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34bd0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff77 expref: 65 pid: 10172 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560657.969373:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 101 00000100:00100000:1.0:1787560657.969388:0:9502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+65:2404:x1874392853349888:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560657.969407:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560657.969416:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34bd0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff77 expref: 65 pid: 10172 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.969497:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34bd0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff77 expref: 65 pid: 10172 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.969526:0:9502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:1.0:1787560657.969532:0:9502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34bfa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.969545:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34bfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.969554:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34bfa lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560657.969579:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560657.969659:0:9502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+65:2404:x1874392853349888:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 275us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560657.969668:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 101 00010000:00010000:2.0:1787560657.971025:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34bd0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff77 expref: 64 pid: 10172 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560657.971063:0:10172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10172:1874392862835968:192.168.203.29@tcp:104: 00010000:00010000:2.0:1787560657.971093:0:10172:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34bfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.971106:0:10172:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34bfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.971133:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34bfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560657.971207:0:10172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787560657.971213:0:10172:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787560657.971240:0:10172:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34bfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.971285:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34bf3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff85 expref: 64 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.971304:0:10172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34bfa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff85 expref: 63 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560657.971315:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:2.0:1787560657.971318:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787560657.971321:0:10172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881a00, rc 0) 00000100:00100000:2.0:1787560657.971398:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3be8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+63:12467:x1874392853349760:12345-192.168.203.29@tcp:101:bash.0 Request processed in 11211us (11648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560657.971407:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 226 00000100:00100000:0.0:1787560657.978991:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560657.979082:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853350144 00000100:00100000:3.0:1787560657.979094:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853350144 00000100:00100000:3.0:1787560657.979170:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 59 00000100:00100000:3.0:1787560657.979183:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+63:12467:x1874392853350144:12345-192.168.203.29@tcp:35:bash.0 00000100:00100000:3.0:1787560657.979563:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+64:12467:x1874392853350144:12345-192.168.203.29@tcp:35:bash.0 Request processed in 380us (583us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1787560657.979571:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 59 00000100:00100000:3.0:1787560658.043578:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560658.043912:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853350272 00000100:00100000:2.0:1787560658.043925:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853350272 00000100:00100000:2.0:1787560658.044023:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 227 00000100:00100000:2.0:1787560658.044038:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+64:12474:x1874392853350272:12345-192.168.203.29@tcp:101:lfs.0 00000100:00080000:3.0:1787560658.044146:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787560658.044232:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560658.044260:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34c01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ff8c expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.044371:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f34c08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.044388:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f34c08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.044401:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f34c08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560658.044503:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787560658.044508:0:6499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787560658.045663:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f34c08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.045737:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34c01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff8c expref: 66 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.045765:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f34c08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff8c expref: 65 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.045775:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:2.0:1787560658.045778:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787560658.045792:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2169e00, rc 0) 00000100:00100000:2.0:1787560658.045902:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+65:12474:x1874392853350272:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 1867us (2337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560658.045910:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 227 00000100:00100000:2.0:1787560658.052030:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560658.052183:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853350400 00000100:00100000:3.0:1787560658.052197:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853350400 00000100:00100000:3.0:1787560658.052319:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 228 00000100:00100000:3.0:1787560658.052333:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+65:12474:x1874392853350400:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1787560658.052361:0:13787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560658.052389:0:13787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34c0f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ff93 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.052517:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f34c16 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.052546:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f34c16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.052559:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f34c16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.052595:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f34c1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.052605:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f34c1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.052612:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f34c1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.052732:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f34c24 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.052742:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f34c24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.052750:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f34c24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560658.052807:0:13787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787560658.052825:0:13787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787560658.052847:0:13787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f34c24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.052862:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f34c24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.052871:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f34c16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.052878:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f34c16 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.052897:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f34c16 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.052903:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafc0030200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560658.052908:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f34c16 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.052916:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f34c16 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.052930:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:3.0:1787560658.052934:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560658.052939:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f34c16 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.052944:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f34c16 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.052960:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f34c1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.052966:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f34c1d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.052971:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f34c1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.052975:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb002177800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560658.052979:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f34c1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.052994:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f34c1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.053004:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cafc5393a00) 00010000:00010000:3.0:1787560658.053006:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560658.053009:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f34c1d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.053015:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f34c1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.053050:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7000/0x4642c20bf2f34c0f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff93 expref: 67 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.053406:0:13787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f34c24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff93 expref: 66 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.053415:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:3.0:1787560658.053418:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787560658.053421:0:13787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb002176600, rc 0) 00000100:00100000:3.0:1787560658.053580:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+66:12474:x1874392853350400:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 1249us (1562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560658.053589:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 228 00000100:00100000:1.0:1787560658.060372:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560658.060507:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560658.061276:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853350528 00000100:00100000:3.0:1787560658.061290:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853350528 00000100:00100000:3.0:1787560658.061373:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:3.0:1787560658.061387:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd7cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+66:2405:x1874392853350528:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560658.061483:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560658.061516:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f34c24 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff93 expref: 66 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.061543:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:3.0:1787560658.061549:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560658.061619:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd7cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+65:2405:x1874392853350528:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 235us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560658.061627:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:0.0:1787560658.062182:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853350784 00000100:00100000:0.0:1787560658.062191:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853350784 00000100:00100000:0.0:1787560658.062244:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 229 00000100:00100000:0.0:1787560658.062254:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+65:12474:x1874392853350784:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:0.0:1787560658.062277:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560658.062299:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34c2b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ff9a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.062450:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34c32 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.062466:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34bfa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff85 expref: 66 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.062475:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34c32 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.062514:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34bfa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff85 expref: 66 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.062528:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34bfa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff85 expref: 66 pid: 10172 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560658.062560:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6498:1874392862836096:192.168.203.29@tcp:104: 00000100:00100000:0.0:1787560658.062643:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec31ec780 going to sleep for 11 seconds 00000100:00100000:3.0:1787560658.066038:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560658.066221:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853350912 00000100:00100000:2.0:1787560658.066252:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853350912 00010000:00010000:2.0:1787560658.066301:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34bfa lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff85 expref: 67 pid: 10172 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560658.066349:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 102 00000100:00100000:2.0:1787560658.066360:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec398bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+67:2404:x1874392853350912:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560658.066377:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560658.066385:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34bfa lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff85 expref: 67 pid: 10172 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.066400:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34bfa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff85 expref: 67 pid: 10172 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.066426:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:2.0:1787560658.066461:0:6486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34c32 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.066472:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34c32 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.066481:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34c32 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.066504:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560658.066559:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec398bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+67:2404:x1874392853350912:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 200us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560658.066566:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 102 00010000:00010000:0.0:1787560658.068257:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34bfa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff85 expref: 66 pid: 10172 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560658.068289:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6498:1874392862836096:192.168.203.29@tcp:104: 00010000:00010000:0.0:1787560658.068318:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34c32 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.068415:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34c32 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.068424:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34c32 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560658.068666:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787560658.069039:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34c2b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff9a expref: 67 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.069151:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34c32 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff9a expref: 66 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.069162:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:1.0:1787560658.069165:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787560658.069169:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881000, rc 0) 00000100:00100000:1.0:1787560658.069253:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+66:12474:x1874392853350784:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 6999us (8744us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1787560658.069263:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 229 00000100:00100000:1.0:1787560658.072727:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560658.072886:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853351168 00000100:00100000:3.0:1787560658.072899:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853351168 00000100:00100000:3.0:1787560658.072984:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:3.0:1787560658.072997:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4051c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+66:12474:x1874392853351168:12345-192.168.203.29@tcp:103:lfs.0 00010000:00010000:3.0:1787560658.073015:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560658.073047:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34b83 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff69 expref: 66 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.073078:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:3.0:1787560658.073084:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560658.073161:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4051c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+65:12474:x1874392853351168:12345-192.168.203.29@tcp:103:lfs.0 Request processed in 166us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560658.073170:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:3.0:1787560658.075393:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560658.075536:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853351296 00000100:00100000:2.0:1787560658.075548:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853351296 00000100:00100000:2.0:1787560658.075636:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 230 00000100:00100000:2.0:1787560658.075650:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+65:12474:x1874392853351296:12345-192.168.203.29@tcp:58:lfs.0 00010000:00010000:2.0:1787560658.075814:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34c40 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.075837:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34c40 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.075851:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34c40 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787560658.075980:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1787560658.076076:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+65:12474:x1874392853351296:12345-192.168.203.29@tcp:58:lfs.0 Request processed in 429us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560658.076084:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 230 00000100:00100000:0.0:1787560658.078826:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560658.078931:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853351424 00000100:00100000:2.0:1787560658.078943:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853351424 00000100:00100000:2.0:1787560658.079014:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 231 00000100:00100000:2.0:1787560658.079027:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+65:12474:x1874392853351424:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1787560658.079053:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560658.079093:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34c47 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ffa1 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.079161:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34c40 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.079174:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34c47 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffa1 expref: 66 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.079219:0:6500:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34c40 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.079236:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34c47 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffa1 expref: 66 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.079252:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:2.0:1787560658.079255:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787560658.079258:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34c47 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffa1 expref: 66 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.079267:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2169400, rc 0) 00000100:00100000:2.0:1787560658.079336:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+66:12474:x1874392853351424:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 312us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560658.079344:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 231 00000040:00080000:1.0:1787560658.099846:0:13775:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787560658.099860:0:13775:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787560658.099896:0:13775:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1787560658.099906:0:13775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787560658.100082:0:13775:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4051180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13775:1874392862836224:192.168.203.29@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787560658.100263:0:13775:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc8af83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560658.105185:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560658.105277:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853351552 00000100:00100000:3.0:1787560658.105289:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853351552 00000100:00100000:3.0:1787560658.105381:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 232 00000100:00100000:3.0:1787560658.105394:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3149850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+67:12475:x1874392853351552:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787560658.105477:0:6498:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787560658.105618:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3149850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+67:12475:x1874392853351552:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 Request processed in 226us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560658.105627:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 232 00000100:00100000:1.0:1787560658.111368:0:13775:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4051180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13775:1874392862836224:192.168.203.29@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787560658.113670:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560658.116041:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853351680 00000100:00100000:3.0:1787560658.116134:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853351680 00000100:00100000:0.0:1787560658.116465:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 233 00000100:00100000:0.0:1787560658.116629:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3be9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+66:12475:x1874392853351680:12345-192.168.203.29@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787560658.116811:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34c4e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.116832:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34c4e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.116845:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34c4e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.116865:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34c55 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.116945:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34c55 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.116978:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34c55 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.117009:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34c5c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.117019:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34c5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.117026:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34c5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560658.117158:0:13787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787560658.117164:0:13787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787560658.117181:0:13787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34c5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.117195:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34c4e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.117202:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34c4e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.117209:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34c4e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.117216:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881a00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560658.117221:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34c4e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.117229:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34c4e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.117306:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9caec3207900) 00010000:00010000:0.0:1787560658.117309:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560658.117315:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34c4e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.117323:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34c4e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.117341:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34c55 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.117347:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34c55 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.117352:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34c55 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.117357:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560658.117361:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34c55 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.117367:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34c55 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.117376:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9caec2028f00) 00010000:00010000:0.0:1787560658.117378:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560658.117381:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34c55 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.117387:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34c55 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.117415:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34c5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.117422:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34c5c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.117428:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34c5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.117605:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560658.117609:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34c5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.117615:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34c5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.117623:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:0.0:1787560658.117626:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560658.117628:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34c5c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.117635:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34c5c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560658.117868:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3be9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+66:12475:x1874392853351680:12345-192.168.203.29@tcp:34:lhsmtool_posix.0 Request processed in 1244us (4207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560658.117879:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 233 00000100:00100000:0.0:1787560658.120978:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560658.121193:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853351936 00000100:00100000:1.0:1787560658.121213:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853351936 00000100:00100000:1.0:1787560658.121345:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 234 00000100:00100000:1.0:1787560658.121359:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+66:12475:x1874392853351936:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787560658.121386:0:10172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560658.121415:0:10172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffc00/0x4642c20bf2f34c63 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ffa8 expref: -99 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.122024:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe600/0x4642c20bf2f34c6a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.122051:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe600/0x4642c20bf2f34c6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.122066:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe600/0x4642c20bf2f34c6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560658.122143:0:10172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787560658.122364:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe600/0x4642c20bf2f34c6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.122374:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe600/0x4642c20bf2f34c6a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.122380:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe600/0x4642c20bf2f34c6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.122386:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021fe600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560658.122392:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe600/0x4642c20bf2f34c6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.122399:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe600/0x4642c20bf2f34c6a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.122414:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:1.0:1787560658.122417:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787560658.122422:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe600/0x4642c20bf2f34c6a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.122608:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe600/0x4642c20bf2f34c6a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.122732:0:10172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffc00/0x4642c20bf2f34c63 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffa8 expref: 68 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.122744:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9caec3207900) 00010000:00010000:1.0:1787560658.122747:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787560658.122751:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffc00/0x4642c20bf2f34c63 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffa8 expref: 68 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.122762:0:10172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb0021ffc00, rc 0) 00000100:00100000:1.0:1787560658.122913:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+67:12475:x1874392853351936:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 1556us (1947us total) trans 4294967506 rc 301/301 00000100:00100000:1.0:1787560658.122923:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 234 00000100:00100000:1.0:1787560658.126517:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560658.127486:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853352064 00000100:00100000:2.0:1787560658.127502:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853352064 00000100:00100000:2.0:1787560658.127583:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 235 00000100:00100000:2.0:1787560658.127595:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+67:12475:x1874392853352064:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787560658.127643:0:6499:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787560658.127823:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+67:12475:x1874392853352064:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 Request processed in 229us (1321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560658.127833:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 235 00000100:00100000:2.0:1787560658.135018:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560658.135387:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853352320 00000100:00100000:0.0:1787560658.135401:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853352320 00000100:00100000:0.0:1787560658.135534:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 236 00000100:00100000:0.0:1787560658.135546:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+67:12475:x1874392853352320:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787560658.135573:0:13787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560658.135819:0:13787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787560658.135856:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169e00/0x4642c20bf2f34c08 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff8c expref: 67 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.135882:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:0.0:1787560658.135888:0:13787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787560658.135905:0:13787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34c78 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ffaf expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787560658.137662:0:13787:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:0.0:1787560658.137898:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34c7f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.137919:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34c7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.137932:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34c7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.138006:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34c78 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffaf expref: 69 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.138028:0:13787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34c7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffaf expref: 68 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.138037:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9caec2028f00) 00010000:00010000:0.0:1787560658.138058:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787560658.138063:0:13787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3880200, rc 0) 00000100:00100000:0.0:1787560658.138152:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+68:12475:x1874392853352320:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 2607us (3149us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1787560658.138162:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 236 00000100:00100000:3.0:1787560658.148943:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560658.149147:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853352576 00000100:00100000:1.0:1787560658.149161:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853352576 00000100:00100000:1.0:1787560658.149285:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 237 00000100:00100000:1.0:1787560658.149299:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec398ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+68:12475:x1874392853352576:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787560658.149381:0:10172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560658.149416:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34c7f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffaf expref: 68 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.149491:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9caec2028f00) 00010000:00010000:1.0:1787560658.149508:0:10172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787560658.149555:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe600/0x4642c20bf2f34c8d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.149571:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe600/0x4642c20bf2f34c8d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.149581:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe600/0x4642c20bf2f34c8d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.149747:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffe00/0x4642c20bf2f34c94 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xf0cfdb0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.149769:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffe00/0x4642c20bf2f34c94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xf0cfdb0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.149791:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffe00/0x4642c20bf2f34c94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xf0cfdb0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.149844:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe600/0x4642c20bf2f34c8d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.149851:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe600/0x4642c20bf2f34c8d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.149859:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe600/0x4642c20bf2f34c8d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.149864:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021fe600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560658.149870:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe600/0x4642c20bf2f34c8d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.149878:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe600/0x4642c20bf2f34c8d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.149909:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:1.0:1787560658.149912:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560658.149916:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe600/0x4642c20bf2f34c8d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.149922:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe600/0x4642c20bf2f34c8d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.149938:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffe00/0x4642c20bf2f34c94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xf0cfdb0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.149944:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffe00/0x4642c20bf2f34c94 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xf0cfdb0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.149950:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffe00/0x4642c20bf2f34c94 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xf0cfdb0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.149955:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ffe00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560658.149958:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffe00/0x4642c20bf2f34c94 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xf0cfdb0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.149964:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffe00/0x4642c20bf2f34c94 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xf0cfdb0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.149971:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xf0cfdb0d (ffff9caec3203200) 00010000:00010000:1.0:1787560658.149973:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560658.149976:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffe00/0x4642c20bf2f34c94 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xf0cfdb0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.149982:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffe00/0x4642c20bf2f34c94 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xf0cfdb0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560658.150112:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec398ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+67:12475:x1874392853352576:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 812us (1179us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787560658.150122:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 237 00000100:00100000:1.0:1787560658.154493:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560658.154587:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853352704 00000100:00100000:0.0:1787560658.154606:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853352704 00000100:00100000:0.0:1787560658.154684:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 238 00000100:00100000:0.0:1787560658.154697:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+67:12475:x1874392853352704:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787560658.154733:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560658.154763:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34c9b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ffb6 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.154817:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34ca2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.154833:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.154845:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.154992:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34c9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffb6 expref: 69 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.155009:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34ca2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffb6 expref: 68 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.155016:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9caec2028000) 00010000:00010000:0.0:1787560658.155024:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787560658.155027:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881a00, rc 0) 00000100:00100000:0.0:1787560658.155100:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+68:12475:x1874392853352704:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 405us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560658.155107:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 238 00000100:00100000:2.0:1787560658.159321:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560658.159544:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853352960 00000100:00100000:0.0:1787560658.159557:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853352960 00000100:00100000:0.0:1787560658.159669:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 239 00000100:00100000:0.0:1787560658.159682:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+68:12475:x1874392853352960:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787560658.159814:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34ca9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.159836:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34ca9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.159850:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34ca9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787560658.160077:0:13787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:0.0:1787560658.160141:0:13787:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009007108c reply state 00000000f97c5eae transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34ca9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.160156:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34ca9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.160165:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9caec2028000) 00010000:00010000:0.0:1787560658.160169:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787560658.160173:0:13787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787560658.160298:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+70:12475:x1874392853352960:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 618us (992us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1787560658.160331:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 239 00000100:00100000:1.0:1787560658.165806:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560658.165957:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853353088 00000100:00100000:2.0:1787560658.165972:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853353088 00000100:00100000:2.0:1787560658.166052:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 240 00000100:00100000:2.0:1787560658.166172:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+70:12475:x1874392853353088:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787560658.166204:0:10172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560658.166232:0:10172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34cb0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ffbd expref: -99 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.166310:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34cb0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffbd expref: 71 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.166327:0:10172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34cb0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffbd expref: 71 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.166351:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9caec2028000) 00010000:00010000:2.0:1787560658.166355:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787560658.166360:0:10172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2169000, rc 0) 00000100:00100000:2.0:1787560658.166477:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+71:12475:x1874392853353088:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 309us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560658.168808:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 240 00000100:00100000:1.0:1787560658.169370:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560658.169466:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853353216 00000100:00100000:3.0:1787560658.169480:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853353216 00000100:00100000:3.0:1787560658.169561:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 70 00000100:00100000:3.0:1787560658.169573:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4050000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+9:2404:x1874392853353216:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787560658.169889:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4050000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+10:2404:x1874392853353216:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 Request processed in 317us (520us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1787560658.169897:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 70 00000100:00080000:0.0:1787560658.169994:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787560658.174035:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560658.174210:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853353472 00000100:00100000:2.0:1787560658.174232:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853353472 00000100:00100000:2.0:1787560658.174312:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 60 00000100:00100000:2.0:1787560658.174324:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+71:12475:x1874392853353472:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787560658.174653:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+72:12475:x1874392853353472:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 330us (633us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1787560658.174697:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 60 00000100:00100000:1.0:1787560658.178171:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560658.178287:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853353728 00000100:00100000:3.0:1787560658.178300:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853353728 00000100:00100000:3.0:1787560658.178423:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 241 00000100:00100000:3.0:1787560658.178838:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+72:12475:x1874392853353728:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787560658.179002:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+72:12475:x1874392853353728:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 569us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560658.179011:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 241 00000100:00100000:1.0:1787560658.184378:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560658.186142:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853353856 00000100:00100000:0.0:1787560658.186160:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853353856 00000100:00100000:0.0:1787560658.186242:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 242 00000100:00100000:0.0:1787560658.186353:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+72:12475:x1874392853353856:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787560658.186380:0:13787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560658.186408:0:13787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34cb7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ffc4 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.186528:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34cbe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.186546:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34cbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.186559:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34cbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560658.186625:0:13787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787560658.186651:0:13787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34cbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.186682:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881800/0x4642c20bf2f34cb7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffc4 expref: 74 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.186703:0:13787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34cbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffc4 expref: 73 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.186736:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9caec2028000) 00010000:00010000:0.0:1787560658.186740:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787560658.186744:0:13787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881600, rc 0) 00000100:00100000:0.0:1787560658.188410:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+73:12475:x1874392853353856:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 2052us (4034us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560658.188424:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 242 00000100:00100000:0.0:1787560658.197624:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560658.197721:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853353984 00000100:00100000:1.0:1787560658.197734:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853353984 00000100:00100000:1.0:1787560658.197818:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 71 00000100:00100000:1.0:1787560658.197831:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+10:2404:x1874392853353984:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787560658.197856:0:8415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560658.197882:0:8415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f4dd5ed/0x4642c20bf2f34cc5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ffcb expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787560658.197916:0:8415:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c02d1, blocks: 0x0 00010000:00010000:1.0:1787560658.197954:0:8415:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=377s v=(0 0) 00010000:00010000:1.0:1787560658.197960:0:8415:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560658.197972:0:8415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f4dd5ed/0x4642c20bf2f34cc5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffcb expref: 11 pid: 8415 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.197993:0:8415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001f4dd5ed/0x4642c20bf2f34cc5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffcb expref: 11 pid: 8415 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.198036:0:8415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb0021ffe00, rc 0) 00000100:00100000:1.0:1787560658.198114:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+11:2404:x1874392853353984:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 286us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560658.198123:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 71 00000100:00100000:1.0:1787560658.200775:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560658.200857:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853354240 00000100:00100000:2.0:1787560658.200870:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853354240 00000100:00100000:2.0:1787560658.200985:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 243 00000100:00100000:2.0:1787560658.200998:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+73:12475:x1874392853354240:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787560658.201189:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+73:12475:x1874392853354240:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 194us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560658.201198:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 243 00000100:00100000:2.0:1787560658.207536:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560658.207687:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853354368 00000100:00100000:1.0:1787560658.207704:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853354368 00000100:00100000:1.0:1787560658.207879:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 72 00000100:00100000:1.0:1787560658.207892:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+11:12475:x1874392853354368:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787560658.207918:0:8414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560658.207941:0:8414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005283323a/0x4642c20bf2f34ccc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ffd2 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.207982:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001f4dd5ed/0x4642c20bf2f34cc5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffcb expref: 12 pid: 8415 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.207991:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560658.207996:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560658.208001:0:8414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005283323a/0x4642c20bf2f34ccc lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffd2 expref: 12 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.208039:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001f4dd5ed/0x4642c20bf2f34cc5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffcb expref: 12 pid: 8415 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.208074:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001f4dd5ed/0x4642c20bf2f34cc5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffcb expref: 12 pid: 8415 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560658.208090:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4051500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8414:1874392862836352:192.168.203.29@tcp:104: 00000100:00100000:1.0:1787560658.208231:0:8414:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc8af83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560658.212565:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4051500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8414:1874392862836352:192.168.203.29@tcp:104: 00010000:00010000:1.0:1787560658.212616:0:8414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005283323a/0x4642c20bf2f34ccc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffd2 expref: 12 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.212643:0:8414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb0021fe000, rc 0) 00000100:00100000:1.0:1787560658.212729:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+12:12475:x1874392853354368:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 4839us (5218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560658.212739:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 72 00000100:00100000:2.0:1787560658.213814:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560658.214030:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853354496 00000100:00100000:0.0:1787560658.214041:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853354496 00010000:00010000:0.0:1787560658.214088:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001f4dd5ed/0x4642c20bf2f34cc5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffcb expref: 12 pid: 8415 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560658.214133:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 103 00000100:00100000:0.0:1787560658.214144:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3beb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+12:2405:x1874392853354496:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787560658.214161:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560658.214187:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001f4dd5ed/0x4642c20bf2f34cc5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffcb expref: 12 pid: 8415 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.214202:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001f4dd5ed/0x4642c20bf2f34cc5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffcb expref: 12 pid: 8415 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.214230:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f4dd5ed/0x4642c20bf2f34cc5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffcb expref: 12 pid: 8415 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.214678:0:6486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560658.214684:0:6486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560658.214694:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005283323a/0x4642c20bf2f34ccc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffd2 expref: 11 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.214707:0:6486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005283323a/0x4642c20bf2f34ccc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffd2 expref: 11 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.214753:0:6486:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005283323a/0x4642c20bf2f34ccc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffd2 expref: 11 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560658.214776:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6486:1874392862836480:192.168.203.29@tcp:105: 00000100:00100000:0.0:1787560658.214926:0:6486:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec31ec900 going to sleep for 11 seconds 00000100:00100000:2.0:1787560658.218949:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560658.219044:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853354624 00000100:00100000:1.0:1787560658.219067:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853354624 00002000:00100000:1.0:1787560658.219130:0:8420:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9caec3be8700 x1874392853354624/t0(0) o4->9331bacf-6cfc-4379-8649-925e79b19df1@192.168.203.29@tcp:19/0 lens 504/0 e 0 to 0 dl 1787560669 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787560658.219144:0:8420:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9caec3be8700 with x1874392853354624 ext(0->12) 00002000:00010000:1.0:1787560658.219151:0:8420:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9caec3be8700 00000100:00100000:1.0:1787560658.219227:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:1.0:1787560658.219239:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3be8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9331bacf-6cfc-4379-8649-925e79b19df1+12:2404:x1874392853354624:12345-192.168.203.29@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787560658.220883:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3be8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9331bacf-6cfc-4379-8649-925e79b19df1+14:2404:x1874392853354624:12345-192.168.203.29@tcp:4:lhsmtool_posix.0 Request processed in 1633us (1936us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1787560658.220912:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 6 00002000:00100000:1.0:1787560658.220924:0:8420:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9caec3be8700 x1874392853354624/t4294967321(0) o4->9331bacf-6cfc-4379-8649-925e79b19df1@192.168.203.29@tcp:19/0 lens 504/448 e 0 to 0 dl 1787560669 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787560658.220934:0:8420:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9caec3be8700 with x1874392853354624 ext(0->12) 00002000:00010000:1.0:1787560658.220941:0:8420:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9caec3be8700 00000100:00100000:0.0:1787560658.221042:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6486:1874392862836480:192.168.203.29@tcp:105: 00010000:00010000:0.0:1787560658.221717:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560658.221762:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3beb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+13:2405:x1874392853354496:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 7617us (7951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560658.221774:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 103 00000100:00100000:2.0:1787560658.225637:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560658.225979:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853354752 00000100:00100000:3.0:1787560658.225992:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853354752 00000100:00100000:3.0:1787560658.226090:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 244 00000100:00100000:3.0:1787560658.226103:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+73:12475:x1874392853354752:12345-192.168.203.29@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787560658.232036:0:6478:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000004:00080000:2.0:1787560658.232090:0:6478:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:2.0:1787560658.232120:0:6478:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9caec22aa240 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1787560658.232127:0:6478:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cafc8744200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9caec22aa900 00000020:00080000:2.0:1787560658.232130:0:6478:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cafc8744900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9caec40d6200 00000004:00080000:2.0:1787560658.232163:0:6478:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:2.0:1787560658.232202:0:6478:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cafc12ed900 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1787560658.232207:0:6478:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cafc8744b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cafc12ed6c0 00000020:00080000:2.0:1787560658.232209:0:6478:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cafc8744600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9caec22d8600 00000020:00080000:1.0:1787560658.232969:0:6530:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1787560658.233061:0:6530:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787560658.233401:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+27:12475:x1874392853354752:12345-192.168.203.29@tcp:44:lhsmtool_posix.0 Request processed in 7294us (7770us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560658.233414:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 244 00000100:00100000:1.0:1787560658.233882:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787560658.233905:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec398a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862836608:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787560658.233973:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560658.234136:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862836608 00000100:00100000:3.0:1787560658.234145:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862836608 00000100:00100000:3.0:1787560658.234244:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787560658.234264:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4051500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3623:x1874392862836608:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787560658.234301:0:8415:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:3.0:1787560658.234343:0:8415:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a8c02d1, atime: 0x6a8c02d1, ctime: 0x6a8c02d1, blocks: 0x8 00010000:00010000:3.0:1787560658.234352:0:8415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057ff37d3/0x4642c20bf2f34cd3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.234372:0:8415:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=377s v=(0 0) 00010000:00010000:3.0:1787560658.234376:0:8415:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560658.234384:0:8415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057ff37d3/0x4642c20bf2f34cd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.234399:0:8415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057ff37d3/0x4642c20bf2f34cd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.234410:0:8415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057ff37d3/0x4642c20bf2f34cd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.234419:0:8415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057ff37d3/0x4642c20bf2f34cd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.234484:0:8415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787560658.234665:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4051500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3623:x1874392862836608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 401us (689us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787560658.234672:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:0.0:1787560658.235023:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f349d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235033:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f349d1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235040:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f349d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235055:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021fe800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560658.235060:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f349d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235068:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f349d1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235085:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9cafef7d0c00) 00010000:00010000:0.0:1787560658.235088:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560658.235092:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f349d1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235098:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f349d1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235130:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34a79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235137:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34a79 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235142:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34a79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235147:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560658.235149:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34a79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235154:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34a79 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235174:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cafc5393800) 00010000:00010000:0.0:1787560658.235176:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560658.235180:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34a79 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235186:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7800/0x4642c20bf2f34a79 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235204:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34af7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235211:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34af7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235217:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34af7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235222:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880000 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560658.235226:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34af7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235231:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34af7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235238:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cafc5393a00) 00010000:00010000:0.0:1787560658.235241:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560658.235244:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34af7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235261:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880000/0x4642c20bf2f34af7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235299:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34b1a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235307:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34b1a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235313:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34b1a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235319:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169a00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560658.235321:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34b1a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235326:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34b1a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235333:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cafc5393a00) 00010000:00010000:0.0:1787560658.235335:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560658.235338:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34b1a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235343:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34b1a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235357:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f34bec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235363:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f34bec lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235368:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f34bec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235378:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafc0030400 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560658.235381:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f34bec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235386:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f34bec lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235395:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:0.0:1787560658.235397:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560658.235400:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f34bec lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235405:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f34bec lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235419:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34ca9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235424:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34ca9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235469:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34ca9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235475:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881c00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560658.235477:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34ca9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235483:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34ca9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235503:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9caec2028000) 00010000:00010000:0.0:1787560658.235505:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787560658.235509:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34ca9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.235515:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34ca9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560658.235620:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787560658.235635:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862836736:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787560658.236211:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787560658.236338:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560658.236348:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057ff37d3/0x4642c20bf2f34cd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.236374:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb002176600 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:2.0:1787560658.236378:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057ff37d3/0x4642c20bf2f34cd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.236388:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057ff37d3/0x4642c20bf2f34cd3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.236405:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057ff37d3/0x4642c20bf2f34cd3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.236412:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057ff37d3/0x4642c20bf2f34cd3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.236454:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560658.236456:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560658.236458:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560658.236892:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862836736 00000100:00100000:1.0:1787560658.236902:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862836736 00000100:00100000:1.0:1787560658.236975:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787560658.236987:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3626:x1874392862836736:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787560658.237019:0:8412:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:1.0:1787560658.237045:0:8412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f34cda lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.237076:0:8412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000783c6363/0x4642c20bf2f34a87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff2a expref: 12 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.237085:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787560658.237090:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787560658.237094:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f34cda lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.237144:0:8412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000783c6363/0x4642c20bf2f34a87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff2a expref: 12 pid: 10171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.237159:0:8412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000783c6363/0x4642c20bf2f34a87 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff2a expref: 12 pid: 10171 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560658.237175:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4053b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8412:1874392862836864:192.168.203.29@tcp:104: 00000100:00100000:1.0:1787560658.237606:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc8af83c0 going to sleep for 11 seconds 00000004:00080000:1.0:1787560658.237667:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9caec398a300/2, rc 0, transno 4294967311 00000100:00100000:1.0:1787560658.237675:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec398a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862836608:0@lo:6:osp-syn-0-0.0 00000100:00080000:0.0:1787560658.240124:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787560658.241532:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560658.241622:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853354880 00000100:00100000:3.0:1787560658.241635:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853354880 00000100:00100000:3.0:1787560658.241705:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 75 00000100:00100000:1.0:1787560658.241807:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4053b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8412:1874392862836864:192.168.203.29@tcp:104: 00000100:00100000:3.0:1787560658.241836:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3be8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+13:2405:x1874392853354880:12345-192.168.203.29@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1787560658.241845:0:8412:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f34cda lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560658.242645:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560658.242744:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853355008 00000100:00100000:2.0:1787560658.242751:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853355008 00010000:00010000:2.0:1787560658.242801:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000783c6363/0x4642c20bf2f34a87 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff2a expref: 14 pid: 10171 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560658.242871:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 104 00000100:00100000:2.0:1787560658.242882:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4053b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+14:2404:x1874392853355008:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560658.242896:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560658.242911:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000783c6363/0x4642c20bf2f34a87 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff2a expref: 14 pid: 10171 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.242928:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000783c6363/0x4642c20bf2f34a87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff2a expref: 14 pid: 10171 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.242955:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000783c6363/0x4642c20bf2f34a87 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff2a expref: 14 pid: 10171 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.242973:0:6485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787560658.242979:0:6485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787560658.242986:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f34cda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.242998:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f34cda lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.243041:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560658.243104:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4053b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+13:2404:x1874392853355008:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 224us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560658.243113:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 104 00010000:00010000:0.0:1787560658.243416:0:8412:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f34cda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.243448:0:8412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f34cda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.243460:0:8412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f34cda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.243468:0:8412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f34cda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.243497:0:8412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787560658.243751:0:9500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560658.243759:0:9500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f34cda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.243769:0:9500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ff400 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560658.243774:0:9500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f34cda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.243809:0:9500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f34cda lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.243825:0:9500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f34cda lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.243834:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f34cda lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.243866:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560658.243868:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560658.243871:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787560658.244099:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9caec407e300/2, rc 0, transno 4294967322 00000100:00100000:1.0:1787560658.244118:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862836736:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787560658.244136:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3626:x1874392862836736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7149us (7922us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1787560658.244157:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000001:00080000:2.0:1787560658.247656:0:9491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:2.0:1787560658.247686:0:9491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000100:00100000:3.0:1787560658.248634:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3be8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+7:2405:x1874392853354880:12345-192.168.203.29@tcp:16:lhsmtool_posix.0 Request processed in 6794us (7103us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560658.248649:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 75 00000100:00100000:1.0:1787560658.252817:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560658.253105:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853355264 00000100:00100000:0.0:1787560658.253118:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853355264 00000100:00100000:0.0:1787560658.253198:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 245 00000100:00100000:0.0:1787560658.253211:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+21:12475:x1874392853355264:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787560658.253284:0:13787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560658.253320:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34cbe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffc4 expref: 21 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.253342:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9caec2028000) 00010000:00010000:0.0:1787560658.253347:0:13787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787560658.253387:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34ce1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.253402:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.253412:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787560658.253902:0:13787:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f00b40a3 reply state 00000000b970318e transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.253918:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34ce1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.253925:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9caec2028000) 00010000:00010000:0.0:1787560658.253927:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787560658.253930:0:13787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787560658.254077:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+22:12475:x1874392853355264:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 868us (1274us total) trans 4294967510 rc 0/0 00000100:00100000:0.0:1787560658.254085:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 245 00000100:00100000:1.0:1787560658.258216:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560658.258401:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853355392 00000100:00100000:2.0:1787560658.258417:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853355392 00000100:00100000:2.0:1787560658.260460:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 76 00000100:00100000:2.0:1787560658.260494:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4052300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+7:2404:x1874392853355392:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787560658.260727:0:10171:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787560658.260731:0:10171:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1787560657 00002000:00010000:2.0:1787560658.260734:0:10171:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1787560657 00002000:00010000:2.0:1787560658.260736:0:10171:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1787560657 -> 1787560657 00002000:00010000:2.0:1787560658.260738:0:10171:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787560658.260838:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4052300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+8:2404:x1874392853355392:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 Request processed in 362us (2637us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1787560658.260848:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 76 00000100:00100000:1.0:1787560658.268534:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560658.268725:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853355648 00000100:00100000:2.0:1787560658.268739:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853355648 00000100:00100000:2.0:1787560658.268826:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 246 00000100:00100000:2.0:1787560658.268839:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+22:12475:x1874392853355648:12345-192.168.203.29@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787560658.268932:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f34ce8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.268953:0:10172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34ca2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffb6 expref: 22 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.268964:0:10172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f34ce8 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.269010:0:10172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34ca2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffb6 expref: 22 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.269027:0:10172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34ca2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffb6 expref: 22 pid: 6500 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560658.269067:0:10172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10172:1874392862836992:192.168.203.29@tcp:104: 00000100:00100000:2.0:1787560658.271043:0:10172:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe0a65780 going to sleep for 11 seconds 00000100:00100000:2.0:1787560658.276876:0:10172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10172:1874392862836992:192.168.203.29@tcp:104: 00010000:00010000:2.0:1787560658.276918:0:10172:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f34ce8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560658.277188:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560658.277344:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853355776 00000100:00100000:3.0:1787560658.277353:0:9502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853355776 00010000:00010000:3.0:1787560658.277493:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34ca2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffb6 expref: 23 pid: 6500 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560658.277533:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 105 00000100:00100000:3.0:1787560658.277546:0:9502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+23:2405:x1874392853355776:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560658.277575:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560658.277584:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34ca2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffb6 expref: 23 pid: 6500 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.277599:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34ca2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffb6 expref: 23 pid: 6500 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.277649:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34ca2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffb6 expref: 23 pid: 6500 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.277669:0:9502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9caec2028000) 00010000:00010000:3.0:1787560658.277675:0:9502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f34ce8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.277686:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f34ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.277694:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f34ce8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.277727:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560658.277798:0:9502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+22:2405:x1874392853355776:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 253us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560658.277806:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 105 00010000:00010000:2.0:1787560658.278093:0:10172:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f34ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.278101:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f34ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.278153:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f34ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.278161:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f34ce8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.278169:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f34ce8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.278176:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168e00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560658.278182:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f34ce8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.278190:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f34ce8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.278202:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9caec2028000) 00010000:00010000:2.0:1787560658.278214:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787560658.278219:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f34ce8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.278226:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f34ce8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560658.278285:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+21:12475:x1874392853355648:12345-192.168.203.29@tcp:55:lhsmtool_posix.0 Request processed in 9447us (9765us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787560658.278295:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 246 00000100:00100000:1.0:1787560658.281319:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560658.281421:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853355904 00000100:00100000:0.0:1787560658.281489:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853355904 00000100:00100000:0.0:1787560658.281568:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 77 00000100:00100000:0.0:1787560658.281582:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeabaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+8:2402:x1874392853355904:12345-192.168.203.29@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787560658.281642:0:8412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000053dce82c/0x4642c20bf2f34cef lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.281668:0:8412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005283323a/0x4642c20bf2f34ccc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffd2 expref: 8 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.281678:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560658.281683:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787560658.281688:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053dce82c/0x4642c20bf2f34cef lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.281732:0:8412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005283323a/0x4642c20bf2f34ccc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffd2 expref: 8 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.281748:0:8412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005283323a/0x4642c20bf2f34ccc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffd2 expref: 8 pid: 8414 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560658.281764:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8412:1874392862837120:192.168.203.29@tcp:104: 00000100:00100000:0.0:1787560658.281879:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec31ec000 going to sleep for 11 seconds 00000100:00100000:1.0:1787560658.284502:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560658.284568:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853356032 00000100:00100000:2.0:1787560658.284586:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853356032 00010000:00010000:2.0:1787560658.284645:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005283323a/0x4642c20bf2f34ccc lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffd2 expref: 9 pid: 8414 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560658.284702:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 106 00000100:00100000:2.0:1787560658.284712:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+9:2404:x1874392853356032:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560658.284729:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560658.284757:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005283323a/0x4642c20bf2f34ccc lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffd2 expref: 9 pid: 8414 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.284772:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005283323a/0x4642c20bf2f34ccc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffd2 expref: 9 pid: 8414 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.284813:0:6484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787560658.284819:0:6484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787560658.284827:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000053dce82c/0x4642c20bf2f34cef lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.284862:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053dce82c/0x4642c20bf2f34cef lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.284888:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560658.284960:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9331bacf-6cfc-4379-8649-925e79b19df1+9:2404:x1874392853356032:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 249us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560658.284968:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 106 00010000:00010000:0.0:1787560658.285321:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005283323a/0x4642c20bf2f34ccc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffd2 expref: 8 pid: 8414 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560658.285348:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8412:1874392862837120:192.168.203.29@tcp:104: 00010000:00010000:0.0:1787560658.285374:0:8412:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000053dce82c/0x4642c20bf2f34cef lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.285384:0:8412:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000053dce82c/0x4642c20bf2f34cef lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.285391:0:8412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053dce82c/0x4642c20bf2f34cef lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.285415:0:8412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000053dce82c/0x4642c20bf2f34cef lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.285423:0:8412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053dce82c/0x4642c20bf2f34cef lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.285629:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053dce82c/0x4642c20bf2f34cef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.285638:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881600 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560658.285643:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053dce82c/0x4642c20bf2f34cef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.285652:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053dce82c/0x4642c20bf2f34cef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.285676:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053dce82c/0x4642c20bf2f34cef lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.285684:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053dce82c/0x4642c20bf2f34cef lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560658.285823:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeabaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+7:2402:x1874392853355904:12345-192.168.203.29@tcp:1:lhsmtool_posix.0 Request processed in 4242us (4510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560658.285834:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 77 00000100:00100000:1.0:1787560658.293920:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560658.294012:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853356288 00000100:00100000:3.0:1787560658.294029:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853356288 00000100:00100000:3.0:1787560658.294115:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 247 00000100:00100000:3.0:1787560658.294127:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeababb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+21:12475:x1874392853356288:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787560658.294206:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34cf6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.294225:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f34be5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff7e expref: 21 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.294236:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34cf6 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.294289:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f34be5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff7e expref: 21 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.294303:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f34be5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff7e expref: 21 pid: 6499 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560658.294318:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec398b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6498:1874392862837248:192.168.203.29@tcp:104: 00000100:00100000:3.0:1787560658.294413:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec22aae40 going to sleep for 11 seconds 00000100:00100000:3.0:1787560658.300267:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec398b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6498:1874392862837248:192.168.203.29@tcp:104: 00010000:00010000:3.0:1787560658.300306:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34cf6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560658.301236:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560658.301590:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853356416 00000100:00100000:3.0:1787560658.301600:0:9502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853356416 00010000:00010000:3.0:1787560658.301643:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f34be5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff7e expref: 22 pid: 6499 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560658.301695:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 107 00000100:00100000:3.0:1787560658.301705:0:9502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd7cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+22:2402:x1874392853356416:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560658.301723:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560658.301730:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f34be5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff7e expref: 22 pid: 6499 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.301744:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f34be5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff7e expref: 22 pid: 6499 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.301794:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6800/0x4642c20bf2f34be5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff7e expref: 22 pid: 6499 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.301814:0:9502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:3.0:1787560658.301820:0:9502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34c47 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffa1 expref: 21 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.301831:0:9502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34cf6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.301839:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34cf6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.301845:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34cf6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.301876:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787560658.301921:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34cf6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560658.301937:0:9502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd7cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9331bacf-6cfc-4379-8649-925e79b19df1+21:2402:x1874392853356416:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 230us (705us total) trans 0 rc 0/0 00010000:00010000:0.0:1787560658.301942:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34cf6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560658.301950:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 107 00010000:00010000:0.0:1787560658.302194:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34cfd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.302213:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34cb0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffbd expref: 21 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.302224:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34cfd lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.302270:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34cb0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffbd expref: 21 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.302288:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34cb0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffbd expref: 21 pid: 10172 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560658.302321:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6498:1874392862837376:192.168.203.29@tcp:104: 00000100:00100000:0.0:1787560658.302485:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec31eccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560658.307087:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6498:1874392862837376:192.168.203.29@tcp:104: 00010000:00010000:0.0:1787560658.307143:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34cfd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560658.307346:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560658.307709:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853356544 00000100:00100000:3.0:1787560658.307723:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853356544 00010000:00010000:3.0:1787560658.307768:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34cb0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffbd expref: 22 pid: 10172 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560658.307823:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 108 00000100:00100000:3.0:1787560658.307833:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeabaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+22:2405:x1874392853356544:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560658.307862:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560658.307869:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34cb0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffbd expref: 22 pid: 10172 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.307882:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34cb0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffbd expref: 22 pid: 10172 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.307903:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34cb0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffbd expref: 22 pid: 10172 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.307921:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9caec2028000) 00010000:00010000:3.0:1787560658.307925:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34cfd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.307935:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34cfd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.307943:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34cfd lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.307970:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787560658.308014:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34cfd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560658.308032:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeabaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+21:2405:x1874392853356544:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 199us (686us total) trans 0 rc 0/0 00010000:00010000:0.0:1787560658.308037:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34cfd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560658.308049:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 108 00000001:00080000:0.0:1787560658.308196:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:0.0:1787560658.308347:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:0.0:1787560658.308391:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:0.0:1787560658.308528:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6498:1874392862837504:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787560658.308596:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560658.308637:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec31ec480 going to sleep for 11 seconds 00000100:00100000:3.0:1787560658.308656:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862837504 00000100:00100000:3.0:1787560658.308664:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862837504 00000100:00100000:3.0:1787560658.308773:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787560658.308797:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6498:x1874392862837504:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787560658.308927:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6498:x1874392862837504:12345-0@lo:1000:mdt00_000.0 Request processed in 145us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560658.308945:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787560658.309054:0:6498:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:1.0:1787560658.309061:0:6498:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:1.0:1787560658.309121:0:6498:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9caec407e300 x1874392862836736/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787560674 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560658.309136:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6498:1874392862837504:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787560658.309281:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:1.0:1787560658.309337:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeabab100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6498:1874392862837632:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787560658.309378:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560658.309677:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560658.311488:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862837632 00000100:00100000:0.0:1787560658.311504:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862837632 00000100:00100000:3.0:1787560658.311608:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787560658.311621:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6498:x1874392862837632:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787560658.312411:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6498:x1874392862837632:12345-0@lo:1000:mdt00_000.0 Request processed in 791us (3029us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1787560658.312420:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787560658.312551:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeabab100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6498:1874392862837632:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1787560658.312598:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34cfd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.312609:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34cfd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.312617:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34cfd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.312624:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560658.312629:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34cfd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.312636:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34cfd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.312651:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9caec2028000) 00010000:00010000:1.0:1787560658.312654:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787560658.312658:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34cfd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.312664:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34cfd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.312714:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34c40 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.312719:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34c40 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.312724:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34c40 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.312729:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560658.312732:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34c40 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.312738:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34c40 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.312746:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:1.0:1787560658.312748:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787560658.312753:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34c47 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffa1 expref: 24 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.312763:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34c47 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffa1 expref: 24 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.312770:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34c47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffa1 expref: 24 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.312816:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34c47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffa1 expref: 24 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560658.312841:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeaba9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6498:1874392862837760:192.168.203.29@tcp:105: 00000100:00100000:1.0:1787560658.312912:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560658.318845:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560658.318918:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853356672 00000100:00100000:2.0:1787560658.318934:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853356672 00000100:00100000:3.0:1787560658.318938:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeaba9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6498:1874392862837760:192.168.203.29@tcp:105: 00010000:00010000:3.0:1787560658.318970:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34c40 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.318980:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34c40 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.319086:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f34d04 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.319100:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f34d04 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.319110:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f34d04 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.319121:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f34d04 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.319127:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f34d04 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.319133:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f34d04 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.319152:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb002177800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560658.319156:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f34d04 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.319162:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f34d04 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.319173:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:3.0:1787560658.319176:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560658.319180:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f34d04 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.319185:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f34d04 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.319197:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34cf6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.319202:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34cf6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.319207:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34cf6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.319211:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb002177c00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560658.319215:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34cf6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.319220:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34cf6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.319238:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:3.0:1787560658.319240:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787560658.319243:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34cf6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560658.319249:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34cf6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560658.319536:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeababb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+25:12475:x1874392853356288:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 25410us (25628us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1787560658.319546:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 247 00000020:00080000:3.0:1787560658.319551:0:6498:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787560658.319750:0:13775:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787560658.319755:0:13775:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1787560658.319843:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 61 00000100:00100000:2.0:1787560658.319860:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+24:12474:x1874392853356672:12345-192.168.203.29@tcp:49:lfs.0 00000100:00100000:2.0:1787560658.320006:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+24:12474:x1874392853356672:12345-192.168.203.29@tcp:49:lfs.0 Request processed in 151us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560658.320014:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 61 00000040:00080000:1.0:1787560658.320422:0:13775:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787560658.320462:0:13775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787560658.327579:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560658.327876:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853356928 00000100:00100000:0.0:1787560658.327890:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853356928 00000100:00100000:0.0:1787560658.328005:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 62 00000100:00100000:0.0:1787560658.328018:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd7c05450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+24:12475:x1874392853356928:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787560658.328358:0:6501:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787560658.328397:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:0.0:1787560658.328474:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34d0b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.328517:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34d0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.328532:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34d0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.328544:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34d0b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.328551:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34d0b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.328558:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34d0b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.328666:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787560658.328807:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd7c05450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+26:12475:x1874392853356928:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 787us (1240us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1787560658.328828:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 62 00000020:00080000:1.0:1787560658.328834:0:6501:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787560658.329036:0:6487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560658.329045:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34d0b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.329054:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880c00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560658.329060:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34d0b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.329068:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34d0b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.329085:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9caec2028000) 00010000:00010000:0.0:1787560658.329087:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787560658.329093:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34d0b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.329098:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34d0b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560658.329127:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560658.329129:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560658.329131:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560658.330001:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560658.330157:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853357184 00000100:00100000:3.0:1787560658.330169:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853357184 00000100:00100000:3.0:1787560658.330244:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 248 00000100:00100000:3.0:1787560658.330257:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+26:12474:x1874392853357184:12345-192.168.203.29@tcp:58:lfs.0 00000040:00080000:3.0:1787560658.330491:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1787560658.330596:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+26:12474:x1874392853357184:12345-192.168.203.29@tcp:58:lfs.0 Request processed in 341us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560658.330605:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 248 00000100:00100000:3.0:1787560658.359956:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560658.360727:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853357312 00000100:00100000:2.0:1787560658.360870:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853357312 00000100:00100000:2.0:1787560658.360963:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 249 00000100:00100000:2.0:1787560658.360975:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec398bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+26:12477:x1874392853357312:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1787560658.361016:0:10172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560658.361043:0:10172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f34d12 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ffd9 expref: -99 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.361126:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34d19 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.361164:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34d19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.361178:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34d19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.361196:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34d20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.361204:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34d20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.361211:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34d20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.361315:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34d27 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.361327:0:10172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34c32 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff9a expref: 27 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.363031:0:10172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34d27 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.363109:0:10172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34c32 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff9a expref: 27 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.363131:0:10172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34c32 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff9a expref: 27 pid: 6498 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560658.363170:0:10172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10172:1874392862837888:192.168.203.29@tcp:104: 00000100:00100000:2.0:1787560658.363301:0:10172:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe0a65780 going to sleep for 11 seconds 00000100:00100000:2.0:1787560658.369989:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560658.370224:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853357568 00000100:00100000:3.0:1787560658.370237:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853357568 00000100:00100000:3.0:1787560658.370414:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 63 00000100:00100000:3.0:1787560658.370427:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3be9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+28:6644:x1874392853357568:12345-192.168.203.29@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787560658.370856:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3be9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+29:6644:x1874392853357568:12345-192.168.203.29@tcp:35:ldlm_bl.0 Request processed in 431us (881us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1787560658.370885:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 63 00000100:00100000:1.0:1787560658.371006:0:10172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10172:1874392862837888:192.168.203.29@tcp:104: 00010000:00010000:1.0:1787560658.371039:0:10172:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34d27 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560658.385010:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560658.385232:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853357696 00000100:00100000:2.0:1787560658.385370:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853357696 00010000:00010000:2.0:1787560658.385427:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34c32 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff9a expref: 29 pid: 6498 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560658.385617:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 109 00000100:00100000:2.0:1787560658.385630:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+29:2405:x1874392853357696:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560658.385652:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560658.385661:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34c32 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff9a expref: 29 pid: 6498 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.385676:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34c32 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff9a expref: 29 pid: 6498 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.385702:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881000/0x4642c20bf2f34c32 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff9a expref: 29 pid: 6498 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.385722:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:2.0:1787560658.385728:0:6486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34d27 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.385739:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34d27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.385769:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34d27 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560658.385880:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560658.385963:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9331bacf-6cfc-4379-8649-925e79b19df1+28:2405:x1874392853357696:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 335us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560658.385971:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 109 00010000:00010000:1.0:1787560658.386820:0:10172:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34d27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.386834:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34d27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560658.386902:0:10172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787560658.386907:0:10172:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787560658.386932:0:10172:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34d27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.386950:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34d27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.386975:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34d19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.386982:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34d19 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.386991:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34d19 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.386998:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560658.387003:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34d19 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.387010:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34d19 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.387024:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:1.0:1787560658.387027:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560658.387031:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34d19 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.387037:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34d19 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.387052:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34d20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.387058:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34d20 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.387065:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34d20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.387076:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169000 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560658.387080:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34d20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.387086:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34d20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.387095:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cafef7ce400) 00010000:00010000:1.0:1787560658.387097:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560658.387100:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34d20 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.387107:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34d20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.387152:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168e00/0x4642c20bf2f34d12 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffd9 expref: 28 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.387167:0:10172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34d27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffd9 expref: 27 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560658.387253:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:1.0:1787560658.387256:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787560658.387258:0:10172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2169a00, rc 0) 00000100:00100000:1.0:1787560658.387379:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec398bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+27:12477:x1874392853357312:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 26404us (27431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560658.387389:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 249 00000100:00100000:1.0:1787560658.483911:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862838016:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787560658.484040:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560658.484283:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787560658.484303:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862838144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787560658.484344:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560658.484381:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862838016 00000100:00100000:0.0:1787560658.484390:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862838016 00000100:00100000:0.0:1787560658.484497:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862838144 00000100:00100000:0.0:1787560658.484500:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862838144 00000100:00100000:0.0:1787560658.484523:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787560658.484535:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862838016:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787560658.485383:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787560658.485398:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafefc4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3624:x1874392862838144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787560658.485649:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00002000:00000024:2.0:1787560658.485893:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560658.485941:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafefc4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3624:x1874392862838144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 548us (1596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560658.485950:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:2.0:1787560658.485984:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560658.486499:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862838016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1965us (2460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560658.486508:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787560658.486802:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862838144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787560658.500839:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862838016:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787560658.931659:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787560659.211827:0:14739:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787560659.211839:0:14739:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787560659.211874:0:14739:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787560659.211885:0:14739:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787560659.385772:0:13775:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787560659.386831:0:13775:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787560659.386903:0:13775:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787560659.386911:0:13775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787560659.387119:0:13775:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec398b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13775:1874392862838272:192.168.203.29@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787560659.387248:0:13775:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec22aa000 going to sleep for 11 seconds 00000100:00100000:1.0:1787560659.396646:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560659.396713:0:13775:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec398b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13775:1874392862838272:192.168.203.29@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787560659.398738:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853357824 00000100:00100000:3.0:1787560659.398757:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853357824 00000100:00100000:3.0:1787560659.398848:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 250 00000100:00100000:3.0:1787560659.398861:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+27:12489:x1874392853357824:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787560659.398910:0:6498:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787560659.402519:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+27:12489:x1874392853357824:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 Request processed in 3640us (5928us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560659.402538:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 250 00000100:00100000:1.0:1787560659.415128:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560659.415208:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853358080 00000100:00100000:0.0:1787560659.415222:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853358080 00000100:00100000:0.0:1787560659.415304:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 251 00000100:00100000:0.0:1787560659.415318:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+27:12489:x1874392853358080:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787560659.415345:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560659.415371:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34d2e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ffe0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560659.415548:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34d35 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560659.415565:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34d35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560659.415578:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34d35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560659.415591:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787560659.415719:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881600/0x4642c20bf2f34d2e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffe0 expref: 30 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560659.415737:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34d35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffe0 expref: 29 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560659.415747:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:0.0:1787560659.415750:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787560659.415755:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3880c00, rc 0) 00000100:00100000:0.0:1787560659.416191:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+29:12489:x1874392853358080:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 874us (1074us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1787560659.416200:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 251 00000100:00100000:3.0:1787560659.427318:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560659.427561:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853358208 00000100:00100000:2.0:1787560659.427575:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853358208 00000100:00100000:2.0:1787560659.427714:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:2.0:1787560659.427728:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3989500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+29:2402:x1874392853358208:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560659.427747:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560659.427787:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f34d35 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffe0 expref: 29 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560659.427826:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:2.0:1787560659.427832:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560659.427905:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3989500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9331bacf-6cfc-4379-8649-925e79b19df1+28:2402:x1874392853358208:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 179us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560659.427914:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:3.0:1787560659.428545:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560659.428917:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853358464 00000100:00100000:0.0:1787560659.428925:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853358464 00000100:00100000:0.0:1787560659.428982:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 252 00000100:00100000:0.0:1787560659.428993:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+28:12489:x1874392853358464:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787560659.429084:0:10172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34d43 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560659.429187:0:10172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34d43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560659.429345:0:10172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34d43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560659.429560:0:10172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34d43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560659.429568:0:10172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34d43 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560659.429575:0:10172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34d43 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560659.429582:0:10172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881a00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560659.429587:0:10172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34d43 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560659.429595:0:10172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34d43 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560659.429609:0:10172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:0.0:1787560659.429612:0:10172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787560659.430072:0:10172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34d43 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560659.430080:0:10172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881a00/0x4642c20bf2f34d43 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10172 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560659.430391:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+29:12489:x1874392853358464:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 1396us (1844us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1787560659.430414:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 252 00000040:00080000:1.0:1787560659.430810:0:13775:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787560659.430817:0:13775:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787560659.431941:0:13775:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787560659.431961:0:13775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787560659.432541:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560659.432591:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853358720 00000100:00100000:2.0:1787560659.432605:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853358720 00000100:00100000:2.0:1787560659.432676:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 64 00000100:00100000:2.0:1787560659.432689:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+29:12489:x1874392853358720:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787560659.432966:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+30:12489:x1874392853358720:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 279us (431us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1787560659.432974:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 64 00000004:00080000:0.0:1787560659.507841:0:9935:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 378847404943ns, next at 379847400391ns, rc = 0 00000100:00100000:0.0:1787560659.507893:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862838400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787560659.507996:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560659.508132:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862838400 00000100:00100000:0.0:1787560659.508132:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3beb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862838528:0@lo:400:kworker.0 00000100:00100000:3.0:1787560659.508146:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862838400 00000100:00100000:0.0:1787560659.508185:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560659.508218:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787560659.508229:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862839040:0@lo:400:kworker.0 00000100:00100000:2.0:1787560659.508230:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862838912:0@lo:400:kworker.0 00000100:00100000:0.0:1787560659.508269:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560659.508285:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560659.508290:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862839552:0@lo:400:kworker.0 00000100:00100000:3.0:1787560659.508299:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3624:x1874392862838400:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560659.508318:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862839424:0@lo:400:kworker.0 00000100:00100000:0.0:1787560659.508327:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1787560659.508335:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1787560659.508353:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787560659.508362:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3beaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862838656:0@lo:400:kworker.0 00000100:00100000:0.0:1787560659.508401:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560659.508403:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3624:x1874392862838400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 171us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560659.508413:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787560659.508423:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862839168:0@lo:400:kworker.0 00000100:00100000:0.0:1787560659.508479:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560659.508493:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862839552 00000100:00100000:3.0:1787560659.508499:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862839552 00000100:00100000:0.0:1787560659.508500:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874392862839680:0@lo:400:kworker.0 00000100:00100000:0.0:1787560659.508526:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560659.508561:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862839040 00000100:00100000:0.0:1787560659.508566:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862839040 00000100:00100000:0.0:1787560659.508601:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787560659.508608:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862839040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560659.508653:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862839040:12345-0@lo:400:kworker.0 Request processed in 46us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560659.508660:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787560659.508691:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862838912 00000100:00100000:0.0:1787560659.508695:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862838912 00000100:00100000:0.0:1787560659.508719:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862838656 00000100:00100000:0.0:1787560659.508723:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862838656 00000100:00100000:0.0:1787560659.508737:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862839168 00000100:00100000:0.0:1787560659.508739:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862839168 00000100:00100000:0.0:1787560659.508755:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862839680 00000100:00100000:0.0:1787560659.508757:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862839680 00000100:00100000:0.0:1787560659.508784:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1787560659.508792:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862838912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560659.508826:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862838912:12345-0@lo:400:kworker.0 Request processed in 35us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560659.508832:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1787560659.508846:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1787560659.508852:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862838656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560659.508879:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862838656:12345-0@lo:400:kworker.0 Request processed in 28us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560659.508886:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1787560659.508897:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1787560659.508903:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862839168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560659.508930:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862839168:12345-0@lo:400:kworker.0 Request processed in 28us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560659.508936:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1787560659.508948:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1787560659.508955:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874392862839680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560659.508983:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874392862839680:12345-0@lo:400:kworker.0 Request processed in 29us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560659.508999:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1787560659.509019:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862838784:0@lo:400:kworker.0 00000100:00100000:0.0:1787560659.509050:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560659.509073:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3beb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862839296:0@lo:400:kworker.0 00000100:00100000:3.0:1787560659.509102:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787560659.509102:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560659.509117:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3625:x1874392862839552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560659.509127:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862839808:0@lo:400:kworker.0 00000100:00100000:0.0:1787560659.509164:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560659.509191:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862839296 00000100:00100000:0.0:1787560659.509195:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862839296 00000100:00100000:0.0:1787560659.509217:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862839808 00000100:00100000:0.0:1787560659.509220:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862839808 00000100:00100000:0.0:1787560659.509239:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1787560659.509245:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862839296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560659.509277:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862839296:12345-0@lo:400:kworker.0 Request processed in 32us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560659.509283:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1787560659.509295:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1787560659.509300:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874392862839808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560659.509327:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874392862839808:12345-0@lo:400:kworker.0 Request processed in 27us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560659.509332:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00010000:00080000:0.0:1787560659.509367:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3beb100 x1874392862839296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560659.509384:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3beb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862839296:0@lo:400:kworker.0 00010000:00080000:0.0:1787560659.509398:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3baf100 x1874392862839808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560659.509415:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862839808:0@lo:400:kworker.0 00000100:00100000:3.0:1787560659.509426:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3625:x1874392862839552:12345-0@lo:400:kworker.0 Request processed in 56us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560659.509460:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787560659.509482:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3beaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862838656:0@lo:400:kworker.0 00000100:00100000:3.0:1787560659.509489:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862838784 00000100:00100000:3.0:1787560659.509494:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862838784 00000100:00100000:0.0:1787560659.509498:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862839168:0@lo:400:kworker.0 00000100:00100000:0.0:1787560659.509512:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874392862839680:0@lo:400:kworker.0 00000100:00100000:0.0:1787560659.509526:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862839040:0@lo:400:kworker.0 00000100:00100000:3.0:1787560659.509528:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787560659.509540:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862838784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560659.509543:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862839552:0@lo:400:kworker.0 00000100:00100000:3.0:1787560659.509591:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862838784:12345-0@lo:400:kworker.0 Request processed in 52us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560659.509598:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787560659.509616:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862838784:0@lo:400:kworker.0 00000100:00080000:3.0:1787560659.509640:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787560659.509646:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787560659.509651:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787560659.509940:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787560659.509951:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeaba9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862840064:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787560659.509986:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560659.510032:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862838528 00000100:00100000:1.0:1787560659.510036:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862838528 00000100:00100000:1.0:1787560659.510071:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1787560659.510079:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5802850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3625:x1874392862838528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560659.510113:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5802850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3625:x1874392862838528:12345-0@lo:400:kworker.0 Request processed in 35us (1930us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560659.510120:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1787560659.510901:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862840064 00000100:00100000:3.0:1787560659.510910:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862840064 00000100:00100000:3.0:1787560659.510970:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787560659.510978:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeabab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862840064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787560659.511000:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:3.0:1787560659.511059:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeabab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862840064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560659.511066:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:1.0:1787560659.511203:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787560659.511247:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeaba9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862840064:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560659.512189:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3beb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862838528:0@lo:400:kworker.0 00000100:00100000:2.0:1787560659.512467:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560659.512518:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862839936:0@lo:400:kworker.0 00000100:00100000:2.0:1787560659.512566:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560659.512598:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862839424 00000100:00100000:3.0:1787560659.512607:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862839424 00000100:00100000:2.0:1787560659.512610:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862838400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560659.512644:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862838912:0@lo:400:kworker.0 00000100:00100000:3.0:1787560659.512679:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862839936 00000100:00100000:1.0:1787560659.512822:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787560659.512836:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3baf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862839424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560659.512917:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3baf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862839424:12345-0@lo:400:kworker.0 Request processed in 85us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560659.512930:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862839936 00000100:00100000:1.0:1787560659.512936:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787560659.512953:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787560659.512959:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3badc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862839936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560659.512993:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3badc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862839936:12345-0@lo:400:kworker.0 Request processed in 34us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560659.512999:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787560659.513934:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862839424:0@lo:400:kworker.0 00000100:00100000:2.0:1787560659.513949:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862839936:0@lo:400:kworker.0 00010000:00010000:2.0:1787560659.955664:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560660.979877:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787560661.005644:0:14790:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787560661.005654:0:14790:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787560661.005686:0:14790:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787560661.005697:0:14790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787560661.043581:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787560661.043603:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeaba9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862840192:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787560661.043674:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560661.043739:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862840192 00000100:00100000:1.0:1787560661.043746:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862840192 00000100:00100000:1.0:1787560661.043818:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787560661.043828:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafe0674050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862840192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787560661.043859:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1787560661.043904:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafe0674050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862840192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560661.043911:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787560661.044265:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeaba9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862840192:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787560661.290538:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560661.290726:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853358976 00000100:00100000:0.0:1787560661.290736:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853358976 00000100:00080000:1.0:1787560661.293044:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560661.293587:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 253 00000100:00100000:0.0:1787560661.293611:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3989180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+30:12509:x1874392853358976:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:0.0:1787560661.293637:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560661.293659:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34d4a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ffe7 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560661.293792:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34d51 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560661.293875:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34d51 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560661.293906:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34d51 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560661.293920:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787560661.294027:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880800/0x4642c20bf2f34d4a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffe7 expref: 33 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560661.294047:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34d51 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffe7 expref: 32 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560661.294056:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:0.0:1787560661.294059:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787560661.294063:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3880200, rc 0) 00000100:00100000:0.0:1787560661.294126:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3989180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+32:12509:x1874392853358976:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 527us (3599us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1787560661.294134:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 253 00000100:00100000:0.0:1787560661.297559:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560661.297683:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853359104 00000100:00100000:3.0:1787560661.297692:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853359104 00000100:00100000:3.0:1787560661.297775:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 254 00000100:00100000:3.0:1787560661.297786:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+32:12509:x1874392853359104:12345-192.168.203.29@tcp:54:lfs.0 00010000:00010000:3.0:1787560661.297986:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34d5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560661.298005:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34d5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560661.298016:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34d5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560661.298050:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34d5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560661.298056:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34d5f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560661.298064:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34d5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560661.298069:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb002177c00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560661.298074:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34d5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560661.298102:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34d5f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560661.298115:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:3.0:1787560661.298118:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787560661.298122:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34d5f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560661.298127:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177c00/0x4642c20bf2f34d5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560661.298204:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+32:12509:x1874392853359104:12345-192.168.203.29@tcp:54:lfs.0 Request processed in 419us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560661.298211:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 254 00000100:00100000:1.0:1787560661.424005:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560661.424102:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853359232 00000100:00100000:0.0:1787560661.424111:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853359232 00000100:00100000:0.0:1787560661.424188:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 78 00000100:00100000:0.0:1787560661.424199:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+7:2405:x1874392853359232:12345-192.168.203.29@tcp:101:cat.0 00010000:00010000:0.0:1787560661.424217:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560661.424238:0:8412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7b1ee9b/0x4642c20bf2f34d66 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605ffee expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787560661.424265:0:8412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a8c02d1, atime: 0x6a8c02d1, ctime: 0x6a8c02d1, blocks: 0x8 00010000:00010000:0.0:1787560661.424316:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=380s v=(0 0) 00010000:00010000:0.0:1787560661.424321:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560661.424330:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7b1ee9b/0x4642c20bf2f34d66 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffee expref: 8 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560661.424349:0:8412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b7b1ee9b/0x4642c20bf2f34d66 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffee expref: 8 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560661.424363:0:8412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3880800, rc 0) 00000100:00100000:0.0:1787560661.424466:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+8:2405:x1874392853359232:12345-192.168.203.29@tcp:101:cat.0 Request processed in 234us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560661.424473:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 78 00000100:00080000:1.0:1787560661.426064:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787560661.452537:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560661.452739:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853359360 00000100:00100000:1.0:1787560661.452750:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853359360 00002000:00100000:1.0:1787560661.452827:0:8418:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9caec407f100 x1874392853359360/t0(0) o3->9331bacf-6cfc-4379-8649-925e79b19df1@192.168.203.29@tcp:22/0 lens 488/0 e 0 to 0 dl 1787560672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787560661.452838:0:8418:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9caec407f100 with x1874392853359360 ext(0->4095) 00002000:00010000:1.0:1787560661.452853:0:8418:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9caec407f100 00000100:00100000:1.0:1787560661.452891:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:1.0:1787560661.452902:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9331bacf-6cfc-4379-8649-925e79b19df1+8:2405:x1874392853359360:12345-192.168.203.29@tcp:3:cat.0 00000100:00100000:1.0:1787560661.453066:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9331bacf-6cfc-4379-8649-925e79b19df1+8:2405:x1874392853359360:12345-192.168.203.29@tcp:3:cat.0 Request processed in 166us (538us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787560661.453073:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00002000:00100000:1.0:1787560661.453079:0:8418:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9caec407f100 x1874392853359360/t0(0) o3->9331bacf-6cfc-4379-8649-925e79b19df1@192.168.203.29@tcp:22/0 lens 488/4536 e 0 to 0 dl 1787560672 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787560661.453086:0:8418:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9caec407f100 with x1874392853359360 ext(0->4095) 00002000:00010000:1.0:1787560661.453089:0:8418:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9caec407f100 00010000:00010000:0.0:1787560662.004936:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560662.025506:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560662.025544:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560662.025575:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560662.025708:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853359744 00000100:00100000:3.0:1787560662.025718:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853359744 00000100:00100000:1.0:1787560662.025877:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853359488 00000100:00100000:1.0:1787560662.025882:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853359488 00000100:00100000:1.0:1787560662.025913:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 389 00000100:00100000:1.0:1787560662.025922:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5800c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+13:2405:x1874392853359488:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560662.025990:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5800c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+13:2405:x1874392853359488:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 69us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560662.025997:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 389 00000100:00080000:1.0:1787560662.026031:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787560662.026075:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 328 00000100:00100000:3.0:1787560662.026085:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+5:2405:x1874392853359744:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560662.026118:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9331bacf-6cfc-4379-8649-925e79b19df1+5:2405:x1874392853359744:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 35us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560662.026197:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560662.026269:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560662.026290:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560662.029076:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853360256 00000100:00100000:1.0:1787560662.029094:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853360256 00000100:00100000:1.0:1787560662.029177:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853359616 00000100:00100000:1.0:1787560662.029181:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853359616 00000100:00100000:1.0:1787560662.029205:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 329 00000100:00100000:1.0:1787560662.029214:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2405:x1874392853360256:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560662.029296:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2405:x1874392853360256:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 83us (3099us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560662.029318:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 329 00000100:00100000:1.0:1787560662.029337:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 330 00000100:00100000:1.0:1787560662.029344:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+32:2405:x1874392853359616:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560662.029369:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+32:2405:x1874392853359616:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 26us (3100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560662.029376:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 330 00000100:00080000:1.0:1787560662.029400:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787560662.030578:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560662.030608:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853360128 00000100:00100000:2.0:1787560662.030615:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853360128 00000100:00100000:2.0:1787560662.030674:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 331 00000100:00100000:2.0:1787560662.030684:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2405:x1874392853360128:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560662.030731:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2405:x1874392853360128:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 49us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560662.030738:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 331 00000100:00080000:2.0:1787560662.030986:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560662.031208:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 328 00000100:00100000:0.0:1787560662.032454:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853360000 00000100:00100000:0.0:1787560662.032465:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853360000 00000100:00100000:0.0:1787560662.032525:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853359872 00000100:00100000:0.0:1787560662.032529:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853359872 00000100:00100000:0.0:1787560662.032579:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 132 00000100:00100000:0.0:1787560662.032589:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4aa4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+8:2405:x1874392853360000:12345-192.168.203.29@tcp:400:kworker.0 00000100:00080000:3.0:1787560662.032918:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560662.033072:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4aa4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+8:2405:x1874392853360000:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 482us (7494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560662.033080:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 132 00000100:00100000:0.0:1787560662.033279:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 133 00000100:00100000:0.0:1787560662.033288:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3badf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+7:2405:x1874392853359872:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560662.033323:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3badf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9331bacf-6cfc-4379-8649-925e79b19df1+7:2405:x1874392853359872:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 36us (7032us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560662.033341:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 133 00000100:00100000:2.0:1787560662.068068:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862840320:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787560662.068185:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560662.068494:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862840320 00000100:00100000:1.0:1787560662.068503:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862840320 00000100:00100000:1.0:1787560662.068557:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787560662.068566:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3baea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862840320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787560662.068598:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787560662.068723:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3baea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862840320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 157us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560662.068731:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787560662.069240:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862840320:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1787560662.196233:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787560662.518634:0:13775:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787560662.518647:0:13775:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787560662.518672:0:13775:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787560662.518680:0:13775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787560663.030684:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560663.604330:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560663.604371:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862840448:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787560663.604477:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560663.604541:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeabab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862840576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787560663.604559:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862840448 00000100:00100000:0.0:1787560663.604568:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862840448 00000100:00100000:1.0:1787560663.604574:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560663.604611:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862840576 00000100:00100000:0.0:1787560663.604634:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787560663.604644:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862840448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787560663.604681:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787560663.604730:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862840448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560663.604737:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:0.0:1787560663.604774:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560663.604818:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862840448:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787560663.606480:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862840576 00000100:00100000:1.0:1787560663.606574:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787560663.606585:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3625:x1874392862840576:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787560663.607400:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787560663.608681:0:6478:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000004:00080000:3.0:1787560663.608706:0:6478:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:3.0:1787560663.608754:0:6478:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cafc8af8240 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1787560663.608759:0:6478:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9caffbb84900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cafc8af83c0 00000020:00080000:3.0:1787560663.608778:0:6478:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cafeab96700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9caec40b9800 00000020:00080000:3.0:1787560663.608797:0:6478:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00002000:00000024:1.0:1787560663.609454:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00010000:00010000:2.0:1787560663.609492:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34ce1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560663.609512:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34ce1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560663.609520:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34ce1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560663.609547:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881c00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560663.609552:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34ce1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560663.609561:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34ce1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560663.609574:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3625:x1874392862840576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2982us (4989us total) trans 0 rc 0/0 00010000:00010000:2.0:1787560663.609586:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9caec2028000) 00000100:00100000:1.0:1787560663.609590:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00010000:00010000:2.0:1787560663.609595:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560663.609602:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34ce1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560663.609609:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3881c00/0x4642c20bf2f34ce1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787560663.609638:0:6530:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1787560663.609737:0:6530:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:1.0:1787560663.609773:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec398b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862840704:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787560663.609824:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560663.609927:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeabab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862840576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787560663.610361:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862840704 00000100:00100000:3.0:1787560663.610371:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862840704 00000100:00100000:3.0:1787560663.611233:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787560663.611247:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeabaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3626:x1874392862840704:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787560663.611423:0:8414:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787560663.611427:0:8414:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1787560657 -> 1787560657 00002000:00010000:3.0:1787560663.611448:0:8414:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 1787560657 -> 1787560657 00002000:00010000:3.0:1787560663.611450:0:8414:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1787560657 -> 1787560657 00002000:00010000:3.0:1787560663.611452:0:8414:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1787560663.611534:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeabaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3626:x1874392862840704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 291us (1710us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1787560663.611543:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000001:00080000:2.0:1787560663.613414:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000004:00080000:1.0:1787560663.613426:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9caec398b100/2, rc 0, transno 4294967325 00000001:00080000:2.0:1787560663.613460:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:1.0:1787560663.613476:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec398b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862840704:0@lo:2:osp-syn-1-0.0 00000001:00080000:3.0:1787560663.616498:0:9491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:3.0:1787560663.616521:0:9491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000100:00080000:0.0:1787560663.619890:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787560664.051640:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560664.627944:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787560664.627969:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862840832:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787560664.628036:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560664.628639:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862840832 00000100:00100000:0.0:1787560664.628647:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862840832 00000100:00100000:0.0:1787560664.628694:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787560664.628703:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862840832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787560664.628730:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787560664.628794:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862840832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560664.628801:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:0.0:1787560664.628823:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787560664.628866:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862840832:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787560664.634080:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862841344:0@lo:400:kworker.0 00000100:00100000:3.0:1787560664.634151:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560664.634194:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec398b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862841856:0@lo:400:kworker.0 00000100:00100000:3.0:1787560664.634221:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560664.634238:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862842368:0@lo:400:kworker.0 00000100:00100000:3.0:1787560664.634257:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560664.634281:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787560664.634297:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862840960:0@lo:400:kworker.0 00000100:00100000:3.0:1787560664.634324:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560664.634345:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862841472:0@lo:400:kworker.0 00000100:00100000:3.0:1787560664.634367:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560664.634384:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3989f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862841984:0@lo:400:kworker.0 00000100:00100000:3.0:1787560664.634404:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560664.634428:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862841088:0@lo:400:kworker.0 00000100:00100000:3.0:1787560664.634482:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560664.634500:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec398aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862841600:0@lo:400:kworker.0 00000100:00100000:3.0:1787560664.634519:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560664.634727:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862841856 00000100:00100000:2.0:1787560664.634735:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862841856 00000100:00100000:2.0:1787560664.634787:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862842368 00000100:00100000:2.0:1787560664.634790:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862842368 00000100:00100000:2.0:1787560664.634804:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862841984 00000100:00100000:2.0:1787560664.634806:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862841984 00000100:00100000:2.0:1787560664.634818:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787560664.634827:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4051500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862841856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560664.634879:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4051500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862841856:12345-0@lo:400:kworker.0 Request processed in 53us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560664.634886:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787560664.634910:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787560664.634916:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4052300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3623:x1874392862842368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560664.634946:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4052300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3623:x1874392862842368:12345-0@lo:400:kworker.0 Request processed in 30us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560664.634951:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787560664.634963:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787560664.634969:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4051c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862841984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560664.634994:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4051c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862841984:12345-0@lo:400:kworker.0 Request processed in 26us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560664.635001:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787560664.635052:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4050a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874392862842112:0@lo:400:kworker.0 00000100:00100000:3.0:1787560664.635075:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560664.637265:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787560664.637280:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862841216:0@lo:400:kworker.0 00000100:00100000:3.0:1787560664.637332:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560664.637355:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec398b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862841728:0@lo:400:kworker.0 00000100:00100000:3.0:1787560664.637380:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560664.638272:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862841344 00000100:00100000:2.0:1787560664.638282:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862841344 00000100:00100000:2.0:1787560664.638344:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862841088 00000100:00100000:2.0:1787560664.638348:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862841088 00000100:00100000:2.0:1787560664.638363:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862841600 00000100:00100000:2.0:1787560664.638366:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862841600 00000100:00100000:2.0:1787560664.638392:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862842112 00000100:00100000:2.0:1787560664.638396:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862842112 00000100:00100000:2.0:1787560664.638415:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1787560664.638424:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862841344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560664.638522:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862841344:12345-0@lo:400:kworker.0 Request processed in 98us (4370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560664.638543:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1787560664.638561:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1787560664.638567:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862841088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560664.638597:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862841088:12345-0@lo:400:kworker.0 Request processed in 31us (4115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560664.638613:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1787560664.638626:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1787560664.638632:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862841600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560664.638661:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862841600:12345-0@lo:400:kworker.0 Request processed in 30us (4141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560664.638666:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1787560664.638678:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1787560664.638683:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874392862842112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560664.638707:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874392862842112:12345-0@lo:400:kworker.0 Request processed in 24us (3632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560664.638713:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1787560664.638772:0:3623:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1787560664.638778:0:3623:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1787560664.638800:0:3623:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9caec398a300, transno 4294967311 00000100:00100000:2.0:1787560664.638814:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3989f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862841984:0@lo:400:kworker.0 00000100:00100000:2.0:1787560664.638828:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862841344:0@lo:400:kworker.0 00000100:00100000:2.0:1787560664.638838:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec398b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862841856:0@lo:400:kworker.0 00000100:00100000:2.0:1787560664.638848:0:3623:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1787560664.638851:0:3623:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9caec407e300, transno 4294967322 00000004:00080000:2.0:1787560664.638860:0:3623:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1787560664.638877:0:3623:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9caec398b100 x1874392862840704/t4294967325(4294967325) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787560679 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560664.638886:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862842368:0@lo:400:kworker.0 00000100:00100000:2.0:1787560664.638908:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787560664.638919:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862842496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560664.638949:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560664.639100:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862842496 00000100:00100000:2.0:1787560664.639105:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862842496 00000100:00100000:2.0:1787560664.639132:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787560664.639139:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1874392862842496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787560664.639155:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787560664.639192:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1874392862842496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560664.639198:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787560664.639235:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862842496:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787560664.639251:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560664.639844:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862840960 00000100:00100000:2.0:1787560664.639850:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862840960 00000100:00100000:2.0:1787560664.639894:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1787560664.639903:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5803850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3623:x1874392862840960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560664.639951:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5803850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3623:x1874392862840960:12345-0@lo:400:kworker.0 Request processed in 50us (5625us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560664.639957:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1787560664.640005:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862840960:0@lo:400:kworker.0 00000100:00100000:3.0:1787560664.640250:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874392862842240:0@lo:400:kworker.0 00000100:00100000:3.0:1787560664.640284:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560664.640313:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862841088:0@lo:400:kworker.0 00000100:00100000:3.0:1787560664.640327:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec398aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862841600:0@lo:400:kworker.0 00000100:00100000:3.0:1787560664.640339:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4050a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874392862842112:0@lo:400:kworker.0 00000100:00100000:3.0:1787560664.640367:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862841472 00000100:00100000:3.0:1787560664.640382:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862841472 00000100:00100000:3.0:1787560664.640412:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862841216 00000100:00100000:3.0:1787560664.640416:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862841216 00000100:00100000:2.0:1787560664.640666:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862841728 00000100:00100000:2.0:1787560664.640671:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862841728 00000100:00100000:2.0:1787560664.640714:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862842240 00000100:00100000:2.0:1787560664.640718:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862842240 00000100:00100000:2.0:1787560664.640735:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1787560664.640755:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862841728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560664.640808:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862841728:12345-0@lo:400:kworker.0 Request processed in 54us (3426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560664.640815:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1787560664.640829:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1787560664.640837:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2006d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874392862842240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560664.640866:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2006d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874392862842240:12345-0@lo:400:kworker.0 Request processed in 30us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560664.640872:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00080000:1.0:1787560664.640928:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787560664.640954:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787560664.640964:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862841472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560664.641014:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862841472:12345-0@lo:400:kworker.0 Request processed in 52us (6645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560664.641020:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787560664.641033:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787560664.641039:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862841216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560664.641063:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862841216:12345-0@lo:400:kworker.0 Request processed in 25us (3732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560664.641068:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787560664.641107:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862841216:0@lo:400:kworker.0 00010000:00080000:3.0:1787560664.641120:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec398b800 x1874392862841728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560664.641130:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec398b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862841728:0@lo:400:kworker.0 00010000:00080000:3.0:1787560664.641140:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec4050380 x1874392862842240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560664.641148:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874392862842240:0@lo:400:kworker.0 00000100:00100000:2.0:1787560664.641222:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862841472:0@lo:400:kworker.0 00010000:00010000:0.0:1787560665.077942:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560666.101554:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560666.170855:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787560666.170879:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeabab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862842624:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787560666.170950:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560666.174663:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862842624 00000100:00100000:3.0:1787560666.174678:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862842624 00000100:00100000:3.0:1787560666.174745:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787560666.174758:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeabaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862842624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787560666.174795:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787560666.174910:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeabaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862842624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 155us (3959us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560666.174918:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787560666.175613:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeabab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862842624:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787560666.597801:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560666.597911:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853360384 00000100:00100000:0.0:1787560666.597921:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853360384 00000100:00100000:0.0:1787560666.597996:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 255 00000100:00100000:0.0:1787560666.598008:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+18:12154:x1874392853360384:12345-192.168.203.29@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787560666.598118:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9331bacf-6cfc-4379-8649-925e79b19df1+18:12154:x1874392853360384:12345-192.168.203.29@tcp:60:lhsmtool_posix.0 Request processed in 112us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560666.598125:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 255 00000100:00080000:1.0:1787560666.598362:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560666.607859:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560666.608041:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853360512 00000100:00100000:1.0:1787560666.608052:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853360512 00000100:00100000:1.0:1787560666.608130:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 256 00000100:00100000:1.0:1787560666.608142:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+5:12154:x1874392853360512:12345-192.168.203.29@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787560666.608254:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+5:12154:x1874392853360512:12345-192.168.203.29@tcp:60:lhsmtool_posix.0 Request processed in 114us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560666.608262:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 256 00000100:00080000:2.0:1787560666.608597:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787560666.614099:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560666.614218:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853360768 00000100:00100000:2.0:1787560666.614228:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853360768 00000100:00100000:2.0:1787560666.614291:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 65 00000100:00100000:2.0:1787560666.614302:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+18:12154:x1874392853360768:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787560666.616546:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+19:12154:x1874392853360768:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 2235us (2446us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1787560666.616560:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 65 00000100:00100000:0.0:1787560666.959134:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560666.959258:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853360896 00000100:00100000:2.0:1787560666.959267:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853360896 00000100:00100000:2.0:1787560666.959378:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 257 00000100:00100000:2.0:1787560666.959388:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:12966:x1874392853360896:12345-192.168.203.29@tcp:101:lsof.0 00010000:00010000:2.0:1787560666.959405:0:13787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560666.959425:0:13787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34d6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4605fff5 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560666.959526:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34d74 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560666.959538:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34d74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560666.959550:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34d74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560666.959591:0:13787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787560666.959594:0:13787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787560666.959613:0:13787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34d74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560666.959634:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169600/0x4642c20bf2f34d6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fff5 expref: 7 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560666.959661:0:13787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34d74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fff5 expref: 6 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560666.959669:0:13787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec3203400) 00010000:00010000:2.0:1787560666.959672:0:13787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787560666.959675:0:13787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2169000, rc 0) 00000100:00100000:2.0:1787560666.959744:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+6:12966:x1874392853360896:12345-192.168.203.29@tcp:101:lsof.0 Request processed in 357us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560666.959751:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 257 00000100:00080000:1.0:1787560666.964893:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787560667.123659:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560667.140151:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560667.140195:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560667.140242:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560667.140278:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560667.140308:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853361408 00000100:00100000:2.0:1787560667.140317:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853361408 00000100:00100000:1.0:1787560667.140467:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853361024 00000100:00100000:1.0:1787560667.140471:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853361024 00000100:00100000:1.0:1787560667.140515:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 391 00000100:00100000:1.0:1787560667.140525:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5800450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+13:2403:x1874392853361024:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560667.140592:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5800450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a608f87b-4315-497d-a70e-0ed75a6814da+13:2403:x1874392853361024:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 68us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560667.140600:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 391 00000100:00080000:1.0:1787560667.140628:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787560667.140843:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853361280 00000100:00100000:3.0:1787560667.140848:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853361280 00000100:00100000:3.0:1787560667.140888:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853361152 00000100:00100000:3.0:1787560667.140891:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853361152 00000100:00100000:3.0:1787560667.140913:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 137 00000100:00100000:3.0:1787560667.140921:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+7:2403:x1874392853361280:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560667.140959:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+7:2403:x1874392853361280:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 39us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560667.140966:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 137 00000100:00100000:3.0:1787560667.140978:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 138 00000100:00100000:3.0:1787560667.140984:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3baed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853361152:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560667.141007:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3baed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853361152:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 22us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560667.141013:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 138 00000100:00080000:1.0:1787560667.141178:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787560667.141181:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787560667.141255:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 338 00000100:00100000:2.0:1787560667.141264:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853361408:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560667.141307:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853361408:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 45us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560667.141315:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 338 00000100:00100000:1.0:1787560667.188195:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862842752:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787560667.188269:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560667.188582:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862842752 00000100:00100000:0.0:1787560667.188589:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862842752 00000100:00100000:0.0:1787560667.188641:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787560667.188660:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862842752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787560667.188886:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787560667.188949:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862842752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 298us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560667.188955:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787560667.189047:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862842752:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787560668.147577:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560668.723697:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeaba8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862842880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787560668.723787:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560668.723988:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862842880 00000100:00100000:1.0:1787560668.723996:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862842880 00000100:00100000:1.0:1787560668.724056:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787560668.724066:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862842880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787560668.724092:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787560668.724135:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862842880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560668.724142:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:3.0:1787560668.724204:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787560668.724237:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeaba8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862842880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787560668.725015:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeaba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862843008:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787560668.725048:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560668.726796:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862843008 00000100:00100000:1.0:1787560668.726807:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862843008 00000100:00100000:1.0:1787560668.726882:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787560668.726892:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862843008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787560668.726913:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787560668.726979:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862843008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (1930us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560668.726998:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787560668.727209:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeaba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862843008:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787560668.727234:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787560669.177622:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560669.747583:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787560669.747606:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862843136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560669.747684:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560669.747720:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862843136 00000100:00100000:1.0:1787560669.747728:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862843136 00000100:00100000:1.0:1787560669.747789:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787560669.747799:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862843136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787560669.747831:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787560669.747877:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862843136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560669.747886:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:1.0:1787560669.747908:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787560669.747935:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862843136:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787560669.749291:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787560669.749309:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeaba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862843264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560669.749359:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560669.749391:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862843264 00000100:00100000:3.0:1787560669.749399:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862843264 00000100:00100000:2.0:1787560669.752163:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787560669.752182:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3badc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1874392862843264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787560669.752209:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787560669.752292:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3badc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1874392862843264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (2932us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560669.752299:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:2.0:1787560669.752322:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787560669.752365:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeaba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862843264:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1787560669.752469:0:6478:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:2.0:1787560669.752482:0:6478:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1787560669.752500:0:6530:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1787560669.752523:0:6530:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:1.0:1787560669.752563:0:9491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000100:00100000:0.0:1787560669.753867:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862843392:0@lo:400:kworker.0 00000100:00100000:0.0:1787560669.753937:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560669.754006:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862843392 00000100:00100000:0.0:1787560669.754013:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862843392 00000100:00100000:0.0:1787560669.754053:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1787560669.754062:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5800050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3623:x1874392862843392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560669.754106:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5800050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3623:x1874392862843392:12345-0@lo:400:kworker.0 Request processed in 46us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560669.754112:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1787560669.754154:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862843392:0@lo:400:kworker.0 00000100:00100000:0.0:1787560669.754188:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862843520:0@lo:400:kworker.0 00000100:00100000:0.0:1787560669.754216:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560669.754247:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862843520 00000100:00100000:0.0:1787560669.754251:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862843520 00000100:00100000:0.0:1787560669.754280:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1787560669.754288:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862843520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560669.754324:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862843520:12345-0@lo:400:kworker.0 Request processed in 37us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560669.754331:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1787560669.754358:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862843520:0@lo:400:kworker.0 00000100:00100000:0.0:1787560669.754393:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862843648:0@lo:400:kworker.0 00000100:00100000:0.0:1787560669.754421:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560669.754474:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862843648 00000100:00100000:0.0:1787560669.754478:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862843648 00000100:00100000:0.0:1787560669.754503:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787560669.754523:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862843648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560669.754569:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862843648:12345-0@lo:400:kworker.0 Request processed in 59us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560669.754587:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787560669.754617:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862843648:0@lo:400:kworker.0 00000100:00100000:0.0:1787560669.754650:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874392862843776:0@lo:400:kworker.0 00000100:00100000:0.0:1787560669.754673:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560669.754698:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862843776 00000100:00100000:0.0:1787560669.754713:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862843776 00000100:00100000:0.0:1787560669.754737:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1787560669.754744:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874392862843776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560669.754779:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874392862843776:12345-0@lo:400:kworker.0 Request processed in 35us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560669.754785:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1787560669.754816:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874392862843776:0@lo:400:kworker.0 00000100:00100000:0.0:1787560669.754851:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862843904:0@lo:400:kworker.0 00000100:00100000:0.0:1787560669.754876:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560669.754905:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862843904 00000100:00100000:0.0:1787560669.754908:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862843904 00000100:00100000:0.0:1787560669.754931:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787560669.754937:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3be9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862843904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560669.754974:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3be9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862843904:12345-0@lo:400:kworker.0 Request processed in 37us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560669.754980:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787560669.755004:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862843904:0@lo:400:kworker.0 00000100:00100000:0.0:1787560669.755047:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862844032:0@lo:400:kworker.0 00000100:00100000:0.0:1787560669.755073:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560669.755102:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862844032 00000100:00100000:0.0:1787560669.755105:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862844032 00000100:00100000:0.0:1787560669.755137:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1787560669.755144:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862844032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560669.755179:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862844032:12345-0@lo:400:kworker.0 Request processed in 35us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560669.755185:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1787560669.755212:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862844032:0@lo:400:kworker.0 00000100:00080000:0.0:1787560669.755227:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560669.755251:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862844160:0@lo:400:kworker.0 00000100:00100000:0.0:1787560669.755275:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560669.755298:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862844160 00000100:00100000:0.0:1787560669.755301:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862844160 00000100:00100000:0.0:1787560669.755325:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1787560669.755331:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3be8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862844160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560669.755363:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3be8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862844160:12345-0@lo:400:kworker.0 Request processed in 32us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560669.755369:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00080000:0.0:1787560669.755385:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787560669.755403:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3bebb80 x1874392862844160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560669.755414:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862844160:0@lo:400:kworker.0 00000100:00100000:0.0:1787560669.755467:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862844288:0@lo:400:kworker.0 00000100:00100000:0.0:1787560669.755499:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560669.755528:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862844288 00000100:00100000:0.0:1787560669.755531:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862844288 00000100:00100000:0.0:1787560669.755558:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787560669.755564:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3be8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862844288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560669.755600:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3be8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862844288:12345-0@lo:400:kworker.0 Request processed in 36us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560669.755607:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787560669.755637:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862844288:0@lo:400:kworker.0 00000100:00100000:0.0:1787560669.755667:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862844416:0@lo:400:kworker.0 00000100:00100000:0.0:1787560669.755696:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560669.755740:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862844416 00000100:00100000:0.0:1787560669.755744:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862844416 00000100:00100000:0.0:1787560669.755767:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787560669.755773:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862844416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560669.755803:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862844416:12345-0@lo:400:kworker.0 Request processed in 30us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560669.755808:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787560669.755833:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862844416:0@lo:400:kworker.0 00000100:00100000:0.0:1787560669.755861:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874392862844544:0@lo:400:kworker.0 00000100:00100000:0.0:1787560669.755882:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560669.755905:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862844544 00000100:00100000:0.0:1787560669.755909:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862844544 00000100:00100000:0.0:1787560669.755934:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1787560669.755939:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3beb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874392862844544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560669.755982:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3beb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874392862844544:12345-0@lo:400:kworker.0 Request processed in 43us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560669.755989:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1787560669.756013:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874392862844544:0@lo:400:kworker.0 00000100:00080000:0.0:1787560669.756026:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560669.756050:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874392862844672:0@lo:400:kworker.0 00000100:00100000:0.0:1787560669.756072:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560669.756093:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862844672 00000100:00100000:0.0:1787560669.756096:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862844672 00000100:00100000:0.0:1787560669.756121:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1787560669.756127:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3be9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874392862844672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560669.756159:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3be9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874392862844672:12345-0@lo:400:kworker.0 Request processed in 32us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560669.756164:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00080000:0.0:1787560669.756178:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787560669.756193:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3bebb80 x1874392862844672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560669.756203:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874392862844672:0@lo:400:kworker.0 00000001:02000400:2.0:1787560669.892251:0:14987:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 04:37:48 (1787560668) 00010000:00010000:1.0:1787560670.195604:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560671.220539:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560671.285662:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787560671.285704:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862844800:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787560671.285775:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560671.285973:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862844800 00000100:00100000:0.0:1787560671.285981:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862844800 00000100:00100000:0.0:1787560671.286036:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787560671.286045:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862844800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787560671.286077:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1787560671.286133:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862844800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560671.286152:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787560671.286240:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862844800:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787560672.243601:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560672.278679:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560672.278740:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560672.278830:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853361536 00000100:00100000:1.0:1787560672.278841:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560672.278849:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853361536 00000100:00100000:1.0:1787560672.278882:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560672.278941:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853362048 00000100:00100000:2.0:1787560672.278942:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 393 00000100:00100000:3.0:1787560672.278955:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853362048 00000100:00100000:2.0:1787560672.278959:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc5802c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+13:2403:x1874392853361536:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560672.279045:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 141 00000100:00100000:3.0:1787560672.279057:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+7:2403:x1874392853362048:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560672.279608:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc5802c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a608f87b-4315-497d-a70e-0ed75a6814da+13:2403:x1874392853361536:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 648us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560672.279618:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 393 00000100:00100000:3.0:1787560672.279795:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9331bacf-6cfc-4379-8649-925e79b19df1+7:2403:x1874392853362048:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 737us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560672.279806:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 141 00000100:00080000:3.0:1787560672.279952:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787560672.288313:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560672.292280:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853361792 00000100:00100000:0.0:1787560672.292303:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853361792 00000100:00100000:0.0:1787560672.292460:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853362304 00000100:00100000:0.0:1787560672.292465:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853362304 00000100:00100000:0.0:1787560672.292504:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 345 00000100:00100000:0.0:1787560672.292517:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853361792:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560672.292637:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853361792:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 122us (13896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560672.292647:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 345 00000100:00100000:0.0:1787560672.292696:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 346 00000100:00100000:0.0:1787560672.292704:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853362304:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560672.292732:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2403:x1874392853362304:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 29us (13851us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560672.292738:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 346 00000100:00080000:3.0:1787560672.293582:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787560672.293823:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560672.293867:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560672.294343:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853361664 00000100:00100000:0.0:1787560672.294354:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853361664 00000100:00100000:0.0:1787560672.294450:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853362176 00000100:00100000:0.0:1787560672.294453:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853362176 00000100:00100000:0.0:1787560672.294480:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 347 00000100:00100000:0.0:1787560672.294489:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+18:2403:x1874392853361664:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560672.294568:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+18:2403:x1874392853361664:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 80us (6267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560672.294576:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 347 00000100:00100000:0.0:1787560672.294593:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 348 00000100:00100000:0.0:1787560672.294632:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeabab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+6:2403:x1874392853362176:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560672.294660:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeabab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+6:2403:x1874392853362176:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 30us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560672.294666:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 348 00000100:00100000:3.0:1787560672.295393:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853361920 00000100:00100000:3.0:1787560672.295413:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853361920 00000100:00100000:3.0:1787560672.295492:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 142 00000100:00100000:3.0:1787560672.295502:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeabab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853361920:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560672.295554:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeabab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+5:2403:x1874392853361920:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 54us (1736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560672.295562:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 142 00000100:00080000:1.0:1787560672.296156:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787560672.296163:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560672.308757:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787560672.308802:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862844928:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787560672.308904:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560672.309121:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862844928 00000100:00100000:0.0:1787560672.309133:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862844928 00000100:00100000:0.0:1787560672.309191:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1787560672.309202:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862844928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787560672.309250:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787560672.309314:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862844928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560672.309323:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787560672.309728:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862844928:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1787560672.436194:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787560672.757074:0:13775:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787560672.757089:0:13775:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787560672.757245:0:13775:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1787560672.757255:0:13775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787560673.267675:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560673.843756:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862845056:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787560673.843796:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2007b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862845184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560673.843938:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560673.844103:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862845184 00000100:00100000:1.0:1787560673.844114:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862845184 00000100:00100000:1.0:1787560673.844256:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00080000:3.0:1787560673.844270:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787560673.844270:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862845184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787560673.844308:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787560673.844378:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862845184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560673.844386:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787560673.844488:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2007b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862845184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787560673.846497:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560673.846688:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862845056 00000100:00100000:3.0:1787560673.846699:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862845056 00000100:00100000:3.0:1787560673.846777:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787560673.846791:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3be8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862845056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787560673.846821:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787560673.846901:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3be8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862845056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560673.846909:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787560673.847094:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862845056:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787560673.847171:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787560674.261881:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560674.262181:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853362560 00000100:00100000:2.0:1787560674.262194:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853362560 00000100:00100000:2.0:1787560674.262899:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 66 00000100:00100000:2.0:1787560674.262916:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+18:13189:x1874392853362560:12345-192.168.203.29@tcp:35:umount.0 00000100:00080000:1.0:1787560674.263138:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560674.263513:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+19:13189:x1874392853362560:12345-192.168.203.29@tcp:35:umount.0 Request processed in 599us (1643us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1787560674.263522:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 66 00000100:00100000:3.0:1787560674.281204:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560674.281425:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853362816 00000100:00100000:2.0:1787560674.281472:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853362816 00000100:00100000:2.0:1787560674.281562:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 67 00000100:00100000:2.0:1787560674.281576:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+19:13189:x1874392853362816:12345-192.168.203.29@tcp:35:umount.0 00000100:00100000:2.0:1787560674.284177:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9331bacf-6cfc-4379-8649-925e79b19df1+20:13189:x1874392853362816:12345-192.168.203.29@tcp:35:umount.0 Request processed in 2587us (2971us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1787560674.284197:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 67 00010000:00010000:1.0:1787560674.291701:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560674.296527:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560674.296636:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853363072 00000100:00100000:1.0:1787560674.296650:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853363072 00000100:00100000:1.0:1787560674.296736:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 68 00000100:00100000:1.0:1787560674.296747:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd7c05850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+20:13189:x1874392853363072:12345-192.168.203.29@tcp:35:umount.0 00000100:00100000:1.0:1787560674.297020:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd7c05850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+21:13189:x1874392853363072:12345-192.168.203.29@tcp:35:umount.0 Request processed in 275us (510us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1787560674.297025:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 68 00000100:00100000:0.0:1787560674.300487:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560674.300579:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853363328 00000100:00100000:1.0:1787560674.300592:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853363328 00000100:00100000:1.0:1787560674.300788:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 69 00000100:00100000:1.0:1787560674.300801:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3beaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+21:13189:x1874392853363328:12345-192.168.203.29@tcp:35:umount.0 00000100:00100000:1.0:1787560674.301177:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3beaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9331bacf-6cfc-4379-8649-925e79b19df1+22:13189:x1874392853363328:12345-192.168.203.29@tcp:35:umount.0 Request processed in 376us (750us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1787560674.301187:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 69 00000100:00100000:3.0:1787560674.305841:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560674.305887:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560674.305935:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560674.306063:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853363456 00000100:00100000:1.0:1787560674.306075:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853363456 00000100:00100000:1.0:1787560674.306143:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853363584 00000100:00100000:1.0:1787560674.306158:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853363584 00000100:00100000:1.0:1787560674.306173:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853364096 00000100:00100000:1.0:1787560674.306176:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853364096 00000100:00100000:1.0:1787560674.306192:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:1.0:1787560674.306202:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2004380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a608f87b-4315-497d-a70e-0ed75a6814da+15:2404:x1874392853363456:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560674.306221:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560674.306246:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca48600/0x4642c20bf2f33ccd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb48 expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560674.306269:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560674.306326:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2004380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a608f87b-4315-497d-a70e-0ed75a6814da+14:2404:x1874392853363456:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 125us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560674.306334:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:1.0:1787560674.306353:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:1.0:1787560674.306359:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2004700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a608f87b-4315-497d-a70e-0ed75a6814da+13:2404:x1874392853363584:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560674.306367:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560674.306375:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafda2f6600/0x4642c20bf2f33c8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb09 expref: 13 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560674.306385:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560674.306399:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2004700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a608f87b-4315-497d-a70e-0ed75a6814da+12:2404:x1874392853363584:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 41us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560674.306405:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:1.0:1787560674.306416:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:1.0:1787560674.306422:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2005500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a608f87b-4315-497d-a70e-0ed75a6814da+11:2402:x1874392853364096:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560674.306476:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560674.306487:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caec2168c00/0x4642c20bf2f33f66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc21 expref: 11 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560674.306504:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560674.306523:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2005500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a608f87b-4315-497d-a70e-0ed75a6814da+10:2402:x1874392853364096:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 101us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560674.306530:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:0.0:1787560674.307425:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560674.307700:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853363968 00000100:00100000:2.0:1787560674.307720:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853363968 00000100:00100000:2.0:1787560674.308190:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 80 00000100:00100000:2.0:1787560674.308204:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3beb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+7:2401:x1874392853363968:12345-192.168.203.29@tcp:9:umount.0 00000020:00000080:2.0:1787560674.308240:0:8415:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f342d8 00000020:00010000:2.0:1787560674.308250:0:8415:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9cafffe73800: total 0 00000100:00080000:2.0:1787560674.308255:0:8415:0:(import.c:65:import_set_state_nolock()) ffff9cafffe70800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787560674.308317:0:8415:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1787560674.308534:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3beb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9331bacf-6cfc-4379-8649-925e79b19df1+5:2401:x1874392853363968:12345-192.168.203.29@tcp:9:umount.0 Request processed in 334us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560674.308544:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 80 00000020:00010000:0.0:1787560674.308547:0:9501:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9cafffe73800: total 0 00010000:00010000:0.0:1787560674.308605:0:9501:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9cafffe73800, canceled 0 locks, left on hash table 2. 00000100:00080000:1.0:1787560674.308612:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787560674.309174:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab9165b8/0x4642c20bf2f34697 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe0b expref: 4 pid: 8415 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560674.309213:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7b1ee9b/0x4642c20bf2f34d66 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffee expref: 3 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560674.309229:0:9501:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9cafffe73800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1787560674.309245:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560674.309247:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560674.309249:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560674.311745:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560674.311983:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853364224 00000100:00100000:3.0:1787560674.311996:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853364224 00000100:00100000:3.0:1787560674.312078:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 81 00000100:00100000:3.0:1787560674.312090:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3be9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+5:2401:x1874392853364224:12345-192.168.203.29@tcp:9:umount.0 00000020:00000080:3.0:1787560674.312128:0:10171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34069 00000100:00080000:3.0:1787560674.312139:0:10171:0:(import.c:65:import_set_state_nolock()) ffff9cafffe72000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787560674.312203:0:10171:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00010000:00010000:2.0:1787560674.312238:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560674.312460:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3be9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9331bacf-6cfc-4379-8649-925e79b19df1+2:2401:x1874392853364224:12345-192.168.203.29@tcp:9:umount.0 Request processed in 371us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560674.312470:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 81 00000100:00080000:1.0:1787560674.313711:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787560674.328693:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560674.328811:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853365248 00000100:00100000:0.0:1787560674.328825:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853365248 00000100:00100000:0.0:1787560674.328911:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 258 00000100:00100000:0.0:1787560674.328925:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+22:2401:x1874392853365248:12345-192.168.203.29@tcp:39:umount.0 00000020:00000080:0.0:1787560674.328970:0:13787:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33c9c 00000020:00010000:0.0:1787560674.328995:0:13787:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9caec2f9b800: total 0 00000100:00080000:0.0:1787560674.329000:0:13787:0:(import.c:65:import_set_state_nolock()) ffff9caec2f9a800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787560674.329038:0:13787:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:0.0:1787560674.329241:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9331bacf-6cfc-4379-8649-925e79b19df1+21:2401:x1874392853365248:12345-192.168.203.29@tcp:39:umount.0 Request processed in 318us (573us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1787560674.329250:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 258 00000020:00010000:1.0:1787560674.329367:0:9500:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9caec2f9b800: total 0 00010000:00010000:1.0:1787560674.329892:0:9500:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9caec2f9b800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787560674.329947:0:9500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:1.0:1787560674.329951:0:9500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787560674.329962:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169a00/0x4642c20bf2f34d27 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffd9 expref: 20 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560674.329983:0:9500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:1.0:1787560674.329986:0:9500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787560674.329990:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880200/0x4642c20bf2f34d51 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffe7 expref: 19 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560674.330005:0:9500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:1.0:1787560674.330007:0:9500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787560674.330011:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880600/0x4642c20bf2f3403f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc4b expref: 18 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560674.330025:0:9500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:1.0:1787560674.330028:0:9500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787560674.330031:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f34a09 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ff07 expref: 17 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560674.330070:0:9500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:1.0:1787560674.330073:0:9500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787560674.330077:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169200/0x4642c20bf2f34682 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe04 expref: 16 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560674.330094:0:9500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec3203400) 00010000:00010000:1.0:1787560674.330097:0:9500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787560674.330101:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f34700 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe27 expref: 15 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560674.330113:0:9500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:1.0:1787560674.330116:0:9500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787560674.330119:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f34658 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdf6 expref: 14 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560674.330130:0:9500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cafda3d1400) 00010000:00010000:1.0:1787560674.330132:0:9500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787560674.330136:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2168600/0x4642c20bf2f3433a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fd24 expref: 13 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560674.330155:0:9500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9caec3207900) 00010000:00010000:1.0:1787560674.330157:0:9500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560674.330161:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff400/0x4642c20bf2f33fe4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc36 expref: 12 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560674.330177:0:9500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cafef7d0900) 00010000:00010000:1.0:1787560674.330180:0:9500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787560674.330190:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169400/0x4642c20bf2f34c47 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605ffa1 expref: 11 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560674.330209:0:9500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9caec3203a00) 00010000:00010000:1.0:1787560674.330212:0:9500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787560674.330216:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc1656800/0x4642c20bf2f3471c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fe2e expref: 10 pid: 10172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560674.330234:0:9500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cafe1537000) 00010000:00010000:1.0:1787560674.330236:0:9500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787560674.330240:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff200/0x4642c20bf2f34578 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fdbe expref: 9 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560674.330253:0:9500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cafef7ce000) 00010000:00010000:1.0:1787560674.330255:0:9500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787560674.330258:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169c00/0x4642c20bf2f33fc8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc2f expref: 8 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560674.330269:0:9500:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9caec2f9b800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1787560674.330287:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560674.330290:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560674.330292:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560674.342903:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560674.343012:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853365376 00000100:00100000:0.0:1787560674.343027:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853365376 00000100:00100000:0.0:1787560674.343125:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 259 00000100:00100000:0.0:1787560674.343139:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+5:2401:x1874392853365376:12345-192.168.203.29@tcp:39:umount.0 00000020:00000080:0.0:1787560674.343182:0:10172:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33ca3 00000100:00080000:0.0:1787560674.343221:0:10172:0:(import.c:65:import_set_state_nolock()) ffff9caec2f99800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787560674.343256:0:10172:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1787560674.343267:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560674.343495:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9331bacf-6cfc-4379-8649-925e79b19df1+3:2401:x1874392853365376:12345-192.168.203.29@tcp:39:umount.0 Request processed in 359us (606us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787560674.343505:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 259 00000100:00080000:1.0:1787560674.343617:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787560674.867709:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862845312:0@lo:400:kworker.0 00000100:00100000:2.0:1787560674.867829:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560674.867922:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862845824:0@lo:400:kworker.0 00000100:00100000:2.0:1787560674.867963:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560674.867976:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862845312 00000100:00100000:0.0:1787560674.867987:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862845312 00000100:00100000:2.0:1787560674.867988:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862846336:0@lo:400:kworker.0 00000100:00100000:2.0:1787560674.868027:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560674.868060:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1787560674.868067:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862846848:0@lo:400:kworker.0 00000100:00100000:0.0:1787560674.868077:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3626:x1874392862845312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560674.868100:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560674.868136:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787560674.868146:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874392862845696:0@lo:400:kworker.0 00000100:00100000:0.0:1787560674.868163:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3626:x1874392862845312:12345-0@lo:400:kworker.0 Request processed in 91us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560674.868173:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1787560674.868188:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560674.868217:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862846208:0@lo:400:kworker.0 00000100:00100000:0.0:1787560674.868231:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862845440:0@lo:400:kworker.0 00000100:00100000:2.0:1787560674.868246:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560674.868276:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560674.868293:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862846720:0@lo:400:kworker.0 00000100:00100000:0.0:1787560674.868311:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874392862845952:0@lo:400:kworker.0 00000100:00100000:2.0:1787560674.868330:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560674.868404:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560674.868604:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862846336 00000100:00100000:3.0:1787560674.868609:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862846336 00000100:00100000:3.0:1787560674.868634:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862846848 00000100:00100000:3.0:1787560674.868637:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862846848 00000100:00100000:3.0:1787560674.868689:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862846208 00000100:00100000:3.0:1787560674.868692:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862846208 00000100:00100000:3.0:1787560674.868705:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862846720 00000100:00100000:3.0:1787560674.868708:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862846720 00000100:00100000:3.0:1787560674.868723:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787560674.868731:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3baf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862846336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560674.871149:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862845312:0@lo:400:kworker.0 00000100:00100000:2.0:1787560674.871224:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862845824 00000100:00100000:2.0:1787560674.871233:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862845824 00000100:00100000:2.0:1787560674.871310:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787560674.871321:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3baf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862845824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560674.871417:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3baf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862845824:12345-0@lo:400:kworker.0 Request processed in 97us (3453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560674.871425:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787560674.871468:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862845696 00000100:00100000:2.0:1787560674.871472:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862845696 00000100:00100000:2.0:1787560674.871498:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862845440 00000100:00100000:2.0:1787560674.871501:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862845440 00000100:00100000:2.0:1787560674.871515:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862845952 00000100:00100000:2.0:1787560674.871518:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862845952 00000100:00100000:2.0:1787560674.871539:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1787560674.872039:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874392862845696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560674.872082:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874392862845696:12345-0@lo:400:kworker.0 Request processed in 47us (3897us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560674.872090:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1787560674.872105:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1787560674.872111:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862845440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560674.872142:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862845440:12345-0@lo:400:kworker.0 Request processed in 32us (3871us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560674.872148:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1787560674.872158:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1787560674.872180:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874392862845952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560674.872210:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874392862845952:12345-0@lo:400:kworker.0 Request processed in 31us (3807us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560674.872215:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1787560674.872252:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787560674.872262:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4050380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862846848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560674.872296:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4050380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862846848:12345-0@lo:400:kworker.0 Request processed in 36us (4197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560674.872302:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787560674.872317:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787560674.872325:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4051880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862846208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560674.872353:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4051880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862846208:12345-0@lo:400:kworker.0 Request processed in 30us (4110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560674.872359:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787560674.872370:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787560674.872376:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862846720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560674.872400:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862846720:12345-0@lo:400:kworker.0 Request processed in 25us (4073us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560674.872405:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787560674.872465:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874392862845696:0@lo:400:kworker.0 00000100:00100000:2.0:1787560674.872479:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862846208:0@lo:400:kworker.0 00000100:00100000:2.0:1787560674.872489:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862846720:0@lo:400:kworker.0 00000100:00100000:2.0:1787560674.872501:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862845824:0@lo:400:kworker.0 00000100:00100000:2.0:1787560674.872523:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:2.0:1787560674.872529:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9caec398b100, transno 4294967325 00000100:00080000:1.0:1787560674.872853:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787560674.872860:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787560674.872931:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862845568:0@lo:400:kworker.0 00000100:00100000:1.0:1787560674.872995:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560674.873034:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862846080:0@lo:400:kworker.0 00000100:00100000:1.0:1787560674.873059:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560674.874503:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862846848:0@lo:400:kworker.0 00000100:00100000:1.0:1787560674.874681:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874392862846592:0@lo:400:kworker.0 00000100:00100000:1.0:1787560674.874730:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560674.874757:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862847104:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787560674.874788:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560674.874816:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787560674.874822:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862846976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787560674.874842:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560674.874876:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862847104 00000100:00100000:1.0:1787560674.874884:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862847104 00000100:00100000:1.0:1787560674.874932:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862846976 00000100:00100000:1.0:1787560674.874936:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862846976 00000100:00100000:1.0:1787560674.874953:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787560674.874961:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862847104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787560674.875119:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787560674.875127:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862846080 00000100:00100000:2.0:1787560674.875132:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862846080 00000100:00100000:1.0:1787560674.875174:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862847104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 212us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560674.875181:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862846592 00000100:00100000:1.0:1787560674.875184:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787560674.875187:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862846592 00000100:00100000:2.0:1787560674.875208:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1787560674.875215:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862846080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560674.875257:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862846080:12345-0@lo:400:kworker.0 Request processed in 42us (2196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560674.875264:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1787560674.875277:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1787560674.875284:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874392862846592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560674.875309:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874392862846592:12345-0@lo:400:kworker.0 Request processed in 27us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560674.875315:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1787560674.875325:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787560674.875335:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862846976:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787560674.875341:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00002000:00000024:1.0:1787560674.875347:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787560674.875379:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862846976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560674.875380:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862845568 00000100:00100000:2.0:1787560674.875387:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862845568 00000100:00100000:1.0:1787560674.875390:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787560674.875421:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787560674.875453:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862845568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560674.875492:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862845568:12345-0@lo:400:kworker.0 Request processed in 63us (2497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560674.875498:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787560674.875525:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862846976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787560674.875545:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862845568:0@lo:400:kworker.0 00010000:00080000:1.0:1787560674.875559:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cafffe4c000 x1874392862846080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560674.875586:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862846080:0@lo:400:kworker.0 00010000:00080000:1.0:1787560674.875598:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cafffe4d180 x1874392862846592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560674.875607:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874392862846592:0@lo:400:kworker.0 00000100:00100000:1.0:1787560674.875620:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862847104:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560674.879128:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874392862845952:0@lo:400:kworker.0 00000100:00100000:0.0:1787560674.879145:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874392862846464:0@lo:400:kworker.0 00000100:00100000:0.0:1787560674.879207:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560674.879273:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862845440:0@lo:400:kworker.0 00000100:00100000:3.0:1787560674.879659:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3baf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862846336:12345-0@lo:400:kworker.0 Request processed in 10926us (11628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560674.879682:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787560674.880064:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862846336:0@lo:400:kworker.0 00000100:00100000:2.0:1787560674.880278:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862846464 00000100:00100000:2.0:1787560674.880423:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862846464 00000100:00080000:1.0:1787560674.880660:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560674.880731:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1787560674.880743:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874392862846464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560674.880830:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874392862846464:12345-0@lo:400:kworker.0 Request processed in 90us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560674.880836:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1787560674.880906:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874392862846464:0@lo:400:kworker.0 00010000:00010000:0.0:1787560675.315794:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560675.939248:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560675.939305:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560675.939343:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560675.939650:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853365504 00000100:00100000:2.0:1787560675.939672:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853365504 00000100:00100000:2.0:1787560675.939757:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853365760 00000100:00100000:2.0:1787560675.939761:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853365760 00000100:00100000:2.0:1787560675.939775:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853365632 00000100:00100000:2.0:1787560675.939778:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853365632 00000100:00100000:2.0:1787560675.939796:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:2.0:1787560675.939807:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd7cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a608f87b-4315-497d-a70e-0ed75a6814da+12:2403:x1874392853365504:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560675.939828:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560675.939852:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffcbffa00/0x4642c20bf2f33d9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb5d expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560675.939874:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560675.939946:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd7cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a608f87b-4315-497d-a70e-0ed75a6814da+11:2403:x1874392853365504:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 141us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560675.939953:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:2.0:1787560675.940005:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:2.0:1787560675.940011:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2004e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a608f87b-4315-497d-a70e-0ed75a6814da+10:2403:x1874392853365760:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560675.940020:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560675.940029:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caec3880e00/0x4642c20bf2f33f5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fc1a expref: 10 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560675.940060:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560675.940079:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2004e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a608f87b-4315-497d-a70e-0ed75a6814da+9:2403:x1874392853365760:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 67us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560675.940085:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:2.0:1787560675.940097:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00100000:2.0:1787560675.940103:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2006680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a608f87b-4315-497d-a70e-0ed75a6814da+8:2403:x1874392853365632:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560675.940110:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560675.940119:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffcbfea00/0x4642c20bf2f33da6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb8e expref: 8 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560675.940127:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560675.940143:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2006680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a608f87b-4315-497d-a70e-0ed75a6814da+7:2403:x1874392853365632:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 40us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560675.940148:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00100000:3.0:1787560675.952144:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560675.952266:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853366016 00000100:00100000:2.0:1787560675.952279:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853366016 00000100:00100000:2.0:1787560675.952388:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 260 00000100:00100000:2.0:1787560675.952402:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+6:2401:x1874392853366016:12345-192.168.203.29@tcp:39:umount.0 00000020:00000080:2.0:1787560675.952485:0:6500:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33db4 00000020:00010000:2.0:1787560675.952494:0:6500:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9caec3382000: total 0 00000100:00080000:2.0:1787560675.952499:0:6500:0:(import.c:65:import_set_state_nolock()) ffff9caec3384800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787560675.952536:0:6500:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00010000:0.0:1787560675.952596:0:6488:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9caec3382000: total 0 00010000:00010000:0.0:1787560675.952722:0:6488:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9caec3382000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787560675.952767:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9caec3203400) 00010000:00010000:0.0:1787560675.952772:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787560675.952782:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec2169000/0x4642c20bf2f34d74 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fff5 expref: 5 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560675.952797:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+4:2401:x1874392853366016:12345-192.168.203.29@tcp:39:umount.0 Request processed in 394us (663us total) trans 4294967529 rc 0/0 00000100:00100000:2.0:1787560675.952810:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 260 00010000:00010000:0.0:1787560675.952813:0:6488:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9caec3382000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1787560675.952839:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560675.952844:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560675.952848:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787560675.953790:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560675.965138:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560675.966900:0:10172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853366144 00000100:00100000:0.0:1787560675.966920:0:10172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853366144 00000100:00100000:0.0:1787560675.967106:0:10172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 261 00000100:00100000:0.0:1787560675.967120:0:10172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+5:2401:x1874392853366144:12345-192.168.203.29@tcp:39:umount.0 00000020:00000080:0.0:1787560675.967174:0:10172:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33dbb 00000100:00080000:0.0:1787560675.967188:0:10172:0:(import.c:65:import_set_state_nolock()) ffff9caec3386800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787560675.967227:0:10172:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1787560675.967743:0:10172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8+3:2401:x1874392853366144:12345-192.168.203.29@tcp:39:umount.0 Request processed in 624us (2617us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787560675.967753:0:10172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 261 00000100:00080000:2.0:1787560675.967944:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787560675.968315:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560676.019729:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560676.020397:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853366400 00000100:00100000:2.0:1787560676.020412:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853366400 00000100:00100000:2.0:1787560676.020508:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 395 00000100:00100000:2.0:1787560676.020522:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+7:2401:x1874392853366400:12345-192.168.203.29@tcp:251:umount.0 00000020:00000080:2.0:1787560676.020573:0:6494:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33c79 00000020:00010000:2.0:1787560676.020582:0:6494:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9caec3213800: total 0 00000100:00080000:2.0:1787560676.020587:0:6494:0:(import.c:65:import_set_state_nolock()) ffff9caec3210800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787560676.020695:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a608f87b-4315-497d-a70e-0ed75a6814da+3:2401:x1874392853366400:12345-192.168.203.29@tcp:251:umount.0 Request processed in 176us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560676.020704:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 395 00000020:00010000:1.0:1787560676.020781:0:6487:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9caec3213800: total 0 00010000:00010000:1.0:1787560676.020788:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560676.020866:0:6487:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9caec3213800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787560676.020913:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafc0030800/0x4642c20bf2f33cd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4605fb4f expref: 2 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560676.020930:0:6487:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9caec3213800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1787560676.020941:0:6487:0:(genops.c:885:class_export_put()) final put ffff9caec3213800/a608f87b-4315-497d-a70e-0ed75a6814da 00010000:00010000:1.0:1787560676.020962:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560676.020964:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560676.020966:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787560676.021028:0:13868:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec3213800/a608f87b-4315-497d-a70e-0ed75a6814da for MGS 00000020:00000080:0.0:1787560676.021078:0:13868:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec3210800 for MGS 00010000:00010000:3.0:1787560676.340735:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560676.405368:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862847232:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787560676.405509:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560676.405898:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862847232 00000100:00100000:0.0:1787560676.405909:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862847232 00000100:00100000:0.0:1787560676.405970:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787560676.405981:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862847232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787560676.406026:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1787560676.406091:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862847232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560676.406117:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1787560676.406238:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862847232:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787560677.364735:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560677.434509:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862847360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787560677.434723:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560677.434900:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862847360 00000100:00100000:2.0:1787560677.434912:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862847360 00000100:00100000:2.0:1787560677.434980:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787560677.435003:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862847360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787560677.435050:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787560677.435112:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862847360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560677.435120:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787560677.435385:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862847360:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787560678.395273:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787560678.453781:0:6478:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8 00000001:00080000:2.0:1787560678.453803:0:6478:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:2.0:1787560678.453810:0:6478:0:(genops.c:885:class_export_put()) final put ffff9caec3382000/5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8 00000001:00100000:2.0:1787560678.453829:0:6478:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9331bacf-6cfc-4379-8649-925e79b19df1 00000001:00080000:2.0:1787560678.453837:0:6478:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:2.0:1787560678.453848:0:6478:0:(genops.c:885:class_export_put()) final put ffff9caec2f9b800/9331bacf-6cfc-4379-8649-925e79b19df1 00000020:00000080:0.0:1787560678.453963:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec3382000/5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8 for lustre-MDT0000 00000020:00000080:0.0:1787560678.457170:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec2f9b800/9331bacf-6cfc-4379-8649-925e79b19df1 for lustre-MDT0000 00000020:00000080:0.0:1787560678.462803:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec3384800 for lustre-MDT0000 00000020:00000080:1.0:1787560678.468180:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec2f9a800 for lustre-MDT0000 00000020:01000004:2.0:1787560678.472133:0:15183:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1787560678.484801:0:15183:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1787560678.484879:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f33d2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d36 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.484898:0:15183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f33d2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33d36 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.484907:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f33d2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f33d36 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.484926:0:15183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f33d2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f33d36 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.484952:0:15183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787560678.484958:0:15183:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1787560678.485003:0:6487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560678.485010:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f33d2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f33d36 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.485018:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7200 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560678.485022:0:6487:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f33d2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f33d36 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.485103:0:6487:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f33d2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f33d36 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560678.485112:0:6487:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f33d2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f33d36 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560678.485118:0:6487:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787560678.485121:0:6487:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787560678.485124:0:6487:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787560678.485171:0:6487:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f33d2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f33d36 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.485177:0:6487:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560678.485210:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f33d2f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f33d36 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.485217:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f33d2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f33d36 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.485236:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.485238:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.485239:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560678.485249:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787560678.485273:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862847488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787560678.485452:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787560678.485528:0:15183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787560678.485533:0:15183:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787560678.485539:0:15183:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787560678.485555:0:15183:0:(import.c:65:import_set_state_nolock()) ffff9cafc6e8d800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787560678.490518:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862847488 00000100:00100000:0.0:1787560678.490535:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862847488 00000100:00100000:0.0:1787560678.490770:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787560678.490783:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2004700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3624:x1874392862847488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787560678.490804:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560678.490829:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffcbfe400/0x4642c20bf2f33d36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4642c20bf2f33d2f expref: 24 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.490846:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560678.490948:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2004700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:3624:x1874392862847488:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (5518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560678.490956:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787560678.491019:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3624:1874392862847488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787560678.492553:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874392862847616:0@lo:39:umount.0 00000100:00100000:3.0:1787560678.492805:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560678.493228:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862847616 00000100:00100000:0.0:1787560678.493238:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862847616 00000100:00100000:0.0:1787560678.493295:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787560678.493305:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2004380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1874392862847616:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787560678.494223:0:6498:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33890 00000100:00080000:0.0:1787560678.494238:0:6498:0:(import.c:65:import_set_state_nolock()) ffff9caffba9f000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787560678.494787:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2004380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3622:x1874392862847616:12345-0@lo:39:umount.0 Request processed in 1479us (1979us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560678.494822:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:0.0:1787560678.494839:0:6498:0:(genops.c:885:class_export_put()) final put ffff9caffba9d800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1787560678.494883:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787560678.494930:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafc6e8d800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787560678.494942:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874392862847616:0@lo:39:umount.0 00000020:00000080:0.0:1787560678.494994:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caffba9d800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:3.0:1787560678.495287:0:15183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787560678.495292:0:15183:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787560678.495298:0:15183:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787560678.496559:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caffba9f000 for lustre-MDT0000 00010000:00010000:3.0:1787560678.501840:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc1656200/0x4642c20bf2f33d3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d44 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.501864:0:15183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc1656200/0x4642c20bf2f33d3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33d44 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.501873:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc1656200/0x4642c20bf2f33d3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f33d44 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.501880:0:15183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9cafc1656200/0x4642c20bf2f33d3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f33d44 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.501930:0:15183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787560678.501939:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe800/0x4642c20bf2f33c33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33c3a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.501946:0:15183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe800/0x4642c20bf2f33c33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33c3a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.501953:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe800/0x4642c20bf2f33c33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f33c3a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.501960:0:15183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe800/0x4642c20bf2f33c33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f33c3a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.501980:0:15183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787560678.501997:0:9500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787560678.502005:0:9500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cafc1656200/0x4642c20bf2f33d3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f33d44 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.502013:0:9500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafc1656200 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560678.502017:0:9500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cafc1656200/0x4642c20bf2f33d3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f33d44 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.502026:0:9500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cafc1656200/0x4642c20bf2f33d3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f33d44 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.502804:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560678.502812:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe800/0x4642c20bf2f33c33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f33c3a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.502822:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbfe800 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:0.0:1787560678.502825:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe800/0x4642c20bf2f33c33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f33c3a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.502833:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe800/0x4642c20bf2f33c33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f33c3a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787560678.502841:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe800/0x4642c20bf2f33c33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f33c3a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560678.502847:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787560678.502850:0:6488:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787560678.502853:0:6488:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787560678.502906:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe800/0x4642c20bf2f33c33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f33c3a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.502914:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787560678.502941:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe800/0x4642c20bf2f33c33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f33c3a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.502960:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe800/0x4642c20bf2f33c33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f33c3a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.502975:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560678.502976:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560678.502978:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560678.502990:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560678.503018:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862847744:0@lo:103:ldlm_bl.0 10000000:00010000:3.0:1787560678.503229:0:9500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cafc1656200/0x4642c20bf2f33d3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f33d44 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560678.503235:0:9500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787560678.503244:0:9500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1787560678.503263:0:9500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cafc1656200/0x4642c20bf2f33d3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f33d44 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.503269:0:9500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560678.503291:0:9500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cafc1656200/0x4642c20bf2f33d3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f33d44 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.503298:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cafc1656200/0x4642c20bf2f33d3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f33d44 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.503312:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.503313:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.503314:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560678.504286:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560678.504418:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862847872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787560678.504469:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787560678.504554:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3881200/0x4642c20bf2f33f97 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33f9e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.504567:0:15183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3881200/0x4642c20bf2f33f97 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33f9e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.504575:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3881200/0x4642c20bf2f33f97 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f33f9e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.504583:0:15183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9caec3881200/0x4642c20bf2f33f97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f33f9e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560678.504781:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862847744 00000100:00100000:0.0:1787560678.504792:0:9502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862847744 00000100:00100000:0.0:1787560678.504846:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862847872 00000100:00100000:0.0:1787560678.504849:0:9502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862847872 00000100:00100000:0.0:1787560678.504878:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787560678.504889:0:9502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f30da5a7-84ca-46bc-bf14-dc2a954107e6+24:3623:x1874392862847744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787560678.504907:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560678.504927:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafc0030a00/0x4642c20bf2f33c3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4642c20bf2f33c33 expref: 24 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.504944:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560678.504986:0:9502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f30da5a7-84ca-46bc-bf14-dc2a954107e6+23:3623:x1874392862847744:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560678.504994:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787560678.505014:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787560678.505021:0:9502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:3625:x1874392862847872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787560678.505493:0:15183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787560678.505513:0:6487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560678.505535:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caec3881200/0x4642c20bf2f33f97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f33f9e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.505544:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881200 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560678.505548:0:6487:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caec3881200/0x4642c20bf2f33f97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f33f9e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.505556:0:6487:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caec3881200/0x4642c20bf2f33f97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f33f9e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560678.505573:0:6487:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caec3881200/0x4642c20bf2f33f97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f33f9e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560678.505579:0:6487:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787560678.505582:0:6487:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787560678.505585:0:6487:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787560678.506293:0:6487:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caec3881200/0x4642c20bf2f33f97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f33f9e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.506306:0:6487:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787560678.506759:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560678.506782:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafda2f6400/0x4642c20bf2f33d44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4642c20bf2f33d3d expref: 22 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.506809:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560678.506884:0:9502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:3625:x1874392862847872:12345-0@lo:103:ldlm_bl.0 Request processed in 1861us (2413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560678.506893:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787560678.506969:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862847872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787560678.506992:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787560678.507001:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862848000:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787560678.507125:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caec3881200/0x4642c20bf2f33f97 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f33f9e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.507133:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caec3881200/0x4642c20bf2f33f97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f33f9e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.507214:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.507217:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.507219:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.507243:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6a00/0x4642c20bf2f337ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f337f6 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.507266:0:15183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6a00/0x4642c20bf2f337ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f337f6 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.507274:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6a00/0x4642c20bf2f337ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f337f6 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.507282:0:15183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6a00/0x4642c20bf2f337ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f337f6 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.507301:0:15183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787560678.507307:0:15183:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1787560678.507312:0:15183:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1787560678.508272:0:15183:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1787560678.508279:0:15183:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1787560678.508285:0:15183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787560678.508293:0:15183:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:3.0:1787560678.508301:0:15183:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9caec1c43000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787560678.508310:0:15183:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9caec1c33800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787560678.508314:0:15183:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9cafefb19000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:0.0:1787560678.508722:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787560678.508792:0:9501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560678.508800:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6a00/0x4642c20bf2f337ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f337f6 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.508810:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6a00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:0.0:1787560678.508815:0:9501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6a00/0x4642c20bf2f337ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f337f6 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.508825:0:9501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6a00/0x4642c20bf2f337ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f337f6 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787560678.508833:0:9501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6a00/0x4642c20bf2f337ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f337f6 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560678.508840:0:9501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787560678.508843:0:9501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787560678.508846:0:9501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787560678.508882:0:9501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6a00/0x4642c20bf2f337ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f337f6 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.508906:0:9501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787560678.508921:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6a00/0x4642c20bf2f337ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f337f6 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.508928:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6a00/0x4642c20bf2f337ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f337f6 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.508940:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560678.508942:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560678.508944:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560678.508962:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862848128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787560678.509011:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1787560678.509116:0:15183:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9cafefb1a000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:3.0:1787560678.509124:0:15183:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9cafe06b19b8) has exports, disconnecting them 00000020:00080000:3.0:1787560678.509129:0:15183:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9caec1c43000), last request at 1787560674 00000020:00000080:3.0:1787560678.509136:0:15183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33ba0 00000100:00080000:3.0:1787560678.509263:0:15183:0:(import.c:65:import_set_state_nolock()) ffff9caec1c44000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787560678.509404:0:15183:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9caec1c43000): rc 0 00000020:00000080:3.0:1787560678.509408:0:15183:0:(genops.c:885:class_export_put()) final put ffff9caec1c43000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1787560678.509421:0:15183:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9caec1c33800), last request at 1787560674 00000020:00000080:3.0:1787560678.509448:0:15183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33a7a 00000100:00080000:3.0:1787560678.509455:0:15183:0:(import.c:65:import_set_state_nolock()) ffff9caec1c35800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787560678.509471:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787560678.509480:0:15183:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9caec1c33800): rc 0 00000020:00000080:3.0:1787560678.509482:0:15183:0:(genops.c:885:class_export_put()) final put ffff9caec1c33800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1787560678.509487:0:15183:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9cafefb19000), last request at 1787560451 00000020:00000080:3.0:1787560678.509490:0:15183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33977 00000100:00080000:3.0:1787560678.509493:0:15183:0:(import.c:65:import_set_state_nolock()) ffff9cafefb1a800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787560678.509504:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787560678.509511:0:15183:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cafefb19000): rc 0 00000020:00000080:3.0:1787560678.509513:0:15183:0:(genops.c:885:class_export_put()) final put ffff9cafefb19000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1787560678.509516:0:15183:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9cafefb1a000), last request at 1787560451 00000020:00000080:3.0:1787560678.509520:0:15183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33938 00000100:00080000:3.0:1787560678.509523:0:15183:0:(import.c:65:import_set_state_nolock()) ffff9cafefb1d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787560678.509534:0:15183:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00100000:0.0:1787560678.510789:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862847744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787560678.510857:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862848000 00000100:00100000:0.0:1787560678.510866:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862848000 00000100:00100000:0.0:1787560678.510926:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862848128 00000100:00100000:0.0:1787560678.510930:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862848128 00000100:00100000:0.0:1787560678.510950:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787560678.510960:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+22:3625:x1874392862848000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787560678.510979:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560678.511002:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caec2168000/0x4642c20bf2f33f9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4642c20bf2f33f97 expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.511020:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:3.0:1787560678.512261:0:15183:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cafefb1a000): rc 0 00000004:00000080:3.0:1787560678.512274:0:15183:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb6db41a3fae0 00000100:00080000:3.0:1787560678.512300:0:15183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787560678.512305:0:15183:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:0.0:1787560678.513828:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+21:3625:x1874392862848000:12345-0@lo:103:ldlm_bl.0 Request processed in 2858us (5097us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560678.513844:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787560678.513911:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787560678.513924:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafd7cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+20:3623:x1874392862848128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787560678.513947:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560678.513975:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafc0030c00/0x4642c20bf2f337f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4642c20bf2f337ef expref: 20 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.513994:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560678.515274:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafd7cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+19:3623:x1874392862848128:12345-0@lo:103:ldlm_bl.0 Request processed in 1346us (6253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560678.515286:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1787560678.515822:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560678.515871:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862848000:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787560678.515903:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560678.515924:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862848128:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1787560678.515974:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec1c43000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787560678.517798:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec1c33800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787560678.517852:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafefb19000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787560678.517885:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec1c44000 for lustre-MDT0000 00000020:00000080:0.0:1787560678.517891:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec1c35800 for lustre-MDT0000 00000020:00000080:0.0:1787560678.517894:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cafefb1a800 for lustre-MDT0000 00000100:00080000:3.0:1787560678.517984:0:15183:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787560678.518019:0:15183:0:(import.c:65:import_set_state_nolock()) ffff9cafc6e89800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787560678.519982:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862848256:0@lo:39:umount.0 00000100:00100000:0.0:1787560678.520269:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787560678.520936:0:15183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787560678.520943:0:15183:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:3.0:1787560678.520961:0:15183:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787560678.522340:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862848256 00000100:00100000:0.0:1787560678.522356:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862848256 00000100:00100000:0.0:1787560678.522445:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787560678.522458:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1874392862848256:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787560678.522511:0:7734:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f339d2 00000100:00080000:0.0:1787560678.522521:0:7734:0:(import.c:65:import_set_state_nolock()) ffff9caffc903800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787560678.522551:0:7734:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:3.0:1787560678.522771:0:15183:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1787560678.522796:0:15183:0:(import.c:65:import_set_state_nolock()) ffff9cafef9be800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1787560678.522818:0:15183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787560678.522821:0:15183:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:3.0:1787560678.522842:0:15183:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787560678.522915:0:15183:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787560678.522926:0:15183:0:(import.c:65:import_set_state_nolock()) ffff9caec3385000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1787560678.522961:0:15183:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9cafe06b19b8) has no exports 00000100:00100000:0.0:1787560678.524454:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3622:x1874392862848256:12345-0@lo:39:umount.0 Request processed in 1993us (4180us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787560678.524468:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00010000:00010000:0.0:1787560678.524516:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560678.524546:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862848384:0@lo:9:umount.0 00000100:00100000:0.0:1787560678.526131:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560678.526253:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862848512:0@lo:9:umount.0 00000100:00100000:0.0:1787560678.526305:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560678.527015:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862848384 00000100:00100000:2.0:1787560678.527025:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862848384 00000100:00080000:0.0:1787560678.527243:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafc6e89800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787560678.527255:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862848256:0@lo:39:umount.0 00000100:00100000:2.0:1787560678.527944:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862848512 00000100:00100000:2.0:1787560678.527950:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862848512 00000100:00100000:2.0:1787560678.527980:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787560678.527992:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1874392862848384:12345-0@lo:9:umount.0 00000100:00080000:0.0:1787560678.528278:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787560678.528283:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1787560678.528304:0:8415:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33b29 00000100:00080000:2.0:1787560678.528316:0:8415:0:(import.c:65:import_set_state_nolock()) ffff9caffdfee800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787560678.528381:0:8415:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1787560678.528622:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3622:x1874392862848384:12345-0@lo:9:umount.0 Request processed in 631us (4024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560678.528630:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787560678.528655:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787560678.528663:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1874392862848512:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787560678.528677:0:8415:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33c72 00000100:00080000:2.0:1787560678.528682:0:8415:0:(import.c:65:import_set_state_nolock()) ffff9caec2fc0000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787560678.528707:0:8415:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1787560678.528785:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3622:x1874392862848512:12345-0@lo:9:umount.0 Request processed in 123us (2479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560678.528791:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:2.0:1787560678.528822:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787560678.528857:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafef9be800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787560678.528873:0:3622:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787560678.528875:0:3622:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787560678.528880:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862848384:0@lo:9:umount.0 00000100:00080000:2.0:1787560678.528894:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec3385000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787560678.528903:0:3622:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787560678.528905:0:3622:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787560678.528908:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862848512:0@lo:9:umount.0 00010000:00010000:0.0:1787560678.530555:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787560678.539795:0:15183:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9cafe06b19b8) has no exports 00000020:00000080:0.0:1787560678.592258:0:15183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f3384a 00000020:00000080:0.0:1787560678.592281:0:15183:0:(genops.c:885:class_export_put()) final put ffff9caffb8b0000/lustre-QMT0000_UUID 00000020:01000000:0.0:1787560678.592370:0:15183:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1787560678.592601:0:15183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787560678.592615:0:15183:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787560678.592621:0:15183:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9caff32499b8) has no exports 00000020:00000080:3.0:1787560678.593019:0:15183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33843 00000020:00000080:3.0:1787560678.593026:0:15183:0:(genops.c:885:class_export_put()) final put ffff9caffb8b5800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787560678.593127:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caffb8b0000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1787560678.593319:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caffb8b5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787560678.593380:0:15183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787560678.593389:0:15183:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787560678.593393:0:15183:0:(genops.c:885:class_export_put()) final put ffff9cafc81ed000/lustre-QMT0000_UUID 00000020:00000080:3.0:1787560678.593396:0:15183:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafc81ed000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1787560678.593401:0:15183:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:2.0:1787560678.964714:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787560678.964748:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862848640:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787560678.964840:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560678.965105:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862848640 00000100:00100000:3.0:1787560678.965116:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862848640 00000100:00100000:3.0:1787560678.965278:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787560678.965292:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3989500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862848640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787560678.965331:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787560678.965393:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3989500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862848640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560678.965402:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787560678.965482:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862848640:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787560678.965604:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787560679.412086:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787560679.478046:0:7430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787560679.478070:0:7430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1787560679.478080:0:7430:0:(genops.c:885:class_export_put()) final put ffff9cafef9bb800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787560679.478099:0:7430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8 00000001:00080000:3.0:1787560679.478105:0:7430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1787560679.478119:0:7430:0:(genops.c:885:class_export_put()) final put ffff9caec3381800/5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8 00000001:00100000:3.0:1787560679.478144:0:7430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 9331bacf-6cfc-4379-8649-925e79b19df1 00000001:00080000:3.0:1787560679.478149:0:7430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1787560679.478151:0:7430:0:(genops.c:885:class_export_put()) final put ffff9caec2f9f800/9331bacf-6cfc-4379-8649-925e79b19df1 00000001:00100000:2.0:1787560679.479075:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787560679.479082:0:8407:0:(genops.c:885:class_export_put()) final put ffff9caffdfef000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787560679.479095:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9331bacf-6cfc-4379-8649-925e79b19df1 00000020:00000080:2.0:1787560679.479098:0:8407:0:(genops.c:885:class_export_put()) final put ffff9cafffe71800/9331bacf-6cfc-4379-8649-925e79b19df1 00000020:00000080:0.0:1787560679.479158:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafef9bb800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1787560679.479251:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec3381800/5dff98ae-67bc-42a4-afbe-0ecc9fb0c3a8 for lustre-MDT0001 00000020:00000080:0.0:1787560679.479277:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec2f9f800/9331bacf-6cfc-4379-8649-925e79b19df1 for lustre-MDT0001 00000020:00000080:0.0:1787560679.479307:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caffdfef000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787560679.479329:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafffe71800/9331bacf-6cfc-4379-8649-925e79b19df1 for lustre-OST0000 00000020:00000080:0.0:1787560679.479346:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caffc903800 for lustre-MDT0001 00000020:00000080:0.0:1787560679.479362:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec3386800 for lustre-MDT0001 00000020:00000080:0.0:1787560679.479366:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec2f99800 for lustre-MDT0001 00000020:00000080:0.0:1787560679.479369:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caffdfee800 for lustre-OST0000 00000020:00000080:0.0:1787560679.479374:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cafffe72000 for lustre-OST0000 00000001:00100000:3.0:1787560679.481199:0:9491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787560679.481210:0:9491:0:(genops.c:885:class_export_put()) final put ffff9caec2fc4000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787560679.481244:0:9491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9331bacf-6cfc-4379-8649-925e79b19df1 00000020:00000080:3.0:1787560679.481246:0:9491:0:(genops.c:885:class_export_put()) final put ffff9cafffe73800/9331bacf-6cfc-4379-8649-925e79b19df1 00000020:00000080:2.0:1787560679.481495:0:13868:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec2fc4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787560679.484893:0:13868:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafffe73800/9331bacf-6cfc-4379-8649-925e79b19df1 for lustre-OST0001 00000020:00000080:2.0:1787560679.484961:0:13868:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec2fc0000 for lustre-OST0001 00000020:00000080:2.0:1787560679.484968:0:13868:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cafffe70800 for lustre-OST0001 00000100:00100000:3.0:1787560679.991496:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787560679.991526:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862848768:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787560679.991722:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560679.992412:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862848768 00000100:00100000:1.0:1787560679.992421:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862848768 00000100:00100000:1.0:1787560679.992648:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787560679.992659:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862848768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787560679.992689:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00080000:3.0:1787560679.992872:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787560679.992930:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862848768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 274us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560679.992938:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787560679.993078:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862848768:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787560679.999103:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787560679.999128:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862849024:0@lo:400:kworker.0 00000100:00100000:3.0:1787560679.999211:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560679.999280:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862849024 00000100:00100000:3.0:1787560679.999287:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862849024 00000100:00100000:3.0:1787560679.999327:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787560679.999335:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3624:x1874392862849024:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787560679.999343:0:6504:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787560679.999382:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3624:x1874392862849024:12345-0@lo:400:kworker.0 Request processed in 46us (171us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787560679.999390:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00080000:3.0:1787560679.999426:0:3624:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787560679.999476:0:3624:0:(import.c:65:import_set_state_nolock()) ffff9cafeed1c000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787560679.999481:0:3624:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1787560680.000781:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787560680.000809:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec398b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862849152:0@lo:400:kworker.0 00000100:00100000:2.0:1787560680.000864:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560680.000940:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862849536:0@lo:400:kworker.0 00000100:00100000:2.0:1787560680.000967:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560680.000997:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862849536 00000100:00100000:2.0:1787560680.001003:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862849536 00000100:00100000:2.0:1787560680.001052:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787560680.001060:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3988a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862849536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560680.001107:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3988a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862849536:12345-0@lo:400:kworker.0 Request processed in 47us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560680.001113:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787560680.001167:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862849536:0@lo:400:kworker.0 00000100:00100000:2.0:1787560680.001198:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787560680.001218:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874392862849664:0@lo:400:kworker.0 00000100:00100000:2.0:1787560680.001243:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560680.001293:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862849152 00000100:00100000:2.0:1787560680.001296:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862849152 00000100:00100000:2.0:1787560680.001317:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862849664 00000100:00100000:2.0:1787560680.001319:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862849664 00000100:00100000:2.0:1787560680.001332:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787560680.001336:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec398b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3623:x1874392862849152:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787560680.001342:0:13787:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787560680.001371:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec398b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3623:x1874392862849152:12345-0@lo:400:kworker.0 Request processed in 33us (507us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787560680.001377:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787560680.001389:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787560680.001392:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec398a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3623:x1874392862849664:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787560680.001397:0:13787:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787560680.001415:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec398a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3623:x1874392862849664:12345-0@lo:400:kworker.0 Request processed in 21us (171us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787560680.001421:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:2.0:1787560680.001831:0:3623:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787560680.001836:0:3623:0:(import.c:65:import_set_state_nolock()) ffff9caec2fc0800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787560680.001840:0:3623:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787560680.001846:0:3623:0:(import.c:65:import_set_state_nolock()) ffff9caec2fc0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787560680.001849:0:3623:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 212 00000100:00080000:2.0:1787560680.001855:0:3623:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9caec2fc0800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560680.001877:0:3623:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caec3988000 x1874392862849920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787560680.001896:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874392862849664:0@lo:400:kworker.0 00000100:00080000:2.0:1787560680.001916:0:3623:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787560680.001918:0:3623:0:(import.c:65:import_set_state_nolock()) ffff9caffbb0b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787560680.001921:0:3623:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787560680.001924:0:3623:0:(import.c:65:import_set_state_nolock()) ffff9caffbb0b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787560680.001927:0:3623:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 170 00000100:00080000:2.0:1787560680.001931:0:3623:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9caffbb0b000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560680.001943:0:3623:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caec3989f80 x1874392862850048/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787560680.001953:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec398b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862849152:0@lo:400:kworker.0 00000100:00100000:2.0:1787560680.001972:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1874392862849920:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1787560680.001998:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560680.002016:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3989f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874392862850048:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1787560680.002033:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560680.002056:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862849920 00000100:00100000:2.0:1787560680.002060:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862849920 00000100:00100000:2.0:1787560680.002072:0:13787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862850048 00000100:00100000:2.0:1787560680.002075:0:13787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862850048 00000100:00100000:2.0:1787560680.002084:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787560680.002089:0:13787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec398b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3622:x1874392862849920:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1787560680.002104:0:13787:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787560680.002204:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862849280:0@lo:400:kworker.0 00000100:00100000:1.0:1787560680.002237:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560680.002255:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec398b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874392862849792:0@lo:400:kworker.0 00000100:00100000:1.0:1787560680.002272:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560680.002284:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787560680.002290:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862848896:0@lo:400:kworker.0 00000100:00100000:1.0:1787560680.002315:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560680.002339:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec398aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862849408:0@lo:400:kworker.0 00000100:00100000:1.0:1787560680.002359:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560680.002377:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862849280 00000100:00100000:1.0:1787560680.002380:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862849280 00000100:00100000:1.0:1787560680.002395:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862849792 00000100:00100000:1.0:1787560680.002398:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862849792 00000100:00100000:1.0:1787560680.002414:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862849408 00000100:00100000:1.0:1787560680.002416:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862849408 00000100:00100000:1.0:1787560680.002682:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1787560680.002696:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874392862849792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560680.002750:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874392862849792:12345-0@lo:400:kworker.0 Request processed in 61us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560680.002756:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1787560680.002771:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1787560680.002795:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862849408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560680.002826:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862849408:12345-0@lo:400:kworker.0 Request processed in 41us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560680.002831:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1787560680.002844:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787560680.002848:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1874392862850048:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1787560680.002857:0:6499:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787560680.002887:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1874392862850048:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 36us (852us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787560680.002893:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787560680.002904:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787560680.002908:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3625:x1874392862849280:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787560680.002914:0:6499:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787560680.002935:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3625:x1874392862849280:12345-0@lo:400:kworker.0 Request processed in 25us (698us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787560680.002941:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787560680.002958:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862848896 00000100:00100000:1.0:1787560680.002962:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862848896 00000100:00100000:1.0:1787560680.002989:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1787560680.002995:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc595f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+19:3625:x1874392862848896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560680.003023:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc595f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f30da5a7-84ca-46bc-bf14-dc2a954107e6+19:3625:x1874392862848896:12345-0@lo:400:kworker.0 Request processed in 28us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560680.003034:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1787560680.003071:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862848896:0@lo:400:kworker.0 00010000:00080000:1.0:1787560680.003082:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec398aa00 x1874392862849408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560680.003104:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec398aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862849408:0@lo:400:kworker.0 00000100:00080000:1.0:1787560680.003116:0:3625:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787560680.003119:0:3625:0:(import.c:65:import_set_state_nolock()) ffff9caec1ef1800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787560680.003122:0:3625:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787560680.003126:0:3625:0:(import.c:65:import_set_state_nolock()) ffff9caec1ef1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787560680.003129:0:3625:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 190 00000100:00080000:0.0:1787560680.003204:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffbb0b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787560680.003210:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787560680.003213:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3989f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874392862850048:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1787560680.003246:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787560680.003250:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787560680.003587:0:3625:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9caec1ef1800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1787560680.003608:0:3625:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafeab13100 x1874392862850176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787560680.003646:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862849280:0@lo:400:kworker.0 00010000:00080000:1.0:1787560680.003661:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec398b480 x1874392862849792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560680.003670:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec398b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874392862849792:0@lo:400:kworker.0 00000100:00100000:0.0:1787560680.003767:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1874392862850176:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1787560680.003811:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560680.004021:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862850176 00000100:00100000:1.0:1787560680.004026:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862850176 00000100:00100000:1.0:1787560680.004058:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787560680.004063:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1874392862850176:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1787560680.004074:0:6499:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787560680.004110:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1874392862850176:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 45us (298us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787560680.004116:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:1.0:1787560680.004518:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec1ef1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787560680.004524:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787560680.004538:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1874392862850176:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1787560680.020517:0:3624:0:(import.c:65:import_set_state_nolock()) ffff9cafeed1c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787560680.020527:0:3624:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 170 00000100:00080000:3.0:1787560680.020537:0:3624:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9cafeed1c000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787560680.020648:0:3624:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafffe18700 x1874392862850304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787560680.020681:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862849024:0@lo:400:kworker.0 00000100:00100000:1.0:1787560680.021407:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862850304:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1787560680.021509:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560680.021685:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862850304 00000100:00100000:0.0:1787560680.021693:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862850304 00000100:00100000:0.0:1787560680.021741:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787560680.021749:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3622:x1874392862850304:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1787560680.021766:0:7734:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787560680.021820:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3622:x1874392862850304:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 70us (312us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787560680.021828:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00080000:1.0:1787560680.022107:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafeed1c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787560680.022112:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787560680.022116:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862850304:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1787560680.035550:0:13787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec398b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3622:x1874392862849920:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 33453us (33545us total) trans 0 rc -19/-19 00000100:00080000:1.0:1787560680.035679:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec2fc0800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787560680.035686:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787560680.035689:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1874392862849920:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787560680.035924:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00010000:00010000:0.0:1787560680.437685:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560681.460001:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560682.484090:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787560682.677093:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787560683.510497:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560684.084725:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787560684.084751:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862850432:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787560684.084822:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560684.085183:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862850432 00000100:00100000:1.0:1787560684.085192:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862850432 00000100:00100000:1.0:1787560684.085259:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787560684.085270:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec398a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862850432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787560684.085306:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787560684.085362:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec398a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862850432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560684.085369:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787560684.085638:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862850432:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787560684.085755:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787560684.535510:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787560684.598381:0:6478:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787560684.598392:0:6478:0:(genops.c:885:class_export_put()) final put ffff9cafefb1a000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787560684.598466:0:13868:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafefb1a000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1787560684.598555:0:13868:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cafefb1d800 for lustre-MDT0000 00000020:01000000:3.0:1787560684.660358:0:15183:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9caec2f598a0 - data ffff9cb00035f1b0/ffff9caec2c8cc00 00000020:01000000:3.0:1787560684.660888:0:15183:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cafc7e142a0 - data ffff9cb0000cfaf8/ffff9caffbaa2000 00000001:00000004:3.0:1787560684.678319:0:15183:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00080000:1.0:1787560684.777261:0:15183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787560684.777272:0:15183:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1787560684.777305:0:15183:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9cafffe18e00 x1874392862848256/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787560688 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560684.777337:0:15183:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1787560684.784228:0:15183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787560684.784239:0:15183:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:1.0:1787560684.784265:0:15183:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787560684.784283:0:15183:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787560684.785054:0:8605:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787560684.785126:0:8605:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1787560684.785141:0:8605:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1787560684.787868:0:15183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787560684.787878:0:15183:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:1.0:1787560684.787946:0:15183:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787560684.787950:0:15183:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787560684.789391:0:9934:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787560684.789399:0:9934:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:3.0:1787560684.789412:0:9934:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1787560684.792320:0:15183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33812 00000020:00000080:1.0:1787560684.792336:0:15183:0:(genops.c:885:class_export_put()) final put ffff9cafeab02800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787560684.795721:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafeab02800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787560684.799328:0:15183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33827 00000020:00000080:1.0:1787560684.799350:0:15183:0:(genops.c:885:class_export_put()) final put ffff9cafeabcd800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787560684.799373:0:15183:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1787560684.799379:0:15183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787560684.799390:0:15183:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787560684.799395:0:15183:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9cafe06b4d28) has no exports 00000020:00000080:3.0:1787560684.799795:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafeabcd800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1787560684.800480:0:15183:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787560684.800493:0:15183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33c5d 00000020:00000080:1.0:1787560684.800501:0:15183:0:(genops.c:885:class_export_put()) final put ffff9caec3216000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787560684.800774:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec3216000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1787560684.800798:0:15183:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787560684.800804:0:15183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787560684.800820:0:15183:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787560684.800824:0:15183:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff9caec2d03370) has no exports 00000020:00000080:1.0:1787560684.800833:0:15183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33c56 00000020:00000080:1.0:1787560684.800838:0:15183:0:(genops.c:885:class_export_put()) final put ffff9cafffe07800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787560684.800974:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafffe07800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787560684.801399:0:15183:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787560684.801404:0:15183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787560684.801409:0:15183:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1787560684.801416:0:15183:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787560684.801419:0:15183:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787560684.801729:0:15183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787560684.801741:0:15183:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787560684.801748:0:15183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33b1b 00000020:00000080:1.0:1787560684.801753:0:15183:0:(genops.c:885:class_export_put()) final put ffff9caffdfe8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787560684.802885:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec3385000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787560684.802897:0:36:0:(genops.c:885:class_export_put()) final put ffff9cafffe05800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787560684.802923:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafffe05800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787560684.802931:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787560684.803208:0:15183:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787560684.803214:0:15183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787560684.803236:0:15183:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787560684.803242:0:15183:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9cafef9fb370) has no exports 00000020:00000080:1.0:1787560684.803251:0:15183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33b14 00000020:00000080:1.0:1787560684.803258:0:15183:0:(genops.c:885:class_export_put()) final put ffff9cafeed1d000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787560684.803503:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caffdfe8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787560684.803510:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafeed1d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787560684.804289:0:15183:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787560684.804296:0:15183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787560684.804302:0:15183:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1787560684.804311:0:15183:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787560684.804314:0:15183:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787560684.804365:0:15183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787560684.804377:0:15183:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1787560684.804396:0:15183:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1787560684.804404:0:15183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f339cb 00000020:00000080:1.0:1787560684.804411:0:15183:0:(genops.c:885:class_export_put()) final put ffff9cafeab03800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787560684.804417:0:15183:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1787560684.804423:0:15183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787560684.807024:0:15183:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787560684.807042:0:15183:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9cafeabd0000) has no exports 00000020:00000080:1.0:1787560684.807057:0:15183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f339c4 00000020:00000080:1.0:1787560684.807159:0:15183:0:(genops.c:885:class_export_put()) final put ffff9cafc6e8b000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787560684.807565:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cafef9be800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787560684.807575:0:36:0:(genops.c:885:class_export_put()) final put ffff9caec1c41800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787560684.807578:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec1c41800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787560684.807586:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787560684.807703:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafeab03800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787560684.807709:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafc6e8b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1787560684.812792:0:15183:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1787560684.812807:0:15183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787560684.812814:0:15183:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1787560684.812824:0:15183:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787560684.812893:0:15183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787560684.812923:0:15183:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787560684.812961:0:15183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787560684.812964:0:15183:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787560684.812971:0:15183:0:(genops.c:885:class_export_put()) final put ffff9cafeab04800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787560684.812976:0:15183:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafeab04800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787560684.812988:0:15183:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787560684.813132:0:15183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f3382e 00000020:00000080:0.0:1787560684.813139:0:15183:0:(genops.c:885:class_export_put()) final put ffff9cafeabcb800/lustre-MDD0000_UUID 00000020:01000000:0.0:1787560684.813145:0:15183:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787560684.813150:0:15183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787560684.813156:0:15183:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787560684.813160:0:15183:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9cafeabd3370) has no exports 00000020:00000080:0.0:1787560684.813188:0:15183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787560684.813192:0:15183:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787560684.813197:0:15183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33835 00000020:00000080:0.0:1787560684.813201:0:15183:0:(genops.c:885:class_export_put()) final put ffff9cafeabc8800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787560684.813212:0:15183:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cb000817800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787560684.813216:0:15183:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cb000817800 3 00000020:01000004:0.0:1787560684.813219:0:15183:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cb000817800 from lustre-MDT0000 00000020:00000080:0.0:1787560684.813243:0:15183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787560684.813246:0:15183:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787560684.813249:0:15183:0:(genops.c:885:class_export_put()) final put ffff9cafeab03000/lustre-MDT0000_UUID 00000020:00000080:0.0:1787560684.813251:0:15183:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafeab03000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787560684.813260:0:15183:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1787560684.813289:0:15183:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1787560684.813294:0:15183:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787560684.813297:0:15183:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787560684.813299:0:15183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787560684.813302:0:15183:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787560684.813311:0:15183:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9caff312b800 f30da5a7-84ca-46bc-bf14-dc2a954107e6 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787560684.813317:0:15183:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9caff324cd28) has exports, disconnecting them 00000020:00080000:0.0:1787560684.813328:0:15183:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9caff312b800), last request at 1787560427 00000020:00000080:0.0:1787560684.813346:0:15183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f337d3 00000020:00010000:0.0:1787560684.813351:0:15183:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9caff312b800: total 2 00000100:00080000:0.0:1787560684.813355:0:15183:0:(import.c:65:import_set_state_nolock()) ffff9caff312d800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787560684.813380:0:15183:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9caff312b800): rc 0 00000020:00080000:0.0:1787560684.813385:0:15183:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9caff324cd28) has no exports 00000100:00100000:0.0:1787560684.813473:0:6493:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9cafd09e7800:6493] 1 exiting: rc = 0 00000100:00100000:0.0:1787560684.813790:0:6492:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9cafd088a600:6492] 0 exiting: rc = 1 00000100:00100000:0.0:1787560684.813871:0:6494:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9cafd09e6400:6494] 2 exiting: rc = 0 00000100:00100000:0.0:1787560684.814705:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.814715:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.814723:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.814729:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.814736:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.814742:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.814749:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.814756:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.814763:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.814770:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.814776:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.814782:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.814788:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.814795:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.814806:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.814812:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.814818:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.814825:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.814832:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.814839:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.814844:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.814850:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.814857:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.814864:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.814884:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.814890:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.814895:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815154:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815165:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815172:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815178:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815184:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815189:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815196:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815202:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815209:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815215:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815222:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815228:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815234:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815241:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815247:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815253:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815260:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815266:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815273:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815279:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815287:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815294:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815301:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815308:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815314:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815320:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815325:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815332:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815338:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815345:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815351:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815357:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815370:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815377:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815384:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815393:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560684.815399:0:15183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787560684.815739:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cafc6e89800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787560684.815752:0:36:0:(genops.c:885:class_export_put()) final put ffff9cafef9b8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787560684.815756:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafef9b8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1787560684.815769:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787560684.815888:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafeabcb800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787560684.815894:0:36:0:(genops.c:885:class_export_put()) final put ffff9cafeabc8000/lustre-MDD0000_UUID 00000020:00000080:3.0:1787560684.815896:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafeabc8000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787560684.815909:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1787560684.815938:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafeabc8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:3.0:1787560684.815978:0:9501:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9caff312b800: total 0 00010000:00010000:3.0:1787560684.816000:0:9501:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9caff312b800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1787560684.816050:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caec2169800/0x4642c20bf2f33f74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4642c20bf2f33f6d expref: 14 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560684.816079:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caec3881e00/0x4642c20bf2f33f82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4642c20bf2f33f7b expref: 13 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560684.816093:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca48800/0x4642c20bf2f33ce2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4642c20bf2f33cdb expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560684.816121:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caec3880a00/0x4642c20bf2f33f90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4642c20bf2f33f89 expref: 11 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560684.816137:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffcbfe600/0x4642c20bf2f33bf4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4642c20bf2f33bed expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560684.816149:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffcbfee00/0x4642c20bf2f33cf0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4642c20bf2f33ce9 expref: 9 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560684.816159:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafc1657800/0x4642c20bf2f33d52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4642c20bf2f33d4b expref: 8 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560684.816173:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca48200/0x4642c20bf2f33d0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4642c20bf2f33d05 expref: 7 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560684.816183:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffcbfe000/0x4642c20bf2f33cfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4642c20bf2f33cf7 expref: 6 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560684.816194:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafda2f7a00/0x4642c20bf2f338dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4642c20bf2f338d6 expref: 5 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560684.816205:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca48a00/0x4642c20bf2f33d1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4642c20bf2f33d13 expref: 4 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560684.816217:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafc0031200/0x4642c20bf2f338cf lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4642c20bf2f338c8 expref: 3 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560684.816232:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafc1656a00/0x4642c20bf2f33d28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4642c20bf2f33d21 expref: 2 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560684.816388:0:9501:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9caff312b800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1787560684.816405:0:9501:0:(genops.c:885:class_export_put()) final put ffff9caff312b800/f30da5a7-84ca-46bc-bf14-dc2a954107e6 00010000:00010000:3.0:1787560684.816417:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560684.816420:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560684.816421:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787560684.816452:0:13868:0:(genops.c:844:class_export_destroy()) destroying export ffff9caff312b800/f30da5a7-84ca-46bc-bf14-dc2a954107e6 for MGS 00000020:00000080:3.0:1787560684.816480:0:13868:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caff312d800 for MGS 00000020:01000000:0.0:1787560684.822010:0:15183:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9caec23b9060 - data ffff9cb000339288/ffff9caffc998c00 00000020:01000000:0.0:1787560684.822186:0:15183:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cafdfe67180 - data ffff9cb0000b7af8/ffff9cafc87f4400 00000020:00000080:0.0:1787560684.822770:0:15183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f337b7 00000020:00000080:0.0:1787560684.822780:0:15183:0:(genops.c:885:class_export_put()) final put ffff9cb000817000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787560684.822800:0:15183:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cb000817800 from MGS, refs=2 00000020:01000004:0.0:1787560684.822803:0:15183:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cb000817800 2 00000020:01000004:0.0:1787560684.822807:0:15183:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cb000817800 from MGS 00000020:00000080:0.0:1787560684.822830:0:15183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787560684.822839:0:15183:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787560684.822841:0:15183:0:(genops.c:885:class_export_put()) final put ffff9cafe3159000/MGS 00000020:00000080:0.0:1787560684.822844:0:15183:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafe3159000/MGS for MGS 00000020:01000000:0.0:1787560684.822851:0:15183:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1787560684.822933:0:15183:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787560684.822937:0:15183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787560684.822943:0:15183:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787560684.822951:0:15183:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9cafc6e89000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787560684.822956:0:15183:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9caffb9919b8) has exports, disconnecting them 00000020:00080000:0.0:1787560684.822961:0:15183:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9cafc6e89000), last request at 1787560428 00000020:00000080:0.0:1787560684.822966:0:15183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33882 00000020:00080000:0.0:1787560684.822976:0:15183:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cafc6e89000): rc 0 00000020:00000080:0.0:1787560684.822981:0:15183:0:(genops.c:885:class_export_put()) final put ffff9cafc6e89000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787560684.824590:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cb000817000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787560684.824618:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafc6e89000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787560684.890226:0:15183:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787560684.890326:0:15183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787560684.890332:0:15183:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787560684.890343:0:15183:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787560684.890491:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cafc6e8d800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787560684.890841:0:15183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787560684.890867:0:15183:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1787560684.890874:0:15183:0:(genops.c:885:class_export_put()) final put ffff9cafc6e88800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787560684.890879:0:15183:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafc6e88800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1787560684.890887:0:15183:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787560684.891059:0:15183:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cb000817800 1 00000020:00000080:0.0:1787560684.891131:0:15183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f337a9 00000020:00000080:0.0:1787560684.891140:0:15183:0:(genops.c:885:class_export_put()) final put ffff9cafc6163000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787560684.891159:0:15183:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787560684.891164:0:15183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787560684.891169:0:15183:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787560684.891173:0:15183:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9caff31d19b8) has no exports 00000020:00000080:3.0:1787560684.897214:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafc6163000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787560685.019089:0:15183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787560685.019107:0:15183:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787560685.019115:0:15183:0:(genops.c:885:class_export_put()) final put ffff9cb000816000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787560685.019120:0:15183:0:(genops.c:844:class_export_destroy()) destroying export ffff9cb000816000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787560685.019129:0:15183:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787560685.019312:0:15183:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9cb000810000 00000020:02000400:2.0:1787560685.019403:0:15183:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00080000:2.0:1787560685.109690:0:13868:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787560685.109700:0:13868:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787560685.109704:0:13868:0:(import.c:65:import_set_state_nolock()) ffff9cafeed1c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787560685.109714:0:13868:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 399 00000100:00080000:2.0:1787560685.109722:0:13868:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787560685.109729:0:13868:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9cafeed1c000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560685.109762:0:13868:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caec398b480 x1874392862850688/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787560685.109793:0:13868:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787560685.109797:0:13868:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787560685.109799:0:13868:0:(import.c:65:import_set_state_nolock()) ffff9caffbb0b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787560685.109803:0:13868:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 399 00000100:00080000:2.0:1787560685.109805:0:13868:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787560685.109808:0:13868:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9caffbb0b000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560685.109822:0:13868:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caec3988e00 x1874392862850816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787560685.109846:0:13868:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787560685.109850:0:13868:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787560685.109852:0:13868:0:(import.c:65:import_set_state_nolock()) ffff9caec1ef1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787560685.109856:0:13868:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 399 00000100:00080000:2.0:1787560685.109858:0:13868:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787560685.109862:0:13868:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9caec1ef1800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560685.109874:0:13868:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caec398aa00 x1874392862850944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787560685.109906:0:13868:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787560685.109909:0:13868:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787560685.109911:0:13868:0:(import.c:65:import_set_state_nolock()) ffff9caec2fc0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787560685.109914:0:13868:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 399 00000100:00080000:2.0:1787560685.109917:0:13868:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787560685.109920:0:13868:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9caec2fc0800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560685.109930:0:13868:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caec3be9180 x1874392862851328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787560685.109973:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec398b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862850688:0@lo:38:kworker.0 00000100:00100000:2.0:1787560685.110051:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560685.110118:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874392862850816:0@lo:38:kworker.0 00000100:00100000:2.0:1787560685.110145:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560685.110169:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec398aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1874392862850944:0@lo:38:kworker.0 00000100:00100000:2.0:1787560685.110192:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560685.110207:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1874392862851328:0@lo:38:kworker.0 00000100:00100000:2.0:1787560685.110237:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560685.110293:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862851200:0@lo:400:kworker.0 00000100:00100000:2.0:1787560685.110322:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560685.110345:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787560685.110351:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874392862851456:0@lo:400:kworker.0 00000100:00100000:2.0:1787560685.110372:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560685.110404:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862850688 00000100:00100000:2.0:1787560685.110413:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862850688 00000100:00100000:2.0:1787560685.110496:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787560685.110505:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1874392862850688:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787560685.110529:0:6503:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787560685.110581:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1874392862850688:12345-0@lo:38:kworker.0 Request processed in 74us (528us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787560685.110590:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787560685.110629:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862850816 00000100:00100000:2.0:1787560685.110633:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862850816 00000100:00100000:2.0:1787560685.110651:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862850944 00000100:00100000:2.0:1787560685.110653:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862850944 00000100:00100000:2.0:1787560685.110661:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862851328 00000100:00100000:2.0:1787560685.110663:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862851328 00000100:00100000:2.0:1787560685.110671:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862851456 00000100:00100000:2.0:1787560685.110673:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862851456 00000100:00100000:2.0:1787560685.110710:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1787560685.110730:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874392862851456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560685.110781:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874392862851456:12345-0@lo:400:kworker.0 Request processed in 64us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560685.110789:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1787560685.110802:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787560685.110815:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1874392862850816:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787560685.110825:0:6499:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787560685.110851:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1874392862850816:12345-0@lo:38:kworker.0 Request processed in 36us (705us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787560685.110857:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787560685.110870:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787560685.110874:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1874392862850944:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787560685.110883:0:6499:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787560685.110905:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1874392862850944:12345-0@lo:38:kworker.0 Request processed in 30us (712us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787560685.110911:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787560685.110924:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787560685.110927:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1874392862851328:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787560685.110936:0:6499:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787560685.110955:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1874392862851328:12345-0@lo:38:kworker.0 Request processed in 26us (718us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787560685.110960:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787560685.110978:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862851200 00000100:00100000:2.0:1787560685.110981:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862851200 00000100:00100000:2.0:1787560685.111006:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787560685.111012:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862851200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560685.111040:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862851200:12345-0@lo:400:kworker.0 Request processed in 28us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560685.111045:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00010000:00080000:2.0:1787560685.111086:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcb0b100 x1874392862851456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560685.111106:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874392862851456:0@lo:400:kworker.0 00000100:00100000:2.0:1787560685.111120:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862851200:0@lo:400:kworker.0 00000100:00080000:2.0:1787560685.111161:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafeed1c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787560685.111165:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787560685.111169:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec398b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862850688:0@lo:38:kworker.0 00000100:00080000:2.0:1787560685.111178:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffbb0b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787560685.111182:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787560685.111185:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874392862850816:0@lo:38:kworker.0 00000100:00080000:2.0:1787560685.111192:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec1ef1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787560685.111195:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787560685.111197:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec398aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1874392862850944:0@lo:38:kworker.0 00000100:00080000:2.0:1787560685.111205:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec2fc0800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787560685.111209:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787560685.111211:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1874392862851328:0@lo:38:kworker.0 00000100:00100000:0.0:1787560685.111754:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862850560:0@lo:400:kworker.0 00000400:00000100:0.0:1787560685.111790:0:3623:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874392862850560 offset 0 length 224: 4 00000100:00100000:0.0:1787560685.111817:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862851584:0@lo:400:kworker.0 00000100:00100000:0.0:1787560685.111843:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560685.111868:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560685.111875:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3989f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862851072:0@lo:400:kworker.0 00000100:00100000:0.0:1787560685.111899:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560685.111938:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862851072 00000100:00100000:0.0:1787560685.111944:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862851072 00000100:00100000:0.0:1787560685.111981:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1787560685.111990:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862851072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560685.112035:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862851072:12345-0@lo:400:kworker.0 Request processed in 46us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560685.112042:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00080000:0.0:1787560685.112076:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787560685.112097:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3989f80 x1874392862851072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560685.112123:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3989f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862851072:0@lo:400:kworker.0 00000100:00100000:3.0:1787560685.113034:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862851712:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787560685.113085:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560685.113131:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862851712 00000100:00100000:3.0:1787560685.113138:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862851712 00000100:00100000:3.0:1787560685.113190:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787560685.113200:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862851712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787560685.113236:0:8417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787560685.113298:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862851712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560685.113305:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787560685.113345:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862851712:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1787560685.113363:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787560685.113887:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862851584 00000100:00100000:2.0:1787560685.113894:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862851584 00000100:00100000:2.0:1787560685.113938:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787560685.113947:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862851584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560685.114014:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862851584:12345-0@lo:400:kworker.0 Request processed in 69us (2170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560685.114021:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787560685.116814:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862851584:0@lo:400:kworker.0 00010000:00010000:0.0:1787560685.560720:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560686.583847:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560687.603934:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560688.633171:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560689.208965:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787560689.208990:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862851840:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787560689.209071:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560689.209130:0:10128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862851840 00000100:00100000:2.0:1787560689.209137:0:10128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862851840 00000100:00100000:2.0:1787560689.209187:0:10128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787560689.209197:0:10128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862851840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787560689.209226:0:10128:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787560689.209269:0:10128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862851840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560689.209276:0:10128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:2.0:1787560689.209299:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787560689.209337:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862851840:0@lo:13:osp-pre-0-1.0 00000020:01000004:3.0:1787560689.347370:0:15385:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1787560689.375740:0:15385:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1787560689.375806:0:15385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc1657c00/0x4642c20bf2f33d13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d1a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560689.375820:0:15385:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc1657c00/0x4642c20bf2f33d13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33d1a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560689.375827:0:15385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc1657c00/0x4642c20bf2f33d13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f33d1a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560689.375834:0:15385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9cafc1657c00/0x4642c20bf2f33d13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f33d1a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560689.375923:0:15385:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787560689.375929:0:15385:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1787560689.375960:0:6487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560689.375966:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cafc1657c00/0x4642c20bf2f33d13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f33d1a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560689.375974:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafc1657c00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:0.0:1787560689.375977:0:6487:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cafc1657c00/0x4642c20bf2f33d13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f33d1a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560689.375986:0:6487:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cafc1657c00/0x4642c20bf2f33d13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f33d1a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787560689.376011:0:6487:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cafc1657c00/0x4642c20bf2f33d13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f33d1a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560689.376018:0:6487:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787560689.376020:0:6487:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787560689.376023:0:6487:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787560689.376062:0:6487:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cafc1657c00/0x4642c20bf2f33d13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f33d1a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560689.376069:0:6487:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787560689.376091:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cafc1657c00/0x4642c20bf2f33d13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f33d1a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560689.376098:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cafc1657c00/0x4642c20bf2f33d13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f33d1a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560689.376111:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560689.376113:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560689.376115:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560689.376126:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787560689.376144:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862851968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787560689.376212:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560689.376274:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862851968 00000100:00100000:0.0:1787560689.376282:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862851968 00000100:00100000:0.0:1787560689.376319:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787560689.376327:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3625:x1874392862851968:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787560689.376333:0:6486:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787560689 with bad export cookie 5062822287694313427 00000100:00080000:3.0:1787560689.378981:0:15385:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787560689.378990:0:15385:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787560689.378998:0:15385:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787560689.379005:0:15385:0:(import.c:65:import_set_state_nolock()) ffff9caffbb0b000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1787560689.379012:0:15385:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787560689.379014:0:15385:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787560689.379018:0:15385:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787560689.387554:0:15385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f33d21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d28 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.387583:0:15385:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f33d21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33d28 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.387591:0:15385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f33d21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f33d28 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.387597:0:15385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f33d21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f33d28 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.387631:0:15385:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787560689.387638:0:15385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6000/0x4642c20bf2f33bed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33bf4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.387645:0:15385:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6000/0x4642c20bf2f33bed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33bf4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.387651:0:15385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6000/0x4642c20bf2f33bed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f33bf4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.387657:0:15385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6000/0x4642c20bf2f33bed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f33bf4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.387685:0:15385:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787560689.387692:0:15385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3880400/0x4642c20bf2f33f89 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33f90 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.387697:0:15385:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3880400/0x4642c20bf2f33f89 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33f90 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.387703:0:15385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3880400/0x4642c20bf2f33f89 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f33f90 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.387708:0:15385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9caec3880400/0x4642c20bf2f33f89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f33f90 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.387724:0:15385:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787560689.387741:0:9501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787560689.387747:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f33d21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f33d28 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.387753:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49e00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560689.387757:0:9501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f33d21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f33d28 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.387765:0:9501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f33d21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f33d28 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560689.387771:0:9501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f33d21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f33d28 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560689.387776:0:9501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787560689.387784:0:9501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1787560689.387819:0:9501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f33d21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f33d28 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.387825:0:9501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560689.387849:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f33d21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f33d28 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.387855:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f33d21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f33d28 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.387870:0:9501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787560689.387873:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6000/0x4642c20bf2f33bed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f33bf4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.387878:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6000 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560689.387881:0:9501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6000/0x4642c20bf2f33bed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f33bf4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.387886:0:9501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6000/0x4642c20bf2f33bed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f33bf4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560689.387892:0:9501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6000/0x4642c20bf2f33bed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f33bf4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560689.387896:0:9501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787560689.387898:0:9501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787560689.387901:0:9501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787560689.387913:0:9501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6000/0x4642c20bf2f33bed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f33bf4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.387918:0:9501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560689.387931:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6000/0x4642c20bf2f33bed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f33bf4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.387938:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6000/0x4642c20bf2f33bed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f33bf4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.387951:0:9501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560689.387955:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caec3880400/0x4642c20bf2f33f89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f33f90 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.387961:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880400 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560689.387963:0:9501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caec3880400/0x4642c20bf2f33f89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f33f90 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.387969:0:9501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caec3880400/0x4642c20bf2f33f89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f33f90 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560689.387975:0:9501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caec3880400/0x4642c20bf2f33f89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f33f90 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560689.387980:0:9501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787560689.387982:0:9501:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787560689.387984:0:9501:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787560689.387996:0:9501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caec3880400/0x4642c20bf2f33f89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f33f90 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.388002:0:9501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560689.388017:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caec3880400/0x4642c20bf2f33f89 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f33f90 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.388024:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caec3880400/0x4642c20bf2f33f89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f33f90 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.388042:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560689.388044:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560689.388046:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560689.388071:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862852096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787560689.388144:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560689.388195:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787560689.388201:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862852224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787560689.388222:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787560689.388255:0:15385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f338d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f338dd expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.388263:0:15385:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f338d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f338dd expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.388269:0:15385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f338d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f338dd expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.388274:0:15385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f338d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f338dd expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.388286:0:15385:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787560689.388289:0:15385:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:3.0:1787560689.388292:0:15385:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1787560689.388319:0:15385:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1787560689.388322:0:15385:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1787560689.388326:0:15385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787560689.388331:0:15385:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1787560689.388336:0:15385:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9caec3212000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787560689.388347:0:15385:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9caec1ef2000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787560689.388353:0:15385:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9caff31d0000) has exports, disconnecting them 00000020:00080000:3.0:1787560689.388358:0:15385:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9caec3212000), last request at 1787560685 00000020:00000080:3.0:1787560689.388364:0:15385:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33bb5 00000100:00080000:3.0:1787560689.388379:0:15385:0:(import.c:65:import_set_state_nolock()) ffff9caec3217800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787560689.388412:0:9501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560689.388416:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f338d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f338dd expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.388422:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6e00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560689.388425:0:9501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f338d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f338dd expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.388460:0:9501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f338d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f338dd expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560689.388466:0:9501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f338d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f338dd expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560689.388471:0:9501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787560689.388483:0:9501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787560689.388485:0:9501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787560689.388502:0:9501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f338d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f338dd expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.388508:0:9501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560689.388515:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f338d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f338dd expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.388521:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f338d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f338dd expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560689.388540:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560689.388542:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560689.388543:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787560689.388560:0:15385:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9caec3212000): rc 0 00000020:00000080:3.0:1787560689.388563:0:15385:0:(genops.c:885:class_export_put()) final put ffff9caec3212000/lustre-MDT0001-lwp-OST0001_UUID 00010000:00010000:2.0:1787560689.389462:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560689.389481:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862852480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787560689.389534:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560689.389590:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787560689.389597:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862852352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787560689.389618:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560689.389650:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862852096 00000100:00100000:2.0:1787560689.389657:0:9502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862852096 00000100:00100000:2.0:1787560689.389686:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862852224 00000100:00100000:2.0:1787560689.389689:0:9502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862852224 00000100:00100000:2.0:1787560689.389706:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862852480 00000100:00100000:2.0:1787560689.389708:0:9502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862852480 00000100:00100000:2.0:1787560689.389714:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862852352 00000100:00100000:2.0:1787560689.389717:0:9502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862852352 00000100:00100000:2.0:1787560689.389727:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787560689.389736:0:9502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3623:x1874392862852096:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787560689.389742:0:9502:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787560689 with bad export cookie 5062822287694313427 00000100:00100000:2.0:1787560689.389797:0:9502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3623:x1874392862852096:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (1652us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787560689.389805:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787560689.389824:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787560689.389828:0:9502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3623:x1874392862852224:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787560689.389833:0:9502:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787560689 with bad export cookie 5062822287694313427 00000100:00100000:2.0:1787560689.389859:0:9502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3623:x1874392862852224:12345-0@lo:103:ldlm_bl.0 Request processed in 30us (1637us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787560689.389865:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787560689.389876:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787560689.389880:0:9502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3626:x1874392862852480:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787560689.389884:0:9502:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787560689 with bad export cookie 5062822287694313427 00000100:00100000:2.0:1787560689.389912:0:9502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3626:x1874392862852480:12345-0@lo:103:ldlm_bl.0 Request processed in 30us (378us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787560689.389918:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787560689.389930:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787560689.389934:0:9502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3626:x1874392862852352:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787560689.389937:0:9502:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787560689 with bad export cookie 5062822287694313427 00000100:00100000:2.0:1787560689.389961:0:9502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3626:x1874392862852352:12345-0@lo:103:ldlm_bl.0 Request processed in 25us (342us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787560689.389966:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1787560689.389996:0:3623:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.129@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787560689.390000:0:3623:0:(import.c:65:import_set_state_nolock()) ffff9cafd80ef800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1787560689.390004:0:3623:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.129@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:1.0:1787560689.390067:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560689.390115:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787560689.390974:0:15385:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9caec1ef2000), last request at 1787560685 00000020:00000080:3.0:1787560689.390985:0:15385:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33a8f 00000100:00080000:3.0:1787560689.390996:0:15385:0:(import.c:65:import_set_state_nolock()) ffff9caec1ef7800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787560689.391025:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787560689.391040:0:15385:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9caec1ef2000): rc 0 00000020:00000080:3.0:1787560689.391042:0:15385:0:(genops.c:885:class_export_put()) final put ffff9caec1ef2000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1787560689.391050:0:15385:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb6db41a3fae0 00000100:00080000:3.0:1787560689.391071:0:15385:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787560689.391075:0:15385:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000020:00000080:1.0:1787560689.391451:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec3212000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1787560689.391520:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec1ef2000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1787560689.391543:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec3217800 for lustre-MDT0001 00000020:00000080:1.0:1787560689.391548:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec1ef7800 for lustre-MDT0001 00000100:00080000:3.0:1787560689.393225:0:15385:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787560689.393235:0:15385:0:(import.c:65:import_set_state_nolock()) ffff9cafeed1c000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1787560689.393340:0:3626:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.129@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787560689.395991:0:15385:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787560689.395999:0:15385:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:1.0:1787560689.396026:0:15385:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787560689.396088:0:15385:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787560689.396131:0:15385:0:(import.c:65:import_set_state_nolock()) ffff9caffdf75000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787560689.396147:0:15385:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787560689.396150:0:15385:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967299 gen 3 00000004:00080000:1.0:1787560689.396164:0:15385:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787560689.396223:0:15385:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787560689.396232:0:15385:0:(import.c:65:import_set_state_nolock()) ffff9caec2f9d800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1787560689.396267:0:15385:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9caff31d0000) has no exports 00000100:00100000:0.0:1787560689.405388:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3625:x1874392862851968:12345-0@lo:103:ldlm_bl.0 Request processed in 29054us (29169us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787560689.405415:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1787560689.405507:0:3625:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.129@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787560689.426304:0:3623:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.129@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1787560689.426309:0:3623:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787560689.426335:0:3623:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9caec3988000 x1874392862850560/t0(0) o400->MGC192.168.203.129@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787560701 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560689.426349:0:3623:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cafffe4fb80 x1874392862851968/t0(0) o103->MGC192.168.203.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787560705 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560689.426358:0:3623:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cafffe1b480 x1874392862852096/t0(0) o103->MGC192.168.203.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787560705 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560689.426366:0:3623:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cafffe1b100 x1874392862852224/t0(0) o103->MGC192.168.203.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787560705 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560689.426373:0:3623:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cafffe1ad80 x1874392862852480/t0(0) o103->MGC192.168.203.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787560705 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560689.426382:0:3623:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cafffe1b800 x1874392862852352/t0(0) o103->MGC192.168.203.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787560705 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787560689.426389:0:3623:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787560689.426392:0:3623:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787560689.426393:0:3623:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787560689.433353:0:3626:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9cafd80ef800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1787560689.433418:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862852480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787560689.435880:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3626:1874392862852352:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787560689.436006:0:3625:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9cafd80ef800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1787560689.436123:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862852608:0@lo:9:umount.0 00000100:00100000:0.0:1787560689.436213:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560689.436261:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862852736:0@lo:9:umount.0 00000100:00100000:0.0:1787560689.436285:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560689.438364:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862852608 00000100:00100000:0.0:1787560689.438373:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862852608 00000100:00100000:0.0:1787560689.438424:0:10171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862852736 00000100:00100000:0.0:1787560689.438427:0:10171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862852736 00000100:00100000:0.0:1787560689.438782:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787560689.438792:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1874392862852608:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787560689.438821:0:10171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33af1 00000100:00080000:0.0:1787560689.438832:0:10171:0:(import.c:65:import_set_state_nolock()) ffff9caffdf76000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787560689.438876:0:10171:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1787560689.439053:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3622:x1874392862852608:12345-0@lo:9:umount.0 Request processed in 260us (2837us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560689.439061:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787560689.439078:0:10171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787560689.439085:0:10171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1874392862852736:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787560689.439099:0:10171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33c1e 00000100:00080000:0.0:1787560689.439104:0:10171:0:(import.c:65:import_set_state_nolock()) ffff9caec2fc6800 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1787560689.439282:0:3623:0:(import.c:65:import_set_state_nolock()) ffff9cafd80ef800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787560689.439289:0:3623:0:(import.c:510:import_select_connection()) MGC192.168.203.129@tcp: connect to NID 0@lo last attempt 146 00000100:00080000:2.0:1787560689.439297:0:3623:0:(import.c:624:import_select_connection()) MGC192.168.203.129@tcp: import ffff9cafd80ef800 using connection 192.168.203.129@tcp/0@lo 00000100:00080000:2.0:1787560689.439315:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787560689.439706:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3625:1874392862851968:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787560689.439789:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffdf75000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787560689.439797:0:3622:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787560689.439799:0:3622:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787560689.439802:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862852608:0@lo:9:umount.0 00000001:00000004:1.0:1787560689.440129:0:10171:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1787560689.440272:0:10171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3622:x1874392862852736:12345-0@lo:9:umount.0 Request processed in 1187us (3986us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560689.440280:0:10171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1787560689.440313:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec2f9d800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787560689.440324:0:3622:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787560689.440326:0:3622:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787560689.440329:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862852736:0@lo:9:umount.0 00010000:00010000:2.0:1787560689.440766:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560689.440818:0:3623:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffcb09880 x1874392862852864/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787560689.440853:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862852096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787560689.440891:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862850560:0@lo:400:kworker.0 00000100:00100000:2.0:1787560689.440908:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3623:1874392862852224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560689.441000:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3622:1874392862852864:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:1.0:1787560689.441034:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874392862852864 offset 0 length 520: 4 00010000:00010000:0.0:1787560689.441270:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787560689.450957:0:15385:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9caff31d0000) has no exports 00000020:01000000:2.0:1787560689.533831:0:15385:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9caec2f590c0 - data ffff9cb00035f948/ffff9caec2fb9400 00000020:01000000:2.0:1787560689.534011:0:15385:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9caffc9fcd80 - data ffff9cb0000cebd0/ffff9caffc8c0000 00000001:00000004:0.0:1787560689.551892:0:15385:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:1.0:1787560689.594389:0:15385:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787560689.594403:0:15385:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1787560689.594414:0:15385:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1787560689.595835:0:15385:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787560689.595841:0:15385:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:1.0:1787560689.595934:0:15385:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787560689.595937:0:15385:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787560689.596228:0:8601:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787560689.596236:0:8601:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:2.0:1787560689.596249:0:8601:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1787560689.597225:0:15385:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787560689.597232:0:15385:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967299 gen 4 00000004:00080000:1.0:1787560689.597287:0:15385:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787560689.597290:0:15385:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787560689.597626:0:9930:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787560689.597632:0:9930:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:2.0:1787560689.597641:0:9930:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1787560689.601887:0:15385:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f338f9 00000020:00000080:1.0:1787560689.601904:0:15385:0:(genops.c:885:class_export_put()) final put ffff9caffbb0a800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787560689.602371:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caffbb0a800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787560689.618016:0:15385:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f3390e 00000020:00000080:1.0:1787560689.618037:0:15385:0:(genops.c:885:class_export_put()) final put ffff9cafeed1e000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787560689.618099:0:15385:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1787560689.618408:0:15385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787560689.618423:0:15385:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787560689.618451:0:15385:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9caff31d3370) has no exports 00000004:01000000:1.0:1787560689.618740:0:15385:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787560689.618755:0:15385:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33c17 00000020:00000080:1.0:1787560689.618762:0:15385:0:(genops.c:885:class_export_put()) final put ffff9caec2fc7800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787560689.620242:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafeed1e000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1787560689.620420:0:15385:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1787560689.620446:0:15385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787560689.620463:0:15385:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787560689.620468:0:15385:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9cafeabd19b8) has no exports 00000020:00000080:1.0:1787560689.620479:0:15385:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33c10 00000020:00000080:1.0:1787560689.620651:0:15385:0:(genops.c:885:class_export_put()) final put ffff9caec2f9c800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787560689.622453:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec2fc7800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1787560689.622489:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec2f9c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1787560689.625327:0:15385:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1787560689.625338:0:15385:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787560689.625344:0:15385:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967299 gen 5 00000004:00080000:1.0:1787560689.625355:0:15385:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787560689.625359:0:15385:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787560689.625457:0:15385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787560689.625481:0:15385:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787560689.625499:0:15385:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33ad5 00000020:00000080:1.0:1787560689.625511:0:15385:0:(genops.c:885:class_export_put()) final put ffff9cafeab07800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787560689.625520:0:15385:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1787560689.625545:0:15385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787560689.625552:0:15385:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787560689.625557:0:15385:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9caff490cd28) has no exports 00000020:00000080:3.0:1787560689.626744:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec2f9d800 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1787560689.626763:0:36:0:(genops.c:885:class_export_put()) final put ffff9caec2f9c000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787560689.626783:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec2f9c000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1787560689.626794:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787560689.626999:0:15385:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33ace 00000020:00000080:1.0:1787560689.627010:0:15385:0:(genops.c:885:class_export_put()) final put ffff9caffdf77800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787560689.632517:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafeab07800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1787560689.632542:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caffdf77800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1787560689.634058:0:15385:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1787560689.634069:0:15385:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787560689.634074:0:15385:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1787560689.634083:0:15385:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787560689.634086:0:15385:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787560689.634211:0:15385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787560689.634229:0:15385:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1787560689.634252:0:15385:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1787560689.634262:0:15385:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33931 00000020:00000080:1.0:1787560689.634272:0:15385:0:(genops.c:885:class_export_put()) final put ffff9cafefb19800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787560689.634330:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caffdf75000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1787560689.634339:0:36:0:(genops.c:885:class_export_put()) final put ffff9caec1c34000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787560689.634342:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec1c34000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1787560689.634350:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787560689.654734:0:15385:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1787560689.654794:0:15385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787560689.654809:0:15385:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787560689.654816:0:15385:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9cafef9f8000) has no exports 00010000:00010000:2.0:1787560689.654820:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787560689.654830:0:15385:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f3392a 00000020:00000080:1.0:1787560689.654840:0:15385:0:(genops.c:885:class_export_put()) final put ffff9cafeed18000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787560689.655196:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafefb19800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1787560689.655207:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafeed18000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1787560689.661701:0:15385:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1787560689.661712:0:15385:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787560689.661718:0:15385:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1787560689.661730:0:15385:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787560689.661797:0:15385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787560689.661812:0:15385:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787560689.663349:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cafeed1c000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1787560689.663366:0:36:0:(genops.c:885:class_export_put()) final put ffff9cafeed1d800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787560689.663371:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafeed1d800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1787560689.663388:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787560689.663632:0:15385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787560689.663646:0:15385:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787560689.663650:0:15385:0:(genops.c:885:class_export_put()) final put ffff9caffbb0e800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787560689.663653:0:15385:0:(genops.c:844:class_export_destroy()) destroying export ffff9caffbb0e800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1787560689.663662:0:15385:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787560689.664775:0:15385:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33915 00000020:00000080:3.0:1787560689.664789:0:15385:0:(genops.c:885:class_export_put()) final put ffff9cafeed1a800/lustre-MDD0001_UUID 00000020:01000000:3.0:1787560689.664801:0:15385:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1787560689.664806:0:15385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787560689.664815:0:15385:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787560689.664819:0:15385:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9caff31d4d28) has no exports 00000020:00000080:3.0:1787560689.664847:0:15385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787560689.664853:0:15385:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1787560689.664872:0:15385:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f3391c 00000020:00000080:3.0:1787560689.664877:0:15385:0:(genops.c:885:class_export_put()) final put ffff9cafeed19000/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1787560689.664888:0:15385:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9caffba72800 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1787560689.664892:0:15385:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9caffba72800 2 00000020:01000004:3.0:1787560689.664896:0:15385:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9caffba72800 from lustre-MDT0001 00000020:00000080:3.0:1787560689.664921:0:15385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787560689.664925:0:15385:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1787560689.664928:0:15385:0:(genops.c:885:class_export_put()) final put ffff9caffbb09000/lustre-MDT0001_UUID 00000020:00000080:3.0:1787560689.664931:0:15385:0:(genops.c:844:class_export_destroy()) destroying export ffff9caffbb09000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1787560689.664942:0:15385:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1787560689.664983:0:15385:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1787560689.664987:0:15385:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1787560689.664990:0:15385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787560689.664993:0:15385:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787560689.665001:0:15385:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9caffbb0f000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787560689.665007:0:15385:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9cafef9fcd28) has exports, disconnecting them 00000020:00080000:3.0:1787560689.665012:0:15385:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9caffbb0f000), last request at 1787560451 00000020:00000080:3.0:1787560689.665016:0:15385:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33970 00000020:00080000:3.0:1787560689.665030:0:15385:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9caffbb0f000): rc 0 00000020:00000080:3.0:1787560689.665033:0:15385:0:(genops.c:885:class_export_put()) final put ffff9caffbb0f000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1787560689.665241:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafeed1a800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1787560689.665248:0:36:0:(genops.c:885:class_export_put()) final put ffff9caffbb09800/lustre-MDD0001_UUID 00000020:00000080:1.0:1787560689.665250:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caffbb09800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1787560689.665254:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1787560689.666046:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafeed19000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787560689.666054:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caffbb0f000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1787560689.684817:0:15385:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1787560689.684833:0:15385:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787560689.684839:0:15385:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787560689.684850:0:15385:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787560689.684954:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caffbb0b000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1787560689.685187:0:15385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787560689.685198:0:15385:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1787560689.685205:0:15385:0:(genops.c:885:class_export_put()) final put ffff9cafeed18800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1787560689.685209:0:15385:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafeed18800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1787560689.685216:0:15385:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1787560689.685314:0:15385:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9caffba72800 1 00000020:00000080:3.0:1787560689.685333:0:15385:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f338ac 00000020:00000080:3.0:1787560689.685341:0:15385:0:(genops.c:885:class_export_put()) final put ffff9caffba71800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1787560689.685634:0:15385:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1787560689.685641:0:15385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787560689.685648:0:15385:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787560689.685653:0:15385:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9caff324b370) has no exports 00000020:00000080:1.0:1787560689.688650:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caffba71800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787560689.823222:0:15385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787560689.823241:0:15385:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1787560689.823247:0:15385:0:(genops.c:885:class_export_put()) final put ffff9caffba74800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787560689.823252:0:15385:0:(genops.c:844:class_export_destroy()) destroying export ffff9caffba74800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1787560689.823267:0:15385:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1787560689.823406:0:15385:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9caffba70800 00000020:01000000:3.0:1787560689.825370:0:15385:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1787560689.825377:0:15385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787560689.825382:0:15385:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787560689.825386:0:15385:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9cafe06b0000) has no exports 00000100:00100000:0.0:1787560689.832318:0:6498:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9cafe06e9800:6498] 0 exiting: rc = 1 00000100:00100000:0.0:1787560689.832460:0:10172:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9caffb9b3800:10172] 3 exiting: rc = 0 00000100:00100000:0.0:1787560689.832529:0:6499:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9cafe09ab800:6499] 1 exiting: rc = 0 00000100:00100000:3.0:1787560689.832693:0:13787:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9caec3273000:13787] 4 exiting: rc = 0 00000100:00100000:1.0:1787560689.832858:0:6500:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9cafe09ab200:6500] 2 exiting: rc = 0 00000100:00100000:3.0:1787560689.837242:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837257:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837264:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837269:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837276:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837282:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837287:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837294:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837299:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837304:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837309:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837315:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837320:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837326:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837331:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837337:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837341:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837347:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837353:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837359:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837365:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837370:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837376:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837381:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837400:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837406:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837412:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837418:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837424:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837465:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837472:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837478:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837483:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837489:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837495:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837500:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837505:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837510:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837515:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837520:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837526:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837530:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837536:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837541:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837546:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837551:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837557:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837575:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837581:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837586:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837591:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837598:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837603:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837610:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837616:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837622:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837628:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837634:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837639:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837653:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837658:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837664:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837669:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.837684:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.841881:0:6502:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9cafc8748a00:6502] 1 exiting: rc = 0 00000100:00100000:0.0:1787560689.842069:0:6501:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9cafc8749a00:6501] 0 exiting: rc = 1 00000100:00100000:3.0:1787560689.842580:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842589:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842596:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842601:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842607:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842614:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842620:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842626:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842632:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842638:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842644:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842650:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842659:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842664:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842670:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842674:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842679:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842684:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842689:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842694:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842700:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842705:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842710:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842716:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842721:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842726:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842731:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842736:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842742:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842767:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842771:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842777:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842782:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842787:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842793:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842799:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842804:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842810:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842816:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842883:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842893:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842898:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842904:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842909:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842915:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842920:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842927:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842932:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842937:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842955:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842961:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842966:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842972:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842976:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842981:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842986:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842992:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.842997:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.843002:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.843123:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.843132:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.843137:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.843144:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.843150:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.843638:0:6504:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9cafc8748600:6504] 1 exiting: rc = 0 00000100:00100000:1.0:1787560689.843703:0:7734:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9caffc882600:7734] 2 exiting: rc = 0 00000100:00100000:1.0:1787560689.843787:0:6503:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9caff3247400:6503] 0 exiting: rc = 1 00000100:00100000:3.0:1787560689.843913:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.843921:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.843929:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.843934:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.843939:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.843945:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.843951:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.843956:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.843962:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.843968:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.843974:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.843992:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.843999:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.844005:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.847649:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.847657:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.847663:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.847669:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.847675:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.847681:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.847686:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.847692:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.847698:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.847723:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.847731:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.847737:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.847744:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.847750:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.847756:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.847762:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.847768:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.847775:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.847781:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.847786:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.847809:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.848325:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.848333:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.848338:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.848343:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.848349:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.848355:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.848361:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.848367:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.848373:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.848379:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.848384:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.848389:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.848408:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.848414:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.848419:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.848426:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.848460:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.848467:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.848472:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.848479:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.848483:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.848490:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.848496:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.848502:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.848521:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.848528:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.848533:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.848540:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.848547:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560689.872735:0:6506:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9caff3246600:6506] 1 exiting: rc = 0 00000100:00100000:2.0:1787560689.874689:0:6505:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9caff3247200:6505] 0 exiting: rc = 1 00000100:00100000:3.0:1787560689.875539:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875546:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875551:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875556:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875573:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875685:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875690:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875695:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875700:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875706:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875711:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875717:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875722:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875727:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875733:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875738:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875743:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875748:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875754:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875759:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875764:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875769:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875773:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875777:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875782:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875787:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875792:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875797:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875803:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875808:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875812:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875817:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875833:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875839:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875844:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875850:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875854:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875859:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875864:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875869:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875883:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875888:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875893:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875898:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875903:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875908:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875913:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875918:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875922:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875927:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875932:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875937:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875942:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875946:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875951:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875955:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875960:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875965:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875971:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875976:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875981:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875985:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875989:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.875994:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.876962:0:6507:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9caff3247c00:6507] 0 exiting: rc = 1 00000100:00100000:0.0:1787560689.877196:0:6508:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9cafc5a79400:6508] 1 exiting: rc = 0 00000100:00100000:2.0:1787560689.877270:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877276:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877282:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877288:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877293:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877298:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877303:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877308:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877313:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877317:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877322:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877326:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877331:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877336:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877350:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877354:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877359:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877364:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877370:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877375:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877380:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877385:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877391:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877396:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877401:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877406:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877412:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877417:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877422:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877426:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877452:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877459:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877463:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877469:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877475:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877480:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877485:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877490:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877495:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877500:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877506:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877511:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877516:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877521:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877526:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877530:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877535:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877540:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877545:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877556:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877574:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877580:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877585:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877589:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877594:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877598:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877603:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877608:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877613:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877618:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877624:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877629:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877634:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877639:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560689.877975:0:6509:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9cafc5a78200:6509] 0 exiting: rc = 1 00000100:00100000:0.0:1787560689.880278:0:6510:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9cafc6eee200:6510] 1 exiting: rc = 0 00000100:00100000:3.0:1787560689.884783:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.884794:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.884799:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.884804:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.884810:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.884815:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.884821:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.884833:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.884840:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.884845:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.884850:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.884872:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.884879:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.884884:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.884890:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.884895:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.884901:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.884906:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.884911:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.884927:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.884933:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.884939:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.884944:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.884948:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.884953:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.884958:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.884964:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.884970:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.884975:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.884980:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.884986:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.884990:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.884995:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.885000:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.885006:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.886250:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.886256:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.886261:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.886267:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.886273:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.886278:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.886282:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.886287:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.886291:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.886295:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.886300:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.886318:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.886322:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.886327:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.886331:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.886336:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.886340:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.886345:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.886349:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.886354:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.886358:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.886363:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.886367:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.886371:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.886376:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.886380:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.886385:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.886390:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.886395:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560689.887020:0:6511:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9cafc5a79800:6511] 0 exiting: rc = 1 00000100:00100000:3.0:1787560689.888826:0:6512:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9cafc6f70400:6512] 1 exiting: rc = 0 00000100:00100000:2.0:1787560689.890545:0:6513:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9cafc6eef600:6513] 2 exiting: rc = 0 00000100:00100000:3.0:1787560689.894869:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.894883:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.894890:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.894895:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.894900:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.894906:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.894913:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.894929:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.894936:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.894941:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.894946:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.894951:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.894968:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.894973:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.894979:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.894985:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895017:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895025:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895030:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895035:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895042:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895047:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895073:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895079:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895085:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895089:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895095:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895100:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895105:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895110:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895116:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895121:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895126:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895131:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895136:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895141:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895146:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895151:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895156:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895161:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895167:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895172:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895177:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895182:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895187:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895192:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895211:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895218:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895223:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895227:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895234:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895245:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895253:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895258:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895264:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895268:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895274:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895280:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895286:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895290:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895296:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895300:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895305:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560689.895311:0:15385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787560689.903393:0:15385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787560689.903407:0:15385:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1787560689.903413:0:15385:0:(genops.c:885:class_export_put()) final put ffff9cb000813800/MDS_uuid 00000020:00000080:2.0:1787560689.903419:0:15385:0:(genops.c:844:class_export_destroy()) destroying export ffff9cb000813800/MDS_uuid for MDS 00000020:01000000:2.0:1787560689.903448:0:15385:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1787560689.904008:0:15385:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00000100:00080000:0.0:1787560690.237051:0:13868:0:(pinger.c:229:ptlrpc_pinger_process_import()) f30da5a7-84ca-46bc-bf14-dc2a954107e6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787560690.237064:0:13868:0:(pinger.c:247:ptlrpc_pinger_process_import()) f30da5a7-84ca-46bc-bf14-dc2a954107e6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787560690.237069:0:13868:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787560690.237072:0:13868:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787560690.237077:0:13868:0:(import.c:65:import_set_state_nolock()) ffff9caec1ef1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787560690.237087:0:13868:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 404 00000100:00080000:0.0:1787560690.237094:0:13868:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787560690.237102:0:13868:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9caec1ef1800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:0.0:1787560690.237646:0:13868:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafffe4d500 x1874392862852992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787560690.237717:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1874392862852992:0@lo:38:kworker.0 00000400:00000100:3.0:1787560690.237790:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874392862852992 offset 0 length 520: 4 00000100:00080000:0.0:1787560690.239032:0:13868:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787560690.239039:0:13868:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787560690.239043:0:13868:0:(import.c:65:import_set_state_nolock()) ffff9caec2fc0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787560690.239050:0:13868:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 404 00000100:00080000:0.0:1787560690.239056:0:13868:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787560690.239062:0:13868:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9caec2fc0800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:0.0:1787560690.239086:0:13868:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafffe4f480 x1874392862853248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787560690.239158:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874392862853376:0@lo:400:kworker.0 00000400:00000100:0.0:1787560690.239212:0:3624:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874392862853376 offset 0 length 224: 4 00000100:00100000:3.0:1787560690.239403:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1874392862853248:0@lo:38:kworker.0 00000400:00000100:3.0:1787560690.239427:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874392862853248 offset 0 length 520: 4 00000100:00100000:2.0:1787560690.240057:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862853120:0@lo:400:kworker.0 00000400:00000100:2.0:1787560690.240087:0:3623:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874392862853120 offset 0 length 224: 4 00010000:00010000:3.0:1787560690.675852:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560691.703665:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560692.723841:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560693.758715:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787560694.259647:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) f30da5a7-84ca-46bc-bf14-dc2a954107e6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787560694.259656:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) f30da5a7-84ca-46bc-bf14-dc2a954107e6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787560694.259660:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787560694.259664:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787560694.259720:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787560694.259724:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787560694.259768:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862853632:0@lo:400:kworker.0 00000400:00000100:2.0:1787560694.259833:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874392862853632 offset 0 length 224: 4 00000100:00100000:2.0:1787560694.259921:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787560694.259928:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874392862853504:0@lo:400:kworker.0 00000400:00000100:2.0:1787560694.259947:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874392862853504 offset 0 length 224: 4 00010000:00010000:0.0:1787560694.775178:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787560695.227979:0:15587:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1787560695.239732:0:15587:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1787560695.239840:0:15587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f33cf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33cfe expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560695.239854:0:15587:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f33cf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33cfe expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560695.239862:0:15587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f33cf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f33cfe expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560695.239868:0:15587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f33cf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f33cfe expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560695.239894:0:15587:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787560695.239899:0:15587:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787560695.239923:0:15587:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787560695.239933:0:15587:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cafffe4d500 x1874392862852992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787560710 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560695.239948:0:15587:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787560695.239953:0:15587:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787560695.239959:0:15587:0:(import.c:65:import_set_state_nolock()) ffff9caec1ef1800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787560695.239964:0:15587:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787560695.239969:0:15587:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cafffe4d500 x1874392862852992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787560710 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560695.239991:0:15587:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787560695.239995:0:15587:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787560695.240091:0:9500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560695.240098:0:9500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f33cf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f33cfe expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560695.240105:0:9500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbffc00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:2.0:1787560695.240109:0:9500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f33cf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f33cfe expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560695.240118:0:9500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f33cf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f33cfe expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560695.240126:0:9500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f33cf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f33cfe expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560695.240132:0:9500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787560695.240135:0:9500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787560695.240138:0:9500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787560695.240154:0:9500:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cafd80ef800 00010000:00010000:2.0:1787560695.240158:0:9500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f33cf7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x4642c20bf2f33cfe expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560695.240175:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f33cf7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x4642c20bf2f33cfe expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560695.240189:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560695.240191:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560695.240193:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560695.240263:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1874392862852992:0@lo:38:kworker.0 00000100:00080000:1.0:1787560695.243953:0:15587:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787560695.243968:0:15587:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cafffe4c700 x1874392862853120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560706 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560695.244179:0:15587:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9caffcb0b800 x1874392862853504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560710 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560695.244206:0:15587:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787560695.244213:0:15587:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787560695.244236:0:15587:0:(import.c:65:import_set_state_nolock()) ffff9caec1c32800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787560695.244815:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3622:1874392862853760:0@lo:39:umount.0 00000400:00000100:0.0:1787560695.244864:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874392862853760 offset 0 length 224: 4 00000100:00100000:3.0:1787560695.245233:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874392862853504:0@lo:400:kworker.0 00000100:00100000:2.0:1787560695.245354:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862853120:0@lo:400:kworker.0 00000100:00080000:2.0:1787560695.283545:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) f30da5a7-84ca-46bc-bf14-dc2a954107e6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787560695.283555:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) f30da5a7-84ca-46bc-bf14-dc2a954107e6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787560695.283558:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787560695.283561:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787560695.283669:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787560695.283741:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874392862853888:0@lo:400:kworker.0 00000400:00000100:3.0:1787560695.283793:0:3624:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874392862853888 offset 0 length 224: 4 00010000:00010000:0.0:1787560695.797146:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787560695.863343:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787560695.863351:0:8407:0:(genops.c:885:class_export_put()) final put ffff9caffdf74800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787560695.863478:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caffdf74800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787560695.863541:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caffdf76000 for lustre-OST0000 00000001:00100000:3.0:1787560695.863701:0:9491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787560695.863705:0:9491:0:(genops.c:885:class_export_put()) final put ffff9caec2fc7000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787560695.866206:0:15403:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec2fc7000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787560695.866270:0:15403:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec2fc6800 for lustre-OST0001 00010000:00010000:2.0:1787560696.819605:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560697.843723:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560698.870271:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560699.379578:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560689/real 1787560689] req@ffff9caffcb09880 x1874392862852864/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787560699 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560699.379611:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9caffcb09880 x1874392862852864/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787560699 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787560699.379632:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafd80ef800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787560699.379659:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1787560699.379663:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3622:1874392862852864:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:1.0:1787560699.379770:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) f30da5a7-84ca-46bc-bf14-dc2a954107e6->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787560699.379775:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1787560699.379778:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cafd80ef800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787560699.379783:0:36:0:(import.c:510:import_select_connection()) MGC192.168.203.129@tcp: connect to NID 0@lo last attempt 408 00000100:00080000:1.0:1787560699.379788:0:36:0:(import.c:589:import_select_connection()) MGC192.168.203.129@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787560699.379794:0:36:0:(import.c:624:import_select_connection()) MGC192.168.203.129@tcp: import ffff9cafd80ef800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1787560699.379824:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafeab11500 x1874392862854016/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787560699.379855:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787560699.379859:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787560699.379993:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787560699.380019:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862854144:0@lo:400:kworker.0 00000400:00000100:2.0:1787560699.380065:0:3623:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874392862854144 offset 0 length 224: 4 00000100:00100000:0.0:1787560699.380304:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3622:1874392862854016:0@lo:250:kworker.0 00000400:00000100:0.0:1787560699.380341:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874392862854016 offset 0 length 520: 4 00010000:00010000:0.0:1787560699.891991:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560700.915637:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560701.941118:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560702.965964:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560703.989081:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787560704.563668:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) f30da5a7-84ca-46bc-bf14-dc2a954107e6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787560704.563678:0:15403:0:(pinger.c:247:ptlrpc_pinger_process_import()) f30da5a7-84ca-46bc-bf14-dc2a954107e6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787560704.564050:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787560704.564054:0:15403:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787560704.564167:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874392862854272:0@lo:400:kworker.0 00000400:00000100:1.0:1787560704.564232:0:3625:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874392862854272 offset 0 length 224: 4 00010000:00010000:2.0:1787560705.011581:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560705.525990:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560695/real 1787560695] req@ffff9cafeab10e00 x1874392862853760/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787560705 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560705.526070:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cafeab10e00 x1874392862853760/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787560705 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787560705.526089:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec1c32800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787560705.526111:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3622:1874392862853760:0@lo:39:umount.0 00000100:00080000:1.0:1787560705.526480:0:15587:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787560705.526485:0:15587:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787560705.526490:0:15587:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787560705.527727:0:15587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc0031600/0x4642c20bf2f33d05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33d0c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560705.527743:0:15587:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc0031600/0x4642c20bf2f33d05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33d0c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560705.527750:0:15587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc0031600/0x4642c20bf2f33d05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f33d0c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560705.527758:0:15587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9cafc0031600/0x4642c20bf2f33d05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f33d0c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560705.527773:0:15587:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787560705.527780:0:15587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3881400/0x4642c20bf2f33f7b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33f82 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560705.527787:0:15587:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3881400/0x4642c20bf2f33f7b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33f82 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560705.527793:0:15587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3881400/0x4642c20bf2f33f7b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f33f82 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560705.527800:0:15587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9caec3881400/0x4642c20bf2f33f7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f33f82 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560705.527821:0:15587:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787560705.527825:0:15587:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1787560705.527894:0:15587:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1787560705.527899:0:15587:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1787560705.527903:0:15587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787560705.527908:0:15587:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787560705.527913:0:15587:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9cafef9f99b8) has no exports 00000020:00080000:1.0:1787560705.527951:0:15587:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9cafef9f99b8) has no exports 00010000:00010000:0.0:1787560705.528488:0:9501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787560705.528495:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cafc0031600/0x4642c20bf2f33d05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f33d0c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560705.528512:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafc0031600 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:0.0:1787560705.528517:0:9501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cafc0031600/0x4642c20bf2f33d05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f33d0c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560705.528525:0:9501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cafc0031600/0x4642c20bf2f33d05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f33d0c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787560705.528533:0:9501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cafc0031600/0x4642c20bf2f33d05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f33d0c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560705.528539:0:9501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787560705.528541:0:9501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1787560705.528544:0:9501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1787560705.528557:0:9501:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cafd80ef800 00010000:00010000:0.0:1787560705.528561:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cafc0031600/0x4642c20bf2f33d05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x4642c20bf2f33d0c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560705.528575:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cafc0031600/0x4642c20bf2f33d05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x4642c20bf2f33d0c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560705.528589:0:9501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560705.528592:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caec3881400/0x4642c20bf2f33f7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f33f82 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560705.528598:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881400 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:0.0:1787560705.528601:0:9501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caec3881400/0x4642c20bf2f33f7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f33f82 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560705.528608:0:9501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caec3881400/0x4642c20bf2f33f7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f33f82 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787560705.528614:0:9501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caec3881400/0x4642c20bf2f33f7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f33f82 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560705.528618:0:9501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787560705.528620:0:9501:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787560705.528622:0:9501:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787560705.528626:0:9501:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cafd80ef800 00010000:00010000:0.0:1787560705.528629:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caec3881400/0x4642c20bf2f33f7b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4642c20bf2f33f82 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560705.528635:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caec3881400/0x4642c20bf2f33f7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4642c20bf2f33f82 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560705.528642:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560705.528644:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560705.528652:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560705.528997:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787560705.531925:0:15587:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cafc8ac1a80 - data ffff9cb000284ca8/ffff9caec2f52800 00000020:01000000:1.0:1787560705.533063:0:15587:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9caec2077f60 - data ffff9cb00027e1b0/ffff9caffcb78400 00100000:10000000:0.0:1787560705.555068:0:15587:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787560705.567550:0:15587:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33a49 00000020:00000080:2.0:1787560705.567563:0:15587:0:(genops.c:885:class_export_put()) final put ffff9caec1c40800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787560705.567583:0:15403:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec1c40800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:2.0:1787560705.567607:0:15587:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cafeab05000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1787560705.567611:0:15587:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cafeab05000 2 00000020:01000004:2.0:1787560705.567615:0:15587:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cafeab05000 from lustre-OST0000 00000020:00000080:2.0:1787560705.567638:0:15587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787560705.567648:0:15587:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1787560705.567651:0:15587:0:(genops.c:885:class_export_put()) final put ffff9cafef9bf000/lustre-OST0000_UUID 00000020:00000080:2.0:1787560705.567653:0:15587:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafef9bf000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1787560705.567660:0:15587:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787560705.567718:0:15587:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1787560705.567723:0:15587:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787560705.567727:0:15587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787560705.567731:0:15587:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787560705.567738:0:15587:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9caec1c30800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787560705.567744:0:15587:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9caffb990000) has exports, disconnecting them 00000020:00080000:2.0:1787560705.567749:0:15587:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9caec1c30800), last request at 1787560470 00000020:00000080:2.0:1787560705.567753:0:15587:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33a73 00000020:00080000:2.0:1787560705.567763:0:15587:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9caec1c30800): rc 0 00000020:00000080:2.0:1787560705.567767:0:15587:0:(genops.c:885:class_export_put()) final put ffff9caec1c30800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787560705.567791:0:15403:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec1c30800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1787560705.569195:0:15587:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787560705.569202:0:15587:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787560705.569206:0:15587:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787560705.569212:0:15587:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787560705.569413:0:15587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787560705.569419:0:15587:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1787560705.569424:0:15587:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787560705.569427:0:15587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787560705.569446:0:15587:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787560705.569461:0:15587:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9caec1c36000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787560705.569468:0:15587:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff9caff3248000) has exports, disconnecting them 00000020:00080000:3.0:1787560705.569472:0:15587:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9caec1c36000), last request at 1787560470 00000020:00000080:3.0:1787560705.569475:0:15587:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33a88 00000020:00080000:3.0:1787560705.569485:0:15587:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9caec1c36000): rc 0 00000020:00000080:3.0:1787560705.569490:0:15587:0:(genops.c:885:class_export_put()) final put ffff9caec1c36000/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1787560705.572332:0:15403:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec1ef1800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787560705.572346:0:15403:0:(genops.c:885:class_export_put()) final put ffff9caffdf71800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1787560705.572348:0:15403:0:(genops.c:844:class_export_destroy()) destroying export ffff9caffdf71800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1787560705.572356:0:15403:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1787560705.574182:0:15403:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec1c36000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1787560705.579875:0:15587:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787560705.579885:0:15587:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787560705.579889:0:15587:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787560705.579896:0:15587:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787560705.579920:0:15403:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec1c32800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1787560705.580115:0:15587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787560705.580124:0:15587:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1787560705.580130:0:15587:0:(genops.c:885:class_export_put()) final put ffff9caec1c37000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1787560705.580133:0:15587:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec1c37000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1787560705.580141:0:15587:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1787560705.580200:0:15587:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cafeab05000 1 00000020:00000080:0.0:1787560705.580206:0:15587:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33a11 00000020:00000080:0.0:1787560705.580212:0:15587:0:(genops.c:885:class_export_put()) final put ffff9caffca19000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1787560705.580219:0:15587:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787560705.580226:0:15403:0:(genops.c:844:class_export_destroy()) destroying export ffff9caffca19000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787560705.580234:0:15587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787560705.580238:0:15587:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787560705.580242:0:15587:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9caffb993370) has no exports 00000020:00000080:0.0:1787560705.644442:0:15587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787560705.644464:0:15587:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787560705.644469:0:15587:0:(genops.c:885:class_export_put()) final put ffff9cafeab01000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787560705.644474:0:15587:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafeab01000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787560705.644493:0:15587:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787560705.644620:0:15587:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9cafeab02000 00000020:02000400:0.0:1787560705.644666:0:15587:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1787560706.039168:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1787560706.483545:0:3624:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560690/real 1787560690] req@ffff9cafffe4e300 x1874392862853376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787560706 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560706.519590:0:3624:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9cafffe4e300 x1874392862853376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787560706 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787560706.519606:0:3624:0:(import.c:65:import_set_state_nolock()) ffff9caffca5a000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787560706.519610:0:3624:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787560706.546276:0:3624:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:3.0:1787560706.548549:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874392862853376:0@lo:400:kworker.0 00000100:00080000:1.0:1787560706.552669:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) f30da5a7-84ca-46bc-bf14-dc2a954107e6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787560706.552681:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) f30da5a7-84ca-46bc-bf14-dc2a954107e6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787560706.552684:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787560706.552687:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787560706.552690:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787560706.552694:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787560706.552698:0:36:0:(import.c:65:import_set_state_nolock()) ffff9caffca5a000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787560706.552705:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 212 00000100:00080000:1.0:1787560706.552714:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9caffca5a000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1787560706.552752:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafeab13800 x1874392862854400/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787560706.552869:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3622:1874392862854400:0@lo:38:kworker.0 00000400:00000100:3.0:1787560706.552923:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874392862854400 offset 0 length 520: 4 00010000:00010000:3.0:1787560707.072691:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560708.084730:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560709.107635:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787560710.096572:0:15789:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1787560710.111550:0:15789:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1787560710.111646:0:15789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc0031000/0x4642c20bf2f33cdb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33ce2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560710.111674:0:15789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc0031000/0x4642c20bf2f33cdb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33ce2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560710.111681:0:15789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc0031000/0x4642c20bf2f33cdb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f33ce2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560710.111689:0:15789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9cafc0031000/0x4642c20bf2f33cdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f33ce2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560710.111717:0:15789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787560710.111723:0:15789:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787560710.111746:0:15789:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787560710.111757:0:15789:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cafffe4f480 x1874392862853248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787560710 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560710.111773:0:15789:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787560710.111805:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec2fc0800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787560710.111818:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:3.0:1787560710.111822:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1874392862853248:0@lo:38:kworker.0 00000100:00080000:3.0:1787560710.111850:0:15789:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787560710.111855:0:15789:0:(import.c:65:import_set_state_nolock()) ffff9caec2fc0800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1787560710.111859:0:15789:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787560710.111861:0:15789:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787560710.111865:0:15789:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787560710.112575:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560710.112584:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cafc0031000/0x4642c20bf2f33cdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f33ce2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560710.112593:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafc0031000 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:0.0:1787560710.112597:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cafc0031000/0x4642c20bf2f33cdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f33ce2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560710.112607:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cafc0031000/0x4642c20bf2f33cdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f33ce2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787560710.112614:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cafc0031000/0x4642c20bf2f33cdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f33ce2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560710.112619:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787560710.112622:0:6488:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787560710.112625:0:6488:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787560710.112638:0:6488:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cafd80ef800 00010000:00010000:0.0:1787560710.112642:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cafc0031000/0x4642c20bf2f33cdb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4642c20bf2f33ce2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560710.112649:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cafc0031000/0x4642c20bf2f33cdb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4642c20bf2f33ce2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560710.112660:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560710.112661:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560710.112663:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787560710.112682:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) f30da5a7-84ca-46bc-bf14-dc2a954107e6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787560710.112687:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) f30da5a7-84ca-46bc-bf14-dc2a954107e6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787560710.112689:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787560710.112692:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787560710.115240:0:15789:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787560710.115259:0:15789:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9caffcb0a300 x1874392862853632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560710 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560710.115286:0:15789:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9caffcb0a680 x1874392862853888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560711 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560710.115304:0:15789:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cafeab10a80 x1874392862854144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560715 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560710.115320:0:15789:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cafffe4d500 x1874392862854272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560720 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560710.115363:0:15789:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cafeab13800 x1874392862854400/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787560716 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560710.115373:0:15789:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:2.0:1787560710.115402:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862854144:0@lo:400:kworker.0 00000100:00080000:2.0:1787560710.115545:0:15789:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787560710.115551:0:15789:0:(import.c:65:import_set_state_nolock()) ffff9caffca5a000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1787560710.115558:0:15789:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787560710.115563:0:15789:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9caffcb0a300 x1874392862853632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560710 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560710.115572:0:15789:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9caffcb0a680 x1874392862853888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560711 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560710.115579:0:15789:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cafffe4d500 x1874392862854272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560720 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560710.115586:0:15789:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cafeab13800 x1874392862854400/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787560716 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560710.115593:0:15789:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787560710.115596:0:15789:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00000100:00100000:3.0:1787560710.115739:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874392862853888:0@lo:400:kworker.0 00000100:00100000:3.0:1787560710.115767:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3622:1874392862854400:0@lo:38:kworker.0 00000100:00100000:0.0:1787560710.115846:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862853632:0@lo:400:kworker.0 00000100:00100000:0.0:1787560710.116484:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874392862854272:0@lo:400:kworker.0 00010000:00010000:2.0:1787560710.117760:0:15789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc0030600/0x4642c20bf2f33ce9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33cf0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560710.117775:0:15789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc0030600/0x4642c20bf2f33ce9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33cf0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560710.117782:0:15789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc0030600/0x4642c20bf2f33ce9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f33cf0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560710.117788:0:15789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9cafc0030600/0x4642c20bf2f33ce9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f33cf0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560710.117825:0:15789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787560710.117832:0:15789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33f6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f33f74 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560710.117839:0:15789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33f6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f33f74 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560710.117844:0:15789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33f6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f33f74 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560710.117849:0:15789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33f6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f33f74 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560710.117858:0:15789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787560710.117862:0:15789:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1787560710.117891:0:15789:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1787560710.117894:0:15789:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1787560710.117898:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787560710.117903:0:15789:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787560710.117907:0:15789:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9caec2d019b8) has no exports 00000020:00080000:2.0:1787560710.117930:0:15789:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9caec2d019b8) has no exports 00010000:00010000:3.0:1787560710.118294:0:9501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787560710.118301:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cafc0030600/0x4642c20bf2f33ce9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f33cf0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560710.118309:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafc0030600 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560710.118313:0:9501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cafc0030600/0x4642c20bf2f33ce9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f33cf0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560710.118322:0:9501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cafc0030600/0x4642c20bf2f33ce9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f33cf0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560710.118329:0:9501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cafc0030600/0x4642c20bf2f33ce9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f33cf0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560710.118334:0:9501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787560710.118336:0:9501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1787560710.118339:0:9501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1787560710.118361:0:9501:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cafd80ef800 00010000:00010000:3.0:1787560710.118365:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cafc0030600/0x4642c20bf2f33ce9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4642c20bf2f33cf0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560710.118372:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cafc0030600/0x4642c20bf2f33ce9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4642c20bf2f33cf0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560710.118384:0:9501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560710.118387:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33f6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f33f74 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560710.118392:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6200 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560710.118395:0:9501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33f6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f33f74 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560710.118408:0:9501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33f6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f33f74 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560710.118415:0:9501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33f6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f33f74 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560710.118428:0:9501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787560710.118466:0:9501:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787560710.118468:0:9501:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787560710.118474:0:9501:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cafd80ef800 00010000:00010000:3.0:1787560710.118477:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33f6d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4642c20bf2f33f74 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560710.118483:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f33f6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4642c20bf2f33f74 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560710.118496:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560710.118498:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560710.118499:0:9501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560710.118665:0:6487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787560710.121236:0:15789:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cafefb6f120 - data ffff9cb000189870/ffff9caec2f51400 00000020:01000000:2.0:1787560710.121614:0:15789:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cafefb23c00 - data ffff9cb0002c6798/ffff9caec2c8e400 00010000:00010000:2.0:1787560710.131569:0:9500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1787560710.138045:0:15789:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787560710.150633:0:15789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33b6f 00000020:00000080:3.0:1787560710.150646:0:15789:0:(genops.c:885:class_export_put()) final put ffff9cafffe04000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1787560710.150664:0:15789:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9caec1ef6000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1787560710.150667:0:15789:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9caec1ef6000 2 00000020:01000004:3.0:1787560710.150671:0:15789:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9caec1ef6000 from lustre-OST0001 00000020:00000080:3.0:1787560710.150699:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787560710.150708:0:15789:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1787560710.150711:0:15789:0:(genops.c:885:class_export_put()) final put ffff9cafffe04800/lustre-OST0001_UUID 00000020:00000080:3.0:1787560710.150714:0:15789:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafffe04800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1787560710.150722:0:15789:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1787560710.150826:0:15789:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import f30da5a7-84ca-46bc-bf14-dc2a954107e6->MGS 00010000:00010000:3.0:1787560710.150849:0:15789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6c00/0x4642c20bf2f338c8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f338cf expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560710.150862:0:15789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6c00/0x4642c20bf2f338c8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f338cf expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560710.150868:0:15789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1787560710.150871:0:15789:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1787560710.150875:0:15789:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1787560710.150889:0:15789:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cafd80ef800 00010000:00010000:3.0:1787560710.150893:0:15789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6c00/0x4642c20bf2f338c8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4642c20bf2f338cf expref: -99 pid: 7428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560710.150910:0:15789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f33d4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f33d52 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560710.150917:0:15789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f33d4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f33d52 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560710.150922:0:15789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787560710.150925:0:15789:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1787560710.150926:0:15789:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1787560710.150943:0:15789:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cafd80ef800 00010000:00010000:3.0:1787560710.150947:0:15789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f33d4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4642c20bf2f33d52 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787560710.150976:0:15789:0:(import.c:65:import_set_state_nolock()) ffff9cafd80ef800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1787560710.150979:0:15789:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787560710.150981:0:15789:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787560710.150982:0:15789:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787560710.150986:0:15789:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787560710.150996:0:15789:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cafeab11500 x1874392862854016/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787560714 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787560710.151016:0:15789:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787560710.151019:0:15789:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000020:00000080:1.0:1787560710.151087:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafffe04000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:2.0:1787560710.151191:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f30da5a7-84ca-46bc-bf14-dc2a954107e6:3622:1874392862854016:0@lo:250:kworker.0 10000000:01000000:3.0:1787560710.151465:0:15789:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787560710.151473:0:15789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f337c5 00000020:00000080:3.0:1787560710.151479:0:15789:0:(genops.c:885:class_export_put()) final put ffff9cafd80eb800/f30da5a7-84ca-46bc-bf14-dc2a954107e6 00000020:01000000:3.0:1787560710.151489:0:15789:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.129@tcp (flags='') 00000020:00000080:3.0:1787560710.151494:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787560710.151500:0:15789:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.129@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787560710.151504:0:15789:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9cafe06b3370) has no exports 00000020:00000080:1.0:1787560710.151570:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafd80eb800/f30da5a7-84ca-46bc-bf14-dc2a954107e6 for MGC192.168.203.129@tcp 10000000:01000000:2.0:1787560710.151624:0:6497:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1787560710.151693:0:15789:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.129@tcp: client import never connected 00000100:00080000:1.0:1787560710.151697:0:15789:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1787560710.151699:0:15789:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787560710.151701:0:15789:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1787560710.151703:0:15789:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787560710.151751:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787560710.151757:0:15789:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.129@tcp (uuid f30da5a7-84ca-46bc-bf14-dc2a954107e6) 00000020:01000000:1.0:1787560710.151762:0:15789:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787560710.151765:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787560710.151768:0:15789:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787560710.151772:0:15789:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9caec2fc3800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787560710.151778:0:15789:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff9caec2fb0000) has exports, disconnecting them 00000020:00080000:1.0:1787560710.151782:0:15789:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9caec2fc3800), last request at 1787560493 00000020:00000080:1.0:1787560710.151786:0:15789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33b99 00000020:00080000:1.0:1787560710.151797:0:15789:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9caec2fc3800): rc 0 00000020:00000080:1.0:1787560710.151801:0:15789:0:(genops.c:885:class_export_put()) final put ffff9caec2fc3800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787560710.154606:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cafd80ef800 for MGC192.168.203.129@tcp 00000020:00000080:2.0:1787560710.154625:0:8:0:(genops.c:885:class_export_put()) final put ffff9cafd80ed800/f30da5a7-84ca-46bc-bf14-dc2a954107e6 00000020:00000080:2.0:1787560710.154644:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafd80ed800/f30da5a7-84ca-46bc-bf14-dc2a954107e6 for MGC192.168.203.129@tcp 00000020:01000000:2.0:1787560710.154653:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.129@tcp (f30da5a7-84ca-46bc-bf14-dc2a954107e6) 00000020:00000080:2.0:1787560710.154936:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec2fc3800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1787560710.156091:0:15789:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787560710.156097:0:15789:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787560710.156102:0:15789:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787560710.156108:0:15789:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787560710.156277:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787560710.156286:0:15789:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1787560710.156293:0:15789:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787560710.156299:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787560710.156304:0:15789:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787560710.156310:0:15789:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9caffdfe9000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787560710.156316:0:15789:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff9caff49099b8) has exports, disconnecting them 00000020:00080000:2.0:1787560710.156321:0:15789:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9caffdfe9000), last request at 1787560493 00000020:00000080:2.0:1787560710.156326:0:15789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33bae 00000020:00080000:2.0:1787560710.156342:0:15789:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9caffdfe9000): rc 0 00000020:00000080:2.0:1787560710.156347:0:15789:0:(genops.c:885:class_export_put()) final put ffff9caffdfe9000/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1787560710.157023:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec2fc0800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787560710.157031:0:8:0:(genops.c:885:class_export_put()) final put ffff9caec21ef000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1787560710.157034:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec21ef000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1787560710.157039:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1787560710.157097:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9caffdfe9000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1787560710.163545:0:15789:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1787560710.163555:0:15789:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787560710.163559:0:15789:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787560710.163567:0:15789:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787560710.163600:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caffca5a000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1787560710.178493:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1787560710.178640:0:9501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1787560710.178758:0:6487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:2.0:1787560710.189828:0:9500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:1.0:1787560710.190324:0:6482:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9cafd08d0e00:6482] 0 exiting: rc = 1 00000100:00100000:3.0:1787560710.190814:0:6483:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9cafd08d1e00:6483] 1 exiting: rc = 0 00000100:00100000:2.0:1787560710.190917:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.191379:0:6485:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9caff80a5e00:6485] 1 exiting: rc = 0 00000100:00100000:3.0:1787560710.191517:0:9502:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9caffc887600:9502] 3 exiting: rc = 0 00000100:00100000:0.0:1787560710.191665:0:6486:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9cafc52f8000:6486] 2 exiting: rc = 0 00000100:00100000:1.0:1787560710.191826:0:6484:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9cafd08d1400:6484] 0 exiting: rc = 1 00000100:00100000:2.0:1787560710.191900:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.191908:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.191914:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.191920:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192056:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192065:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192070:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192077:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192083:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192089:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192109:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192115:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192120:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192126:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192132:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192138:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192143:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192148:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192153:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192159:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192165:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192170:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192175:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192180:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192185:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192190:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192195:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192201:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192205:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192210:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192215:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192221:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192225:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192230:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192235:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192240:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192245:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192251:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192256:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192261:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192266:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192271:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192276:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192282:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192287:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192301:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192307:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192312:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192317:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192323:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192328:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192333:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192338:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192342:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192348:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192353:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192358:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192362:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192367:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192372:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192378:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192382:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192387:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.192399:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787560710.193738:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787560710.193749:0:15789:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1787560710.193755:0:15789:0:(genops.c:885:class_export_put()) final put ffff9caec1c40000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1787560710.193760:0:15789:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec1c40000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1787560710.193765:0:15789:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1787560710.193821:0:15789:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9caec1ef6000 1 00000020:00000080:3.0:1787560710.193828:0:15789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f33b3e 00000020:00000080:3.0:1787560710.193833:0:15789:0:(genops.c:885:class_export_put()) final put ffff9cafeed19800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1787560710.193851:0:15789:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1787560710.193856:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787560710.193861:0:15789:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787560710.193864:0:15789:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9caffb994d28) has no exports 00000020:00000080:2.0:1787560710.195529:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafeed19800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787560710.227637:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787560710.227652:0:15789:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1787560710.227657:0:15789:0:(genops.c:885:class_export_put()) final put ffff9caec1ef3800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1787560710.227661:0:15789:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec1ef3800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1787560710.227673:0:15789:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1787560710.227979:0:15789:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9caec1ef7000 00000020:01000000:0.0:1787560710.228000:0:15789:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1787560710.228005:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787560710.228009:0:15789:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787560710.228013:0:15789:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9cafeabd4d28) has no exports 00000020:00000080:0.0:1787560710.228032:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787560710.228037:0:15789:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1787560710.228040:0:15789:0:(genops.c:885:class_export_put()) final put ffff9caffc902800/OSS_uuid 00000020:00000080:0.0:1787560710.228042:0:15789:0:(genops.c:844:class_export_destroy()) destroying export ffff9caffc902800/OSS_uuid for OSS 00000020:01000000:0.0:1787560710.228048:0:15789:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1787560710.228126:0:8415:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9caffc8bb400:8415] 2 exiting: rc = 0 00000100:00080000:2.0:1787560710.228333:0:6495:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1787560710.228488:0:8412:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9caffba85400:8412] 0 exiting: rc = 1 00000100:00100000:1.0:1787560710.230243:0:8414:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9cafd9bb4a00:8414] 1 exiting: rc = 0 00000100:00100000:1.0:1787560710.230320:0:10171:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9caec1777600:10171] 3 exiting: rc = 0 00000100:00100000:3.0:1787560710.230692:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230701:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230708:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230713:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230719:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230724:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230729:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230734:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230740:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230746:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230751:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230757:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230762:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230767:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230772:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230777:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230782:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230787:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230792:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230797:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230803:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230808:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230813:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230818:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230823:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230829:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230835:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230840:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230859:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230864:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230869:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230874:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230879:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230884:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230889:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230894:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230899:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230904:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230909:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230914:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230990:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.230998:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.231003:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.231008:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.231013:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.231018:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.231023:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.231029:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.231034:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.231039:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.231051:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.231057:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.231063:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.231068:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.231072:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.231077:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.231082:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.231087:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.231092:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.231097:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.231102:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.231108:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.231112:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.231125:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.232491:0:10128:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9caec2caf000:10128] 2 exiting: rc = 0 00000100:00100000:0.0:1787560710.232818:0:8417:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9caffc883c00:8417] 1 exiting: rc = 0 00000100:00100000:1.0:1787560710.233237:0:8416:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9caffc882000:8416] 0 exiting: rc = 1 00000100:00100000:2.0:1787560710.233329:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233340:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233426:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233581:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233587:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233592:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233598:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233604:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233609:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233613:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233619:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233624:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233628:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233647:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233653:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233658:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233665:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233669:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233674:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233680:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233685:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233690:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233695:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233701:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233706:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233711:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233716:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233721:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233726:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233731:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233736:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233741:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233745:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233751:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233756:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233762:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233767:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233772:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233777:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233782:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233787:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233792:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233798:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233803:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233809:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233814:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233819:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233824:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233838:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233842:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233848:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233853:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233858:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233863:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233869:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233874:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233879:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233885:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233890:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233895:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233899:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233904:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.233908:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.238031:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.242808:0:8418:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9caffc832800:8418] 0 exiting: rc = 1 00000100:00100000:1.0:1787560710.243729:0:8420:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9caffc832200:8420] 2 exiting: rc = 0 00000100:00100000:0.0:1787560710.244740:0:8419:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9caffc832c00:8419] 1 exiting: rc = 0 00000100:00100000:3.0:1787560710.245811:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.245820:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.245825:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.245832:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.245842:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.245848:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.245854:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.245859:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.245864:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.245869:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.245875:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.245891:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.245898:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.245904:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.245910:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.245915:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.245920:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.245925:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.245931:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.245936:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.245942:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.245957:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.245965:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.245971:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.245978:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.245983:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.245989:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.245994:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.245999:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246005:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246010:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246016:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246021:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246039:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246045:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246063:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246069:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246075:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246080:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246085:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246091:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246096:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246102:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246108:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246114:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246119:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246125:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246130:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246135:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246140:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246146:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246152:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246158:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246163:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246168:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246183:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246191:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246196:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246202:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246215:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246222:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246227:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246232:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.246244:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560710.256515:0:8422:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9cafef9d9600:8422] 1 exiting: rc = 0 00000100:00100000:1.0:1787560710.264115:0:8421:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9cafef9d9e00:8421] 0 exiting: rc = 1 00000100:00100000:0.0:1787560710.264284:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264292:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264310:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264315:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264321:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264326:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264332:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264337:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264342:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264347:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264352:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264356:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264362:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264367:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264372:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264377:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264382:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264387:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264393:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264398:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264403:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264409:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264414:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264565:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264573:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264579:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264584:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264590:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264595:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264600:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264606:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264611:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264616:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264621:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264627:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264632:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264638:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264652:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264658:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264663:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264668:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264672:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264677:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264682:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264687:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264691:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264696:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264701:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264706:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264711:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264716:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264722:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264727:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264732:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264737:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264741:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264746:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264751:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264755:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264760:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264765:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264770:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264775:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560710.264780:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560710.267358:0:8423:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9caffc887c00:8423] 0 exiting: rc = 1 00000100:00100000:3.0:1787560710.269211:0:8424:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9caffc886200:8424] 1 exiting: rc = 0 00000100:00100000:1.0:1787560710.269493:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269504:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269510:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269515:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269522:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269542:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269550:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269555:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269562:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269568:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269584:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269589:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269594:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269601:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269607:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269613:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269620:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269639:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269647:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269653:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269659:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269664:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269670:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269675:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269680:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269686:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269691:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269696:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269702:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269723:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269730:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269737:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269742:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269747:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269753:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269758:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269764:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269770:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269774:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269779:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269784:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269802:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269809:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269815:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269821:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269833:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269839:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269845:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269851:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269857:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269863:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269868:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269873:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269895:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269902:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269908:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269914:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269932:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269939:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.269944:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.270057:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.270064:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.270071:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560710.270084:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1787560710.290354:0:15789:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1787560730.057462:0:16552:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787560742.346655:0:17152:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787560742.346660:0:17152:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1787560742.346662:0:17152:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787560742.346769:0:17152:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9caffff56000 00000020:01000004:2.0:1787560742.346783:0:17152:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787560742.346790:0:17152:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787560742.346802:0:17152:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9caff490b370) 00000020:00000080:2.0:1787560742.346838:0:17152:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787560742.420284:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787560742.423633:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787560742.424165:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1787560742.427242:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787560742.427528:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1787560742.427830:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787560742.428075:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1787560742.428349:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1787560742.428710:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1787560742.428908:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787560742.429104:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787560742.429365:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1787560742.432533:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1787560742.433480:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1787560742.433874:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1787560742.434140:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1787560742.434400:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1787560742.434724:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1787560742.434966:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1787560742.435180:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1787560742.435390:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1787560742.437272:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1787560742.437625:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1787560742.437995:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1787560742.438235:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1787560742.438417:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1787560742.438699:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1787560742.438891:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1787560742.439377:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1787560742.439749:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1787560742.440034:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1787560742.440307:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1787560742.440571:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1787560742.440863:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1787560742.441096:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1787560742.441954:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1787560742.442724:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1787560742.442923:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1787560742.443113:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1787560742.443371:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787560742.446649:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1787560742.448016:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1787560742.448466:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1787560742.450864:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1787560742.451207:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1787560742.451769:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1787560742.452048:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787560742.453841:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1787560742.454254:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1787560742.454800:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1787560742.455190:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1787560742.455395:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1787560742.455658:0:17152:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:1.0:1787560742.456569:0:17152:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787560742.456812:0:17152:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787560742.456820:0:17152:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787560742.456832:0:17152:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4642c20bf2f34d82 00000020:01000004:1.0:1787560742.456839:0:17152:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1787560742.456844:0:17152:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787560742.456849:0:17152:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9caffff56000 from MGS 00000020:01000004:1.0:1787560742.456852:0:17152:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787560742.456862:0:17152:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9cafeabd4d28) 00000020:00000080:1.0:1787560742.456872:0:17152:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787560742.456932:0:17152:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9caffff56000 from MGS, refs=2 00080000:01000000:1.0:1787560742.456937:0:17152:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787560742.456942:0:17152:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4642c20bf2f34d90 00000100:00100000:1.0:1787560742.457032:0:17152:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787560742.457168:0:17152:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787560742.457175:0:17152:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787560742.458291:0:17152:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787560742.458301:0:17152:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787560742.459060:0:17152:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787560742.459298:0:17152:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787560742.459304:0:17152:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787560742.465747:0:17152:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787560742.465767:0:17152:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787560742.469140:0:17152:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787560742.469153:0:17152:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787560742.470797:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560742.470802:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560742.470804:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560742.471060:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560742.471063:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560742.471064:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560742.471780:0:17152:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787560742.481525:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787560742.481774:0:17152:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1787560742.487163:0:17164:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787560742.487525:0:17152:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787560742.487652:0:17152:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787560742.490476:0:17152:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787560742.490819:0:17152:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787560742.491034:0:17152:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787560742.491041:0:17152:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787560742.497695:0:17152:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787560742.497776:0:17152:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787560742.498363:0:17152:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787560742.498371:0:17152:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787560742.499322:0:17152:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787560742.499344:0:17152:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.129@tcp' 00000020:01000004:2.0:1787560742.499346:0:17152:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787560742.499376:0:17152:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.129@tcp (typ=mgc) 00000020:00000080:2.0:1787560742.499389:0:17152:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.129@tcp (ffff9caff4908000) 00000020:00000080:2.0:1787560742.499405:0:17152:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787560742.499664:0:17152:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cafd80ed800@MGC192.168.203.129@tcp: add connection 192.168.203.129@tcp at head 00010000:00010000:2.0:1787560742.499870:0:17152:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.129@tcp-0 is initialized 00000040:01000000:2.0:1787560742.499877:0:17152:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 1 is initialized 10000000:01000000:0.0:1787560742.500276:0:17170:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787560742.500337:0:17152:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.129@tcp (uuid f08f2f56-c18f-4579-88a9-05007f76ffc9) 00000020:00000080:2.0:1787560742.500351:0:17152:0:(genops.c:1385:class_connect()) connect: client f08f2f56-c18f-4579-88a9-05007f76ffc9, cookie 0x4642c20bf2f34d9e 00000100:00080000:2.0:1787560742.500370:0:17152:0:(import.c:510:import_select_connection()) MGC192.168.203.129@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787560742.500375:0:17152:0:(import.c:624:import_select_connection()) MGC192.168.203.129@tcp: import ffff9cafd80ed800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560742.500404:0:17152:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffcb08a80 x1874392862854528/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787560742.500425:0:17152:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f08f2f56-c18f-4579-88a9-05007f76ffc9->MGS 00000020:01000004:2.0:1787560742.500472:0:17152:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787560742.500476:0:17152:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787560742.500519:0:17152:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9caff49099b8) 00000020:00000080:2.0:1787560742.500528:0:17152:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:1.0:1787560742.500798:0:17169:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:0.0:1787560742.502596:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f08f2f56-c18f-4579-88a9-05007f76ffc9:3622:1874392862854528:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787560742.502662:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560742.502849:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862854528 00000100:00100000:1.0:1787560742.502858:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862854528 00000100:00100000:1.0:1787560742.502894:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787560742.502902:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4934050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3622:x1874392862854528:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1787560742.502926:0:17166:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f08f2f56-c18f-4579-88a9-05007f76ffc9@0@lo t0 exp 0000000000000000 cur 461 last 0 00000020:00000080:1.0:1787560742.502952:0:17166:0:(genops.c:1385:class_connect()) connect: client f08f2f56-c18f-4579-88a9-05007f76ffc9, cookie 0x4642c20bf2f34dac 00000100:00080000:1.0:1787560742.503085:0:17166:0:(import.c:65:import_set_state_nolock()) ffff9caec2f9c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787560742.503149:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4934050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+5:3622:x1874392862854528:12345-0@lo:250:mount.lustre.0 Request processed in 245us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560742.503156:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787560742.503365:0:3622:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.129@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787560742.503375:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.129@tcp: connect to target with instance 0 00000100:00080000:0.0:1787560742.503381:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.129@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787560742.503385:0:3622:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787560742.503388:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafd80ed800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787560742.503391:0:3622:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787560742.503403:0:3622:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787560742.503408:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f08f2f56-c18f-4579-88a9-05007f76ffc9:3622:1874392862854528:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787560742.536409:0:17152:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787560742.543386:0:17152:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787560742.543396:0:17152:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787560742.548307:0:17152:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787560742.548324:0:17152:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787560742.549082:0:17152:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787560742.549090:0:17152:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787560742.550086:0:17152:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787560742.550360:0:17152:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787560742.550365:0:17152:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787560742.556110:0:17152:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787560742.556138:0:17152:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787560742.616001:0:17152:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787560742.618039:0:17152:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787560742.618051:0:17152:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787560742.624253:0:17152:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787560742.624271:0:17152:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787560742.625113:0:17152:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787560742.625297:0:17152:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787560742.625302:0:17152:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787560742.626772:0:17152:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787560742.626782:0:17152:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787560742.627478:0:17152:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787560742.627767:0:17152:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787560742.627772:0:17152:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787560742.634278:0:17152:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787560742.635108:0:17152:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787560742.635916:0:17152:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787560742.636105:0:17152:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787560742.636110:0:17152:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787560742.637721:0:17152:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787560742.637733:0:17152:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787560742.669681:0:17152:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787560742.669889:0:17152:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787560742.669895:0:17152:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787560742.672371:0:17152:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787560742.672385:0:17152:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787560742.674073:0:17152:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787560742.674086:0:17152:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787560742.677760:0:17152:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787560742.680422:0:17152:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1787560742.680456:0:17152:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.129@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787560742.680691:0:17152:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787560742.680735:0:17152:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.129@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787560742.680739:0:17152:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787560742.680741:0:17152:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787560742.680742:0:17152:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787560742.680748:0:17152:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787560742.680749:0:17152:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787560742.680750:0:17152:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787560742.680752:0:17152:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787560742.680753:0:17152:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787560742.680755:0:17152:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787560742.680756:0:17152:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787560742.680759:0:17152:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787560742.680761:0:17152:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787560742.680762:0:17152:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787560742.680763:0:17152:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787560742.680763:0:17152:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787560742.680764:0:17152:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787560742.680765:0:17152:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787560742.680766:0:17152:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787560742.680767:0:17152:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787560742.680768:0:17152:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787560742.680769:0:17152:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787560742.680797:0:17152:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787560742.680994:0:17152:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17152:1874392862854656:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787560742.681085:0:17152:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560742.681154:0:17152:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd17b6900 going to sleep for 11 seconds 00000100:00100000:1.0:1787560742.681306:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862854656 00000100:00100000:1.0:1787560742.681314:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862854656 00000100:00100000:1.0:1787560742.681360:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787560742.681370:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4935450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+5:17152:x1874392862854656:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787560742.681412:0:17168:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787560742.681415:0:17168:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787560742.681417:0:17168:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1787560742.681984:0:17189:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787560742.682421:0:17168:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1787560742.692913:0:17190:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787560742.692921:0:17190:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1787560742.692924:0:17190:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787560742.692927:0:17190:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787560742.693185:0:17190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1787560742.695665:0:17168:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787560742.695678:0:17168:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787560742.705920:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4935450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+5:17152:x1874392862854656:12345-0@lo:253:mount.lustre.0 Request processed in 24541us (24825us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560742.705941:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787560742.706043:0:17152:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17152:1874392862854656:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787560742.706059:0:17152:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787560742.706062:0:17152:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787560742.706064:0:17152:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787560742.706065:0:17152:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787560742.706066:0:17152:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787560742.706068:0:17152:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787560742.706068:0:17152:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787560742.706070:0:17152:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787560742.706079:0:17152:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787560742.706081:0:17152:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787560742.706082:0:17152:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787560742.706099:0:17152:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9caffff56000 from lustre-MDT0000 10000000:01000000:3.0:1787560742.706141:0:17152:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787560742.706144:0:17152:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787560742.706148:0:17152:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9caff4908000 10000000:01000000:3.0:1787560742.706152:0:17152:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787560742.706159:0:17152:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9caff4908000 from 1 10000000:01000000:3.0:1787560742.706162:0:17152:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787560742.706208:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb002177000/0x4642c20bf2f34db3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560742.706218:0:17152:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cb002177000/0x4642c20bf2f34db3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560742.706227:0:17152:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cb002177000/0x4642c20bf2f34db3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560742.706245:0:17152:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17152:1874392862854784:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787560742.706283:0:17152:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560742.706320:0:17152:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd17b6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787560742.706416:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862854784 00000100:00100000:0.0:1787560742.706422:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862854784 00000100:00100000:0.0:1787560742.706504:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787560742.706513:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4934c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+5:17152:x1874392862854784:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787560742.706527:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560742.706554:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caec3880a00/0x4642c20bf2f34dba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f34db3 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560742.706582:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caec3880a00/0x4642c20bf2f34dba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f34db3 expref: 6 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560742.706594:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caec3880a00/0x4642c20bf2f34dba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f34db3 expref: 6 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560742.706604:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3880a00, rc 0) 00000100:00100000:0.0:1787560742.706640:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4934c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+6:17152:x1874392862854784:12345-0@lo:101:mount.lustre.0 Request processed in 128us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560742.706655:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787560742.706860:0:17152:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17152:1874392862854784:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787560742.706873:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cb002177000/0x4642c20bf2f34db3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34dba expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560742.706882:0:17152:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cb002177000/0x4642c20bf2f34db3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f34dba expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560742.706933:0:17152:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17152:1874392862854912:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787560742.706970:0:17152:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560742.706998:0:17152:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd17b6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787560742.707081:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862854912 00000100:00100000:2.0:1787560742.707087:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862854912 00000100:00100000:2.0:1787560742.707112:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787560742.707130:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4936450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+6:17152:x1874392862854912:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560742.707233:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4936450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+6:17152:x1874392862854912:12345-0@lo:501:mount.lustre.0 Request processed in 114us (262us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787560742.707241:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787560742.707399:0:17152:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17152:1874392862854912:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787560742.707427:0:17152:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787560742.707479:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb002177000/0x4642c20bf2f34db3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34dba expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560742.707488:0:17152:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cb002177000/0x4642c20bf2f34db3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34dba expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560742.707496:0:17152:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9caffff56000 10000000:01000000:3.0:1787560742.707501:0:17152:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787560742.707505:0:17152:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9caffff56000 10000000:01000000:3.0:1787560742.707507:0:17152:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787560742.707511:0:17152:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9caffff56000 from 1 10000000:01000000:3.0:1787560742.707513:0:17152:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787560742.707542:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb002177a00/0x4642c20bf2f34dc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560742.707549:0:17152:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cb002177a00/0x4642c20bf2f34dc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560742.707557:0:17152:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cb002177a00/0x4642c20bf2f34dc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560742.707568:0:17152:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17152:1874392862855040:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787560742.707593:0:17152:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560742.707609:0:17152:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd17b6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787560742.707781:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862855040 00000100:00100000:1.0:1787560742.707786:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862855040 00000100:00100000:1.0:1787560742.707826:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787560742.707834:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4935850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+6:17152:x1874392862855040:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787560742.707842:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560742.707855:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cb0021ff600/0x4642c20bf2f34dc8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f34dc1 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560742.707870:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cb0021ff600/0x4642c20bf2f34dc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f34dc1 expref: 7 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560742.707879:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cb0021ff600/0x4642c20bf2f34dc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f34dc1 expref: 7 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560742.707885:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb0021ff600, rc 0) 00000100:00100000:1.0:1787560742.707914:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4935850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+7:17152:x1874392862855040:12345-0@lo:101:mount.lustre.0 Request processed in 81us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560742.707920:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787560742.708136:0:17152:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17152:1874392862855040:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787560742.708156:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cb002177a00/0x4642c20bf2f34dc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34dc8 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560742.708164:0:17152:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cb002177a00/0x4642c20bf2f34dc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f34dc8 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560742.708176:0:17152:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787560742.708191:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb002177a00/0x4642c20bf2f34dc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34dc8 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560742.708208:0:17152:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cb002177a00/0x4642c20bf2f34dc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34dc8 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560742.708214:0:17152:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787560742.708218:0:17152:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787560742.708222:0:17152:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9caffff56000 10000000:01000000:3.0:1787560742.708226:0:17152:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787560742.708229:0:17152:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787560742.708231:0:17152:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787560742.708246:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb002177c00/0x4642c20bf2f34dcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560742.708254:0:17152:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cb002177c00/0x4642c20bf2f34dcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560742.708262:0:17152:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cb002177c00/0x4642c20bf2f34dcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560742.708275:0:17152:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17152:1874392862855168:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787560742.708310:0:17152:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560742.708333:0:17152:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd17b6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787560742.708506:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862855168 00000100:00100000:1.0:1787560742.708517:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862855168 00000100:00100000:1.0:1787560742.708559:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787560742.708567:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4936850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+7:17152:x1874392862855168:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787560742.708574:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560742.708583:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cb0021fe400/0x4642c20bf2f34dd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f34dcf expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560742.708598:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cb0021fe400/0x4642c20bf2f34dd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f34dcf expref: 8 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560742.708606:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cb0021fe400/0x4642c20bf2f34dd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f34dcf expref: 8 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560742.708613:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb0021fe400, rc 0) 00000100:00100000:1.0:1787560742.708647:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4936850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+8:17152:x1874392862855168:12345-0@lo:101:mount.lustre.0 Request processed in 81us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560742.708654:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787560742.708947:0:17152:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17152:1874392862855168:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787560742.708959:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cb002177c00/0x4642c20bf2f34dcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34dd6 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560742.708967:0:17152:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cb002177c00/0x4642c20bf2f34dcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f34dd6 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560742.709016:0:17152:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17152:1874392862855296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787560742.709045:0:17152:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560742.709113:0:17152:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd17b6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787560742.713596:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862855296 00000100:00100000:2.0:1787560742.713613:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862855296 00000100:00100000:0.0:1787560742.717107:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787560742.717133:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4937850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+8:17152:x1874392862855296:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787560742.717349:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4937850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+9:17152:x1874392862855296:12345-0@lo:501:mount.lustre.0 Request processed in 229us (8302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560742.717357:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787560742.717587:0:17152:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17152:1874392862855296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787560742.717637:0:17152:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17152:1874392862855424:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787560742.717693:0:17152:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560742.717722:0:17152:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd17b6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787560742.717850:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862855424 00000100:00100000:1.0:1787560742.717857:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862855424 00000100:00100000:1.0:1787560742.717904:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787560742.717912:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4936c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+9:17152:x1874392862855424:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787560742.718957:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4936c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+9:17152:x1874392862855424:12345-0@lo:503:mount.lustre.0 Request processed in 1042us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560742.718966:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787560742.719070:0:17152:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17152:1874392862855424:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787560742.724870:0:17191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab12a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f08f2f56-c18f-4579-88a9-05007f76ffc9:17191:1874392862855552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560742.724952:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560742.724997:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd7d0d180 going to sleep for 11 seconds 00000100:00100000:2.0:1787560742.725064:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862855552 00000100:00100000:2.0:1787560742.725073:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862855552 00000100:00100000:2.0:1787560742.725131:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787560742.725141:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+9:17191:x1874392862855552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787560742.725967:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+9:17191:x1874392862855552:12345-0@lo:502:llog_process_th.0 Request processed in 825us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560742.725975:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787560742.726182:0:17191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab12a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f08f2f56-c18f-4579-88a9-05007f76ffc9:17191:1874392862855552:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787560742.726231:0:17191:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560742.726241:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560742.726244:0:17191:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787560742.726248:0:17191:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787560742.726251:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787560742.726266:0:17191:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9cafeabd19b8) 00000020:00000080:1.0:1787560742.726282:0:17191:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787560742.726288:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787560742.726369:0:17191:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787560742.726376:0:17191:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4642c20bf2f34de4 00000020:00000080:0.0:1787560742.734410:0:17191:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787560742.734422:0:17191:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560742.734445:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560742.734447:0:17191:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787560742.734452:0:17191:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560742.734457:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560742.734459:0:17191:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787560742.734463:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787560742.734475:0:17191:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9caec2d00000) 00000020:00000080:0.0:1787560742.734494:0:17191:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787560742.734498:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787560742.734500:0:17191:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787560742.734503:0:17191:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787560742.734509:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787560742.736128:0:17191:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9caffff56000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787560742.736152:0:17191:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9caec2d04d28) 00000020:00000080:0.0:1787560742.736165:0:17191:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787560742.736245:0:17191:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787560742.736252:0:17191:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4642c20bf2f34df9 00000020:00000080:0.0:1787560742.736385:0:17191:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787560742.736391:0:17191:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787560742.736395:0:17191:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4642c20bf2f34e00 00080000:01000000:0.0:1787560742.736401:0:17191:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787560742.736405:0:17191:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4642c20bf2f34e07 00010000:00010000:0.0:1787560742.873265:0:17191:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1787560742.873958:0:17191:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:0.0:1787560742.874265:0:17191:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787560742.874996:0:17191:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9caec2d019b8) 00000020:00000080:0.0:1787560742.875014:0:17191:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787560742.875081:0:17191:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787560742.875088:0:17191:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4642c20bf2f34e15 00000020:00000080:0.0:1787560742.875704:0:17191:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787560742.890181:0:17191:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4642c20bf2f34e1c 00000020:00000080:1.0:1787560742.890750:0:17191:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787560742.890764:0:17191:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560742.890770:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560742.890772:0:17191:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787560742.890775:0:17191:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787560742.890778:0:17191:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1787560742.890780:0:17191:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787560742.890781:0:17191:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787560742.890782:0:17191:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787560742.890785:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560742.890786:0:17191:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787560742.890789:0:17191:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560742.890794:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560742.890796:0:17191:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787560742.890800:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787560742.890836:0:17191:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787560742.890848:0:17191:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560742.890850:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560742.890851:0:17191:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787560742.890854:0:17191:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560742.890856:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560742.890863:0:17191:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1787560742.890866:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787560742.890871:0:17191:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:00000080:1.0:1787560742.890894:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787560742.890908:0:17191:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9cafeabd3370) 00000020:00000080:1.0:1787560742.890920:0:17191:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1787560742.890925:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787560742.890990:0:17191:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1787560742.890995:0:17191:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787560742.891001:0:17191:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4642c20bf2f34e2a 00010000:00080000:1.0:1787560742.891030:0:17191:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9caffba9c000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.129@tcp at head 00010000:00010000:1.0:1787560742.904523:0:17191:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1787560742.911099:0:17191:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787560742.911116:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787560742.912252:0:17191:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787560742.912277:0:17191:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4642c20bf2f34e31 00000100:00080000:0.0:1787560742.912287:0:17191:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787560742.912293:0:17191:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9caffba9c000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:0.0:1787560742.912330:0:17191:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafffe4d500 x1874392862855680/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787560742.912364:0:17191:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1787560742.912468:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862855680:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787560742.912549:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560742.912844:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862855680 00000100:00100000:3.0:1787560742.912851:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862855680 00000100:00100000:3.0:1787560742.912883:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787560742.912890:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1874392862855680:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1787560742.912905:0:17178:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:01000000:0.0:1787560742.914711:0:17191:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560742.914724:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560742.914726:0:17191:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1787560742.915096:0:17191:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787560742.915101:0:17191:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1787560742.915103:0:17191:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787560742.915106:0:17191:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787560742.915108:0:17191:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787560742.915112:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560742.915114:0:17191:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787560742.915118:0:17191:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787560742.915123:0:17191:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787560742.915127:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560742.915129:0:17191:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787560742.915144:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787560742.915149:0:17191:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:01000000:0.0:1787560742.915175:0:17191:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787560742.915178:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787560742.915205:0:17191:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9caec2d03370) 00000020:00000080:0.0:1787560742.915226:0:17191:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1787560742.915231:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787560742.915326:0:17191:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787560742.915332:0:17191:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787560742.915339:0:17191:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4642c20bf2f34e3f 00010000:00080000:0.0:1787560742.915367:0:17191:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9caec3380800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.129@tcp at head 00010000:00010000:0.0:1787560742.916089:0:17191:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1787560742.931829:0:17191:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787560742.937865:0:17191:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787560742.956788:0:17191:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787560742.957321:0:17191:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1787560742.971005:0:17191:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1787560742.973841:0:17197:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787560742.973849:0:17197:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787560742.977063:0:17191:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787560742.977079:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787560742.977171:0:17191:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787560742.977204:0:17191:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4642c20bf2f34e46 00000100:00080000:0.0:1787560742.977216:0:17191:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787560742.977222:0:17191:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9caec3380800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:0.0:1787560742.977259:0:17191:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafffe4ea00 x1874392862855808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787560742.977357:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862855808:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787560742.977456:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874392862855808 offset 0 length 520: 4 00000100:00080000:0.0:1787560742.977610:0:17191:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787560742.977661:0:17191:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560742.977666:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560742.977668:0:17191:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787560742.977678:0:17191:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787560742.977681:0:17191:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1787560742.977682:0:17191:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787560742.977684:0:17191:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787560742.977686:0:17191:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787560742.977689:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560742.977690:0:17191:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787560742.977693:0:17191:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787560742.977698:0:17191:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787560742.977702:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560742.977703:0:17191:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787560742.977707:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787560742.977711:0:17191:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:01000000:0.0:1787560742.977743:0:17191:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787560742.977746:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787560742.977759:0:17191:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9caffb994d28) 00000020:00000080:0.0:1787560742.977772:0:17191:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1787560742.977777:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787560742.977856:0:17191:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787560742.977863:0:17191:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:0.0:1787560742.977871:0:17191:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4642c20bf2f34e54 00010000:00080000:0.0:1787560742.977913:0:17191:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9caec32fd800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.129@tcp at head 00010000:00010000:0.0:1787560742.979383:0:17191:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1787560742.979480:0:17191:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787560742.979500:0:17191:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1787560742.986551:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1874392862855680:12345-0@lo:38:llog_process_th.0 Request processed in 73639us (73981us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787560742.986570:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:2.0:1787560742.988707:0:17191:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787560742.989241:0:17191:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1787560742.989383:0:17191:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00080000:3.0:1787560742.994789:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffba9c000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787560742.994801:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787560742.995028:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862855680:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1787560742.998720:0:17199:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787560742.998729:0:17199:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787560742.999727:0:17191:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787560742.999740:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787560742.999776:0:17191:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787560742.999795:0:17191:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4642c20bf2f34e5b 00000100:00080000:1.0:1787560743.000508:0:17191:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787560743.000518:0:17191:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9caec32fd800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1787560743.000573:0:17191:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafeab12a00 x1874392862855936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787560743.000630:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862855936:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787560743.000687:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874392862855936 offset 0 length 520: 4 00000100:00080000:1.0:1787560743.000741:0:17191:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787560743.000818:0:17191:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560743.000823:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560743.000825:0:17191:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787560743.000828:0:17191:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560743.000832:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560743.000834:0:17191:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787560743.000836:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787560743.000847:0:17191:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787560743.000850:0:17191:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560743.000853:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560743.000854:0:17191:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787560743.000856:0:17191:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560743.000859:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560743.000860:0:17191:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787560743.000864:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787560743.000892:0:17191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab11880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f08f2f56-c18f-4579-88a9-05007f76ffc9:17191:1874392862856064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560743.000942:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560743.002109:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862856064 00000100:00100000:1.0:1787560743.002289:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862856064 00000100:00100000:1.0:1787560743.002387:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787560743.002398:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+9:17191:x1874392862856064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560743.002580:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+9:17191:x1874392862856064:12345-0@lo:502:llog_process_th.0 Request processed in 184us (1638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560743.002588:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787560743.002631:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd84bb900 going to sleep for 11 seconds 00000100:00100000:1.0:1787560743.002653:0:17191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab11880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f08f2f56-c18f-4579-88a9-05007f76ffc9:17191:1874392862856064:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787560743.002682:0:17191:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560743.002689:0:17191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560743.002691:0:17191:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787560743.002696:0:17191:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1787560743.003521:0:17152:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1787560743.003547:0:17152:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787560743.003574:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb002177c00/0x4642c20bf2f34dcf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34dd6 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560743.003599:0:17152:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cb002177c00/0x4642c20bf2f34dcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34dd6 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560743.003608:0:17152:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9caffff56000 from 1 10000000:01000000:2.0:1787560743.003611:0:17152:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787560743.003647:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec2169600/0x4642c20bf2f34e62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560743.003654:0:17152:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caec2169600/0x4642c20bf2f34e62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560743.003663:0:17152:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caec2169600/0x4642c20bf2f34e62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560743.003682:0:17152:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17152:1874392862856192:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787560743.003725:0:17152:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560743.003759:0:17152:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd17700c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560743.004509:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862856192 00000100:00100000:1.0:1787560743.004517:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862856192 00000100:00100000:1.0:1787560743.004556:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787560743.004564:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2162850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+9:17152:x1874392862856192:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787560743.004577:0:17168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560743.004592:0:17168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cb0021ff000/0x4642c20bf2f34e69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f34e62 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560743.004625:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cb0021ff000/0x4642c20bf2f34e69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f34e62 expref: 10 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560743.004635:0:17168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cb0021ff000/0x4642c20bf2f34e69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f34e62 expref: 10 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560743.004644:0:17168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb0021ff000, rc 0) 00000100:00100000:1.0:1787560743.004693:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2162850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+10:17152:x1874392862856192:12345-0@lo:101:mount.lustre.0 Request processed in 130us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560743.004700:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787560743.005854:0:17152:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17152:1874392862856192:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787560743.005877:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caec2169600/0x4642c20bf2f34e62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34e69 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560743.005889:0:17152:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caec2169600/0x4642c20bf2f34e62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f34e69 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560743.006757:0:17152:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17152:1874392862856320:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787560743.007189:0:17152:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560743.007237:0:17152:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd17700c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560743.007334:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862856320 00000100:00100000:1.0:1787560743.007341:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862856320 00000100:00100000:1.0:1787560743.007380:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787560743.007388:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2162c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+10:17152:x1874392862856320:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787560743.007408:0:17166:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787560743.007415:0:17166:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787560743.007512:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2162c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+10:17152:x1874392862856320:12345-0@lo:256:mount.lustre.0 Request processed in 124us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560743.007520:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787560743.007778:0:17152:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17152:1874392862856320:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787560743.008652:0:17152:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787560743.008669:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec2169600/0x4642c20bf2f34e62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34e69 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560743.008679:0:17152:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caec2169600/0x4642c20bf2f34e62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34e69 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560743.008687:0:17152:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9caffff56000 from 1 10000000:01000000:2.0:1787560743.008691:0:17152:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787560743.008724:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec2168e00/0x4642c20bf2f34e70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560743.008732:0:17152:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caec2168e00/0x4642c20bf2f34e70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560743.008741:0:17152:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caec2168e00/0x4642c20bf2f34e70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560743.008758:0:17152:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17152:1874392862856448:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787560743.008799:0:17152:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560743.011339:0:17152:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd17700c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560743.011514:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862856448 00000100:00100000:1.0:1787560743.011527:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862856448 00000100:00100000:1.0:1787560743.011593:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787560743.011603:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+10:17152:x1874392862856448:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787560743.011619:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560743.011638:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cb0021ff800/0x4642c20bf2f34e77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f34e70 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560743.011683:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cb0021ff800/0x4642c20bf2f34e77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f34e70 expref: 11 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560743.011694:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cb0021ff800/0x4642c20bf2f34e77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f34e70 expref: 11 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560743.011702:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb0021ff800, rc 0) 00000100:00100000:1.0:1787560743.011758:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+11:17152:x1874392862856448:12345-0@lo:101:mount.lustre.0 Request processed in 157us (2957us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560743.011765:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787560743.018785:0:17152:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17152:1874392862856448:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787560743.018822:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caec2168e00/0x4642c20bf2f34e70 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34e77 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560743.018836:0:17152:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caec2168e00/0x4642c20bf2f34e70 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f34e77 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560743.018961:0:17152:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17152:1874392862856576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787560743.019020:0:17152:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560743.019070:0:17152:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c4b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560743.019145:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862856576 00000100:00100000:1.0:1787560743.019152:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862856576 00000100:00100000:1.0:1787560743.019212:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787560743.019222:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+11:17152:x1874392862856576:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787560743.019374:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+11:17152:x1874392862856576:12345-0@lo:501:mount.lustre.0 Request processed in 153us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560743.019382:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787560743.020044:0:17152:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17152:1874392862856576:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560743.020082:0:17152:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17152:1874392862856704:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787560743.020145:0:17152:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560743.020178:0:17152:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd1770d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787560743.020241:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862856704 00000100:00100000:1.0:1787560743.020246:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862856704 00000100:00100000:1.0:1787560743.020282:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787560743.020290:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+11:17152:x1874392862856704:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787560743.020383:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+11:17152:x1874392862856704:12345-0@lo:503:mount.lustre.0 Request processed in 93us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560743.020389:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787560743.020909:0:17152:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17152:1874392862856704:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787560743.021365:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f08f2f56-c18f-4579-88a9-05007f76ffc9:17201:1874392862856832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787560743.021416:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560743.021483:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe0a65240 going to sleep for 11 seconds 00000100:00100000:1.0:1787560743.021558:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862856832 00000100:00100000:1.0:1787560743.021563:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862856832 00000100:00100000:1.0:1787560743.021597:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787560743.021605:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2163450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+11:17201:x1874392862856832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560743.022091:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2163450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+11:17201:x1874392862856832:12345-0@lo:502:llog_process_th.0 Request processed in 486us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560743.022098:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787560743.022240:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f08f2f56-c18f-4579-88a9-05007f76ffc9:17201:1874392862856832:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787560743.022266:0:17201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560743.022274:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560743.022276:0:17201:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787560743.022283:0:17201:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9caffff56000 00000020:00000080:0.0:1787560743.022285:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787560743.022293:0:17201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560743.022295:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560743.022297:0:17201:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787560743.022299:0:17201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560743.022301:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560743.022303:0:17201:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787560743.022306:0:17201:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9caffff56000 00000020:00000080:0.0:1787560743.022308:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787560743.022364:0:17201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560743.022368:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560743.022369:0:17201:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787560743.022371:0:17201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560743.022373:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560743.022375:0:17201:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787560743.022378:0:17201:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9caffff56000 00000020:00000080:0.0:1787560743.022380:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787560743.022405:0:17201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560743.022407:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560743.022409:0:17201:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787560743.022411:0:17201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560743.022414:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560743.022415:0:17201:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787560743.022418:0:17201:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9caffff56000 00000020:00000080:0.0:1787560743.022420:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787560743.022484:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f08f2f56-c18f-4579-88a9-05007f76ffc9:17201:1874392862856960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787560743.022519:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560743.022545:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd9b5e480 going to sleep for 11 seconds 00000100:00100000:1.0:1787560743.024188:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862856960 00000100:00100000:1.0:1787560743.024207:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862856960 00000100:00100000:1.0:1787560743.024257:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787560743.024267:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+11:17201:x1874392862856960:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560743.024408:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+11:17201:x1874392862856960:12345-0@lo:502:llog_process_th.0 Request processed in 142us (1888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560743.024415:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787560743.025322:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f08f2f56-c18f-4579-88a9-05007f76ffc9:17201:1874392862856960:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787560743.025363:0:17201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560743.025371:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560743.025374:0:17201:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787560743.025379:0:17201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1787560743.044387:0:17152:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787560743.044424:0:17152:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787560743.044945:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec2168e00/0x4642c20bf2f34e70 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34e77 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560743.044959:0:17152:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caec2168e00/0x4642c20bf2f34e70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34e77 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560743.045017:0:17152:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787560743.045020:0:17152:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9caffff56000 10000000:01000000:2.0:1787560743.045023:0:17152:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9caffff56000 10000000:01000000:2.0:1787560743.045027:0:17152:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787560743.045033:0:17152:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9caffff56000 from 1 10000000:01000000:2.0:1787560743.045035:0:17152:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787560743.045069:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec2168000/0x4642c20bf2f34e7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560743.045078:0:17152:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caec2168000/0x4642c20bf2f34e7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560743.045088:0:17152:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caec2168000/0x4642c20bf2f34e7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560743.045112:0:17152:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17152:1874392862857088:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787560743.045179:0:17152:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560743.045297:0:17152:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd17b6900 going to sleep for 11 seconds 00000100:00100000:1.0:1787560743.053298:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862857088 00000100:00100000:1.0:1787560743.053313:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862857088 00000100:00100000:1.0:1787560743.057670:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787560743.057697:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+11:17152:x1874392862857088:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787560743.057719:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560743.057741:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cb0021fee00/0x4642c20bf2f34e85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f34e7e expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560743.057770:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cb0021fee00/0x4642c20bf2f34e85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f34e7e expref: 12 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560743.057780:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cb0021fee00/0x4642c20bf2f34e85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f34e7e expref: 12 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560743.057790:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb0021fee00, rc 0) 00000100:00100000:1.0:1787560743.057885:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+12:17152:x1874392862857088:12345-0@lo:101:mount.lustre.0 Request processed in 201us (12706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560743.057909:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787560743.058008:0:17152:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17152:1874392862857088:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787560743.058027:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caec2168000/0x4642c20bf2f34e7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34e85 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560743.058036:0:17152:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caec2168000/0x4642c20bf2f34e7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f34e85 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560743.058115:0:17152:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17152:1874392862857216:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787560743.058150:0:17152:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560743.059108:0:17152:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc599db40 going to sleep for 11 seconds 00000100:00100000:2.0:1787560743.059180:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862857216 00000100:00100000:2.0:1787560743.059187:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862857216 00000100:00100000:2.0:1787560743.059237:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787560743.059245:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+12:17152:x1874392862857216:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560743.059405:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+12:17152:x1874392862857216:12345-0@lo:501:mount.lustre.0 Request processed in 161us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560743.059413:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787560743.059664:0:17152:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17152:1874392862857216:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787560743.059717:0:17152:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17152:1874392862857344:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787560743.059758:0:17152:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560743.059779:0:17152:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc599db40 going to sleep for 11 seconds 00000100:00100000:2.0:1787560743.059938:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862857344 00000100:00100000:2.0:1787560743.059943:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862857344 00000100:00100000:2.0:1787560743.059965:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787560743.059971:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+12:17152:x1874392862857344:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787560743.060059:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+12:17152:x1874392862857344:12345-0@lo:503:mount.lustre.0 Request processed in 86us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560743.060066:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787560743.061457:0:17152:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17152:1874392862857344:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787560743.061868:0:17207:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f08f2f56-c18f-4579-88a9-05007f76ffc9:17207:1874392862857472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560743.061934:0:17207:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560743.061964:0:17207:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc599d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560743.062046:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862857472 00000100:00100000:2.0:1787560743.062052:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862857472 00000100:00100000:2.0:1787560743.062084:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787560743.062091:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+12:17207:x1874392862857472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787560743.062209:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+12:17207:x1874392862857472:12345-0@lo:502:llog_process_th.0 Request processed in 117us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560743.062217:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787560743.062348:0:17207:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f08f2f56-c18f-4579-88a9-05007f76ffc9:17207:1874392862857472:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1787560743.062405:0:17207:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787560743.062421:0:17207:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9caec2fb0000) 00000020:00000080:3.0:1787560743.062470:0:17207:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1787560743.062572:0:17207:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9caffff56000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787560743.062577:0:17207:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9caffff56000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787560743.062580:0:17207:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9caffff56000 4 00010000:00080000:3.0:1787560743.062613:0:17207:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cafd0868000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.129@tcp at head 00010000:00010000:2.0:1787560743.066300:0:17207:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1787560743.066526:0:17207:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787560743.066571:0:17207:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787560743.066586:0:17207:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4642c20bf2f34e93 00000100:00080000:2.0:1787560743.066595:0:17207:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787560743.066601:0:17207:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9cafd0868000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560743.066639:0:17207:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffcb08e00 x1874392862857600/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787560743.066663:0:17207:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787560743.068945:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874392862857600:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787560743.069031:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560743.069221:0:17207:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f08f2f56-c18f-4579-88a9-05007f76ffc9:17207:1874392862857728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560743.069263:0:17207:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560743.069292:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862857728 00000100:00100000:3.0:1787560743.069299:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862857728 00000100:00100000:3.0:1787560743.069342:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787560743.069351:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+12:17207:x1874392862857728:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560743.069479:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+12:17207:x1874392862857728:12345-0@lo:502:llog_process_th.0 Request processed in 128us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560743.069487:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787560743.069584:0:17207:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc599d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560743.069604:0:17207:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f08f2f56-c18f-4579-88a9-05007f76ffc9:17207:1874392862857728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560743.069644:0:17207:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f08f2f56-c18f-4579-88a9-05007f76ffc9:17207:1874392862857856:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560743.069677:0:17207:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560743.069696:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862857856 00000100:00100000:3.0:1787560743.069699:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862857856 00000100:00100000:3.0:1787560743.069719:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787560743.069725:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc2c81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+12:17207:x1874392862857856:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560743.069781:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc2c81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+12:17207:x1874392862857856:12345-0@lo:502:llog_process_th.0 Request processed in 56us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560743.069797:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787560743.069825:0:17207:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc599d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560743.069837:0:17207:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f08f2f56-c18f-4579-88a9-05007f76ffc9:17207:1874392862857856:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787560743.069856:0:17207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787560743.073994:0:17152:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787560743.074032:0:17152:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787560743.074057:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec2168000/0x4642c20bf2f34e7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34e85 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560743.074069:0:17152:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caec2168000/0x4642c20bf2f34e7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34e85 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787560743.074131:0:17152:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787560743.074133:0:17152:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787560743.074135:0:17152:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560743.074136:0:17152:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560743.074137:0:17152:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560743.074138:0:17152:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560743.074140:0:17152:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787560743.074142:0:17152:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787560743.074143:0:17152:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560743.074144:0:17152:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787560743.074148:0:17152:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787560743.074150:0:17152:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787560743.074152:0:17152:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787560743.074153:0:17152:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560743.074154:0:17152:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560743.074155:0:17152:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560743.074156:0:17152:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560743.074157:0:17152:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787560743.074158:0:17152:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787560743.074160:0:17152:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560743.074161:0:17152:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787560743.074186:0:17152:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787560743.074219:0:17152:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17152:1874392862857984:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787560743.074285:0:17152:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560743.074324:0:17152:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffb8baa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787560743.081063:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862857984 00000100:00100000:0.0:1787560743.081077:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862857984 00000100:00100000:0.0:1787560743.081129:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862857600 00000100:00100000:0.0:1787560743.081132:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862857600 00000100:00100000:0.0:1787560743.081164:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787560743.081171:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1874392862857600:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787560743.081275:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1874392862857600:12345-0@lo:38:llog_process_th.0 Request processed in 103us (12243us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787560743.081283:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787560743.082878:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787560743.082891:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc2c83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+12:17152:x1874392862857984:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787560743.082921:0:17166:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787560743.082934:0:17166:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787560743.085645:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787560743.085661:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafd0868000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787560743.085668:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787560743.085673:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874392862857600:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1787560743.098379:0:17166:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787560743.098403:0:17166:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787560743.100500:0:17189:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787560743.100511:0:17189:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787560743.100541:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cb0021ff400/0x4642c20bf2f34e9a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560743.100562:0:17189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cb0021ff000/0x4642c20bf2f34e69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f34e62 expref: 12 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560743.100570:0:17189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cb0021ff400/0x4642c20bf2f34e9a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560743.100614:0:17189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cb0021ff000/0x4642c20bf2f34e69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f34e62 expref: 12 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560743.100632:0:17189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cb0021ff000/0x4642c20bf2f34e69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f34e62 expref: 12 pid: 17168 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560743.100647:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab11880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17189:1874392862858112:0@lo:104: 00000100:00100000:1.0:1787560743.100728:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560743.100777:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2180 going to sleep for 11 seconds 00000100:00100000:2.0:1787560743.101097:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc2c83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+12:17152:x1874392862857984:12345-0@lo:253:mount.lustre.0 Request processed in 18207us (26809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560743.101108:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787560743.101170:0:17152:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17152:1874392862857984:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787560743.101181:0:17152:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787560743.101184:0:17152:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787560743.101186:0:17152:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787560743.101187:0:17152:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560743.101188:0:17152:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560743.101200:0:17152:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560743.101201:0:17152:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560743.101203:0:17152:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787560743.101204:0:17152:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787560743.101206:0:17152:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560743.101207:0:17152:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787560743.101220:0:17152:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787560743.110318:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862858112 00000100:00100000:0.0:1787560743.110336:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862858112 00000100:00100000:0.0:1787560743.110444:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787560743.110456:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f08f2f56-c18f-4579-88a9-05007f76ffc9+3:17189:x1874392862858112:12345-0@lo:104: 00010000:00010000:0.0:1787560743.110474:0:17156:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9caec2169600/0x4642c20bf2f34e62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f34e69 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560743.110570:0:17156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787560743.110577:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f08f2f56-c18f-4579-88a9-05007f76ffc9+3:17189:x1874392862858112:12345-0@lo:104: Request processed in 124us (9849us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560743.110584:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787560743.110646:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab11880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17189:1874392862858112:0@lo:104: 00010000:00010000:0.0:1787560743.110670:0:17189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cb0021ff400/0x4642c20bf2f34e9a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560743.111234:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560743.111244:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caec2169600/0x4642c20bf2f34e62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f34e69 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560743.111253:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169600 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560743.111258:0:17162:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caec2169600/0x4642c20bf2f34e62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f34e69 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560743.111268:0:17162:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caec2169600/0x4642c20bf2f34e62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f34e69 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560743.111276:0:17162:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caec2169600/0x4642c20bf2f34e62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f34e69 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560743.111283:0:17162:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787560743.111342:0:17162:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caec2169600/0x4642c20bf2f34e62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f34e69 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560743.111351:0:17162:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560743.111392:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caec2169600/0x4642c20bf2f34e62 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f34e69 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560743.111400:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caec2169600/0x4642c20bf2f34e62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f34e69 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560743.111419:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560743.111421:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560743.111423:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560743.111481:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f08f2f56-c18f-4579-88a9-05007f76ffc9:3626:1874392862858240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787560743.111531:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560743.111624:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862858240 00000100:00100000:3.0:1787560743.111629:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862858240 00010000:00010000:3.0:1787560743.111651:0:17158:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cb0021ff000/0x4642c20bf2f34e69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f34e62 expref: 12 pid: 17168 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560743.111676:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787560743.111684:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f08f2f56-c18f-4579-88a9-05007f76ffc9+12:3626:x1874392862858240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787560743.111697:0:17158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560743.111703:0:17158:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cb0021ff000/0x4642c20bf2f34e69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f34e62 expref: 12 pid: 17168 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560743.111714:0:17158:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cb0021ff000/0x4642c20bf2f34e69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f34e62 expref: 12 pid: 17168 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560743.111728:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cb0021ff000/0x4642c20bf2f34e69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f34e62 expref: 12 pid: 17168 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560743.111744:0:17158:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cb0021ff400/0x4642c20bf2f34e9a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560743.111762:0:17158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cb0021ff400/0x4642c20bf2f34e9a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787560743.111777:0:17158:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011267045s 00010000:00010000:3.0:1787560743.111782:0:17158:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cb0021ff400/0x4642c20bf2f34e9a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560743.111788:0:17158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cb0021ff400/0x4642c20bf2f34e9a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560743.111795:0:17158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cb0021ff400/0x4642c20bf2f34e9a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560743.111801:0:17158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cb0021ff400/0x4642c20bf2f34e9a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560743.111806:0:17158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ff400 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560743.111809:0:17158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cb0021ff400/0x4642c20bf2f34e9a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560743.111816:0:17158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cb0021ff400/0x4642c20bf2f34e9a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560743.111830:0:17158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cb0021ff400/0x4642c20bf2f34e9a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560743.111838:0:17158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560743.111869:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f08f2f56-c18f-4579-88a9-05007f76ffc9+11:3626:x1874392862858240:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560743.111876:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787560743.111906:0:17189:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cb0021ff400/0x4642c20bf2f34e9a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560743.111914:0:17189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cb0021ff400/0x4642c20bf2f34e9a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560743.111920:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cb0021ff400/0x4642c20bf2f34e9a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560743.111950:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f08f2f56-c18f-4579-88a9-05007f76ffc9:3626:1874392862858240:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1787560743.136059:0:17152:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1787560743.136376:0:17152:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1787560743.137261:0:17214:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1787560743.137584:0:17214:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1787560743.139306:0:17213:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1787560743.139314:0:17213:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:1.0:1787560743.140057:0:17214:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787560743.140143:0:17214:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:2.0:1787560743.140344:0:17152:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:1.0:1787560743.147104:0:17215:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9cafeab10700 x1874392862858368/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560743.147129:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2900 going to sleep for 0 seconds 00000040:01000000:3.0:1787560743.154149:0:17152:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787560743.154216:0:17152:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787560743.154735:0:17152:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787560743.154743:0:17152:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787560743.154779:0:17152:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787560743.155844:0:17152:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787560743.156396:0:17152:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787560743.156427:0:17152:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1787560743.162886:0:17152:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:3.0:1787560743.165676:0:17152:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1787560743.167494:0:17152:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787560743.167532:0:17152:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb6db41c6f988 00100000:10000000:3.0:1787560743.167541:0:17152:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787560743.168308:0:17152:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787560743.168322:0:17152:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.129@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787560743.168339:0:17152:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1787560743.168363:0:17152:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1787560743.176306:0:17152:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787560743.176550:0:17152:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787560743.476413:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787560744.118182:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1787560744.182218:0:17170:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787560744.182225:0:17170:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9caffff56000 from 7 10000000:01000000:1.0:1787560744.182230:0:17170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787560744.182279:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f34ea1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560744.182290:0:17170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f34ea1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560744.182301:0:17170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f34ea1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560744.182325:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab11500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862858496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787560744.182401:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560744.182487:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2780 going to sleep for 11 seconds 00000100:00100000:2.0:1787560744.182553:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862858496 00000100:00100000:2.0:1787560744.182561:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862858496 00000100:00100000:2.0:1787560744.182613:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787560744.182623:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc2c80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+11:17170:x1874392862858496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560744.182637:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560744.182651:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caec2169000/0x4642c20bf2f34ea8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f34ea1 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560744.182672:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caec2169000/0x4642c20bf2f34ea8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f34ea1 expref: 12 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560744.182681:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caec2169000/0x4642c20bf2f34ea8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f34ea1 expref: 12 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560744.182700:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2169000, rc 0) 00000100:00100000:2.0:1787560744.182740:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc2c80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+12:17170:x1874392862858496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560744.182747:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787560744.182791:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab11500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862858496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560744.182804:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f34ea1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34ea8 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560744.182813:0:17170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f34ea1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f34ea8 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560744.182859:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862858624:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787560744.182888:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560744.182910:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec22aa780 going to sleep for 11 seconds 00000100:00100000:2.0:1787560744.182923:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862858624 00000100:00100000:2.0:1787560744.182926:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862858624 00000100:00100000:2.0:1787560744.182948:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787560744.182955:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc2c82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+12:17170:x1874392862858624:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787560744.182969:0:17166:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787560744.182995:0:17166:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787560744.182998:0:17166:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1787560744.183062:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc2c82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+12:17170:x1874392862858624:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 107us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560744.183069:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787560744.183094:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862858624:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787560744.183134:0:17170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787560744.183140:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f34ea1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34ea8 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560744.183148:0:17170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f34ea1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34ea8 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560744.184681:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2900 going to sleep for 0 seconds 00010000:00010000:3.0:1787560744.513199:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787560745.142031:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787560745.203509:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2900 going to sleep for 0 seconds 00010000:00010000:3.0:1787560745.535803:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560746.227810:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2900 going to sleep for 0 seconds 00010000:00010000:3.0:1787560746.548862:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560747.251567:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2900 going to sleep for 0 seconds 00010000:00010000:3.0:1787560747.574759:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787560748.085956:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787560748.085963:0:15403:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787560748.085966:0:15403:0:(import.c:65:import_set_state_nolock()) ffff9caffba9c000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787560748.085973:0:15403:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 462 00000100:00080000:0.0:1787560748.085979:0:15403:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787560748.085984:0:15403:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9caffba9c000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:0.0:1787560748.086020:0:15403:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafffe4f100 x1874392862858880/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787560748.086037:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787560748.086041:0:15403:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787560748.086043:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787560748.086046:0:15403:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787560748.086048:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787560748.086052:0:15403:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787560748.086053:0:15403:0:(import.c:65:import_set_state_nolock()) ffff9cafd0868000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787560748.086058:0:15403:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9cafd0868000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:0.0:1787560748.086070:0:15403:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafffe4c000 x1874392862859008/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787560748.086191:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787560748.086203:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f08f2f56-c18f-4579-88a9-05007f76ffc9:3624:1874392862858752:0@lo:400:kworker.0 00000100:00100000:0.0:1787560748.086268:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560748.086318:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862858880:0@lo:38:kworker.0 00000100:00100000:0.0:1787560748.086345:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560748.086370:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874392862859008:0@lo:38:kworker.0 00000100:00100000:0.0:1787560748.086394:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560748.086463:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862859008 00000100:00100000:0.0:1787560748.086470:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862859008 00000100:00100000:0.0:1787560748.086514:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787560748.086522:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1874392862859008:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787560748.086546:0:17175:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 467 last 0 00000020:00000080:0.0:1787560748.086695:0:17175:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4642c20bf2f34eaf 00000004:00100000:0.0:1787560748.086719:0:17175:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787560748.086838:0:17175:0:(import.c:65:import_set_state_nolock()) ffff9cafd086f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787560748.086882:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1874392862859008:12345-0@lo:38:kworker.0 Request processed in 360us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560748.086889:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787560748.086936:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862858880 00000100:00100000:0.0:1787560748.086941:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862858880 00000100:00100000:0.0:1787560748.086958:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787560748.086962:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1874392862858880:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787560748.086975:0:17179:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787560748.087634:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862858752 00000100:00100000:2.0:1787560748.087641:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862858752 00000100:00100000:2.0:1787560748.087688:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787560748.087695:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc2c82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+12:3624:x1874392862858752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560748.087758:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc2c82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+12:3624:x1874392862858752:12345-0@lo:400:kworker.0 Request processed in 64us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560748.087764:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787560748.087807:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f08f2f56-c18f-4579-88a9-05007f76ffc9:3624:1874392862858752:0@lo:400:kworker.0 00010000:00080000:1.0:1787560748.090838:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cafffe4c000 x1874392862859008/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787560758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787560748.090864:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787560748.090873:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787560748.090879:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787560748.090882:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafd0868000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787560748.090889:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874392862859008:0@lo:38:kworker.0 00000100:00100000:1.0:1787560748.126972:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1874392862858880:12345-0@lo:38:kworker.0 Request processed in 40002us (40620us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787560748.126989:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787560748.128562:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffba9c000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787560748.128571:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787560748.128576:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862858880:0@lo:38:kworker.0 00000100:00100000:1.0:1787560748.279803:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2900 going to sleep for 0 seconds 00010000:00010000:0.0:1787560748.612190:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560749.300787:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2900 going to sleep for 0 seconds 00010000:00010000:1.0:1787560749.619997:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787560749.689099:0:17458:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787560750.323699:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2900 going to sleep for 0 seconds 00010000:00010000:0.0:1787560750.643653:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787560750.823509:0:17510:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787560750.823688:0:17510:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787560751.348663:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2900 going to sleep for 0 seconds 00010000:00010000:1.0:1787560751.668562:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787560752.035250:0:17560:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787560752.044344:0:17560:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787560752.180234:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560742/real 1787560742] req@ffff9cafffe4ea00 x1874392862855808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560752 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560752.180264:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cafffe4ea00 x1874392862855808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560752 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787560752.180283:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec3380800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787560752.180294:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787560752.180298:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862855808:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787560752.180490:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787560752.180495:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787560752.180498:0:36:0:(import.c:65:import_set_state_nolock()) ffff9caffba9c000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787560752.180503:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 467 00000100:00080000:1.0:1787560752.180508:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787560752.180515:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9caffba9c000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1787560752.180543:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafeab10a80 x1874392862859264/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787560752.180555:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787560752.180558:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787560752.180560:0:36:0:(import.c:65:import_set_state_nolock()) ffff9caec3380800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787560752.180563:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 462 00000100:00080000:1.0:1787560752.180566:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787560752.180569:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9caec3380800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1787560752.180579:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafeab10e00 x1874392862859392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787560752.180588:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787560752.180592:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787560752.180840:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f08f2f56-c18f-4579-88a9-05007f76ffc9:3624:1874392862859136:0@lo:400:kworker.0 00000100:00100000:3.0:1787560752.180904:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560752.180958:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862859520:0@lo:400:kworker.0 00000100:00100000:3.0:1787560752.180989:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560752.181257:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862859520 00000100:00100000:3.0:1787560752.181266:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862859520 00000100:00100000:3.0:1787560752.181306:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787560752.181314:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862859520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560752.181362:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862859520:12345-0@lo:400:kworker.0 Request processed in 49us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560752.181369:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787560752.181417:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cafeab13b80 x1874392862859520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560752.181451:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862859520:0@lo:400:kworker.0 00000100:00100000:3.0:1787560752.181473:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862859264:0@lo:38:kworker.0 00000100:00100000:3.0:1787560752.181512:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560752.181715:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862859392:0@lo:8:kworker.0 00000400:00000100:3.0:1787560752.181739:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874392862859392 offset 0 length 520: 4 00000100:00100000:1.0:1787560752.181928:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862859136 00000100:00100000:1.0:1787560752.181933:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862859136 00000100:00100000:1.0:1787560752.181972:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787560752.181980:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc2c83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+12:3624:x1874392862859136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560752.182033:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc2c83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+12:3624:x1874392862859136:12345-0@lo:400:kworker.0 Request processed in 43us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560752.182047:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787560752.182084:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f08f2f56-c18f-4579-88a9-05007f76ffc9:3624:1874392862859136:0@lo:400:kworker.0 00000100:00100000:2.0:1787560752.184779:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862859264 00000100:00100000:2.0:1787560752.184791:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862859264 00000100:00100000:2.0:1787560752.184825:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787560752.184832:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1874392862859264:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787560752.184852:0:17178:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787560752.208792:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1874392862859264:12345-0@lo:38:kworker.0 Request processed in 23950us (27269us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787560752.208807:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787560752.215912:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffba9c000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787560752.215925:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787560752.215931:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862859264:0@lo:38:kworker.0 00000100:00100000:1.0:1787560752.372833:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2900 going to sleep for 0 seconds 00010000:00010000:0.0:1787560752.691607:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560753.204530:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560743/real 1787560743] req@ffff9cafeab12a00 x1874392862855936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560753 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560753.204573:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cafeab12a00 x1874392862855936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560753 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787560753.204594:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec32fd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787560753.204613:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787560753.204618:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862855936:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787560753.204742:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787560753.204748:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787560753.204750:0:8:0:(import.c:65:import_set_state_nolock()) ffff9caffba9c000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787560753.204755:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 471 00000100:00080000:1.0:1787560753.204760:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787560753.204766:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9caffba9c000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1787560753.204785:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafeab13480 x1874392862859776/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787560753.204797:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787560753.204801:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787560753.204803:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787560753.204810:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787560753.204812:0:8:0:(import.c:65:import_set_state_nolock()) ffff9caec32fd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787560753.204815:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 462 00000100:00080000:1.0:1787560753.204817:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787560753.204820:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9caec32fd800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1787560753.204832:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafeab12300 x1874392862859904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787560753.204866:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862860032:0@lo:400:kworker.0 00000100:00100000:1.0:1787560753.204926:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560753.205000:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862860032 00000100:00100000:1.0:1787560753.205007:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862860032 00000100:00100000:0.0:1787560753.205257:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787560753.205269:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862859648:0@lo:400:kworker.0 00000100:00100000:0.0:1787560753.205303:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560753.205338:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862859648 00000100:00100000:0.0:1787560753.205341:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862859648 00000100:00100000:0.0:1787560753.205369:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787560753.205377:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc2c82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+12:3625:x1874392862859648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560753.205454:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc2c82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+12:3625:x1874392862859648:12345-0@lo:400:kworker.0 Request processed in 78us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560753.205462:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787560753.205508:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862859648:0@lo:400:kworker.0 00000100:00100000:0.0:1787560753.205526:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862859776:0@lo:38:kworker.0 00000100:00100000:0.0:1787560753.205552:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560753.205570:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862859904:0@lo:8:kworker.0 00000400:00000100:0.0:1787560753.205590:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874392862859904 offset 0 length 520: 4 00000100:00100000:0.0:1787560753.205613:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862859776 00000100:00100000:0.0:1787560753.205616:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862859776 00000100:00100000:0.0:1787560753.205637:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787560753.205650:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1874392862859776:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787560753.205668:0:17179:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787560753.205714:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1874392862859776:12345-0@lo:38:kworker.0 Request processed in 63us (160us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787560753.205721:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787560753.205749:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffba9c000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787560753.205753:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787560753.205756:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862859776:0@lo:38:kworker.0 00000100:00100000:1.0:1787560753.206368:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787560753.206393:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862860032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560753.206469:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862860032:12345-0@lo:400:kworker.0 Request processed in 91us (1543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560753.206476:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787560753.207560:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cafeab13100 x1874392862860032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560753.207575:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862860032:0@lo:400:kworker.0 00000100:00100000:0.0:1787560753.401152:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2900 going to sleep for 0 seconds 00010000:00010000:1.0:1787560753.716157:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560754.423210:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2900 going to sleep for 0 seconds 00010000:00010000:3.0:1787560754.740607:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787560755.380800:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787560755.444272:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2900 going to sleep for 0 seconds 00010000:00010000:3.0:1787560755.764571:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560756.467522:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2900 going to sleep for 0 seconds 00010000:00010000:3.0:1787560756.791513:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560757.494234:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2900 going to sleep for 0 seconds 00010000:00010000:1.0:1787560757.813805:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787560758.324134:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787560758.324141:0:15403:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787560758.324144:0:15403:0:(import.c:65:import_set_state_nolock()) ffff9caffba9c000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787560758.324151:0:15403:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 472 00000100:00080000:1.0:1787560758.324155:0:15403:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787560758.324162:0:15403:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9caffba9c000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1787560758.324186:0:15403:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafeab12680 x1874392862860288/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787560758.324207:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787560758.324211:0:15403:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787560758.324213:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787560758.324217:0:15403:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787560758.324255:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862860288:0@lo:38:kworker.0 00000100:00100000:1.0:1787560758.324329:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560758.324396:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862860416:0@lo:400:kworker.0 00000100:00100000:1.0:1787560758.324463:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560758.324495:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862860288 00000100:00100000:1.0:1787560758.324503:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862860288 00000100:00100000:1.0:1787560758.324537:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787560758.324545:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1874392862860288:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787560758.324563:0:17179:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787560758.325161:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560758.325173:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f08f2f56-c18f-4579-88a9-05007f76ffc9:3623:1874392862860160:0@lo:400:kworker.0 00000100:00100000:0.0:1787560758.325213:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560758.325883:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862860160 00000100:00100000:2.0:1787560758.325898:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862860160 00000100:00100000:2.0:1787560758.325939:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787560758.325958:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+12:3623:x1874392862860160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560758.326016:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+12:3623:x1874392862860160:12345-0@lo:400:kworker.0 Request processed in 60us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560758.326023:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787560758.326071:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f08f2f56-c18f-4579-88a9-05007f76ffc9:3623:1874392862860160:0@lo:400:kworker.0 00000100:00100000:3.0:1787560758.329124:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862860416 00000100:00100000:3.0:1787560758.329139:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862860416 00000100:00100000:3.0:1787560758.329201:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787560758.329212:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862860416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560758.329307:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862860416:12345-0@lo:400:kworker.0 Request processed in 97us (4843us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560758.329315:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787560758.329363:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cafeab10000 x1874392862860416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560758.329377:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862860416:0@lo:400:kworker.0 00000100:00100000:0.0:1787560758.397511:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1874392862860288:12345-0@lo:38:kworker.0 Request processed in 72956us (73171us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787560758.397527:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787560758.397657:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffba9c000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787560758.397664:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787560758.397668:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862860288:0@lo:38:kworker.0 00000100:00100000:0.0:1787560758.529469:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2900 going to sleep for 0 seconds 00010000:00010000:3.0:1787560758.840509:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560759.545934:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2900 going to sleep for 0 seconds 00010000:00010000:3.0:1787560759.861801:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787560760.086881:0:17906:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787560760.086887:0:17906:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787560760.086889:0:17906:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787560760.087224:0:17906:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9cafc6f14000 00000020:01000004:3.0:1787560760.087248:0:17906:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1787560760.087734:0:17906:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787560760.087772:0:17906:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9caec2fb4d28) 00000020:00000080:3.0:1787560760.087793:0:17906:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787560760.202544:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1787560760.203305:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1787560760.226639:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1787560760.227564:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1787560760.227930:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1787560760.228576:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1787560760.228853:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1787560760.229292:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1787560760.230716:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1787560760.231545:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1787560760.231859:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1787560760.232299:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1787560760.233229:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1787560760.233660:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1787560760.233924:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1787560760.234252:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1787560760.234687:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1787560760.235667:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1787560760.236288:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1787560760.236722:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1787560760.237210:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1787560760.237650:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1787560760.238244:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1787560760.238943:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1787560760.239745:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1787560760.240682:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1787560760.241189:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1787560760.241572:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1787560760.241764:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1787560760.242203:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1787560760.243554:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1787560760.244722:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1787560760.245921:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1787560760.246221:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1787560760.247810:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787560760.250546:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1787560760.251214:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1787560760.251643:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787560760.251904:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787560760.252594:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787560760.253183:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1787560760.254109:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787560760.254591:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1787560760.255261:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1787560760.259481:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1787560760.260333:0:17906:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:01000000:2.0:1787560760.264356:0:17906:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787560760.264775:0:17906:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1787560760.264800:0:17906:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787560760.264815:0:17906:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4642c20bf2f34ebd 00000020:01000004:2.0:1787560760.264825:0:17906:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787560760.264853:0:17906:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.129@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787560760.264869:0:17906:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787560760.264877:0:17906:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1787560760.264912:0:17906:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1787560760.264917:0:17906:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.129@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1787560760.269967:0:17906:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787560760.270014:0:17906:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.129@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1787560760.270020:0:17906:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787560760.270022:0:17906:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787560760.270023:0:17906:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560760.270025:0:17906:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560760.270026:0:17906:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560760.270027:0:17906:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560760.270029:0:17906:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787560760.270031:0:17906:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560760.270033:0:17906:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787560760.270037:0:17906:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1787560760.270040:0:17906:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787560760.270047:0:17906:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787560760.270048:0:17906:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560760.270049:0:17906:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560760.270050:0:17906:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560760.270051:0:17906:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560760.270052:0:17906:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787560760.270053:0:17906:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560760.270054:0:17906:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787560760.270105:0:17906:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787560760.270132:0:17906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862860544:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787560760.270223:0:17906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560760.270294:0:17906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffbb62480 going to sleep for 11 seconds 00000100:00100000:0.0:1787560760.270920:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862860544 00000100:00100000:0.0:1787560760.270930:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862860544 00000100:00100000:0.0:1787560760.270997:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787560760.271034:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+12:17906:x1874392862860544:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787560760.271092:0:17168:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787560760.271096:0:17168:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1787560760.271105:0:17168:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1787560760.271965:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+12:17906:x1874392862860544:12345-0@lo:253:mount.lustre.0 Request processed in 931us (1737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560760.271976:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787560760.272060:0:17906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862860544:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787560760.272091:0:17906:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787560760.272095:0:17906:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787560760.272097:0:17906:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787560760.272098:0:17906:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560760.272099:0:17906:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560760.272101:0:17906:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560760.272102:0:17906:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560760.272104:0:17906:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787560760.272106:0:17906:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560760.272107:0:17906:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787560760.272132:0:17906:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cafc6f14000 from lustre-MDT0001 10000000:01000000:2.0:1787560760.272173:0:17906:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1787560760.272177:0:17906:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787560760.272186:0:17906:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9caff4908000 local copy 00010000:00010000:2.0:1787560760.272200:0:17906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb002177000/0x4642c20bf2f34db3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34dba expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560760.272350:0:17906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862860672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560760.272392:0:17906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560760.272500:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862860672 00000100:00100000:0.0:1787560760.272508:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862860672 00000100:00100000:0.0:1787560760.272555:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787560760.272567:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+12:17906:x1874392862860672:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560760.272601:0:17906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc81fef00 going to sleep for 11 seconds 00000100:00100000:0.0:1787560760.272665:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+12:17906:x1874392862860672:12345-0@lo:501:mount.lustre.0 Request processed in 101us (272us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787560760.272675:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787560760.272791:0:17906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862860672:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787560760.272827:0:17906:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787560760.272855:0:17906:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787560760.272862:0:17906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb002177000/0x4642c20bf2f34db3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34dba expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560760.272870:0:17906:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cb002177000/0x4642c20bf2f34db3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34dba expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560760.272893:0:17906:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cafc6f14000 10000000:01000000:2.0:1787560760.272897:0:17906:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787560760.272902:0:17906:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9caff4908000 10000000:01000000:2.0:1787560760.272904:0:17906:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787560760.272906:0:17906:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9caff4908000 from 1 10000000:01000000:2.0:1787560760.272909:0:17906:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787560760.272930:0:17906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec2169400/0x4642c20bf2f34ec4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560760.272936:0:17906:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caec2169400/0x4642c20bf2f34ec4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560760.272944:0:17906:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caec2169400/0x4642c20bf2f34ec4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560760.272952:0:17906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862860800:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787560760.272973:0:17906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560760.272992:0:17906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc81fef00 going to sleep for 11 seconds 00000100:00100000:0.0:1787560760.273094:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862860800 00000100:00100000:0.0:1787560760.273098:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862860800 00000100:00100000:0.0:1787560760.273132:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787560760.273139:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+12:17906:x1874392862860800:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787560760.273149:0:17168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560760.273166:0:17168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caec3881000/0x4642c20bf2f34ecb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f34ec4 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560760.273190:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caec3881000/0x4642c20bf2f34ecb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f34ec4 expref: 13 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560760.273202:0:17168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caec3881000/0x4642c20bf2f34ecb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f34ec4 expref: 13 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560760.273225:0:17168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881000, rc 0) 00000100:00100000:0.0:1787560760.274689:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+13:17906:x1874392862860800:12345-0@lo:101:mount.lustre.0 Request processed in 1539us (1703us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560760.274699:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787560760.274739:0:17906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862860800:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787560760.274769:0:17906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caec2169400/0x4642c20bf2f34ec4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34ecb expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560760.274798:0:17906:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caec2169400/0x4642c20bf2f34ec4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f34ecb expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560760.274821:0:17906:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787560760.274847:0:17906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec2169400/0x4642c20bf2f34ec4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34ecb expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560760.274855:0:17906:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caec2169400/0x4642c20bf2f34ec4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34ecb expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560760.274866:0:17906:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9cafc6f14000 10000000:01000000:2.0:1787560760.274871:0:17906:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787560760.274877:0:17906:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9cafc6f14000 from 1 10000000:01000000:2.0:1787560760.274879:0:17906:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787560760.274910:0:17906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec2168600/0x4642c20bf2f34ed2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560760.274917:0:17906:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caec2168600/0x4642c20bf2f34ed2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560760.274927:0:17906:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caec2168600/0x4642c20bf2f34ed2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560760.274946:0:17906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862860928:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787560760.274990:0:17906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560760.275035:0:17906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc81fef00 going to sleep for 11 seconds 00000100:00100000:3.0:1787560760.275171:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862860928 00000100:00100000:3.0:1787560760.275178:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862860928 00000100:00100000:3.0:1787560760.275222:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787560760.275233:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+13:17906:x1874392862860928:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787560760.275248:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560760.275262:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cb002177400/0x4642c20bf2f34ed9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f34ed2 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560760.275298:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cb002177400/0x4642c20bf2f34ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f34ed2 expref: 14 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560760.275309:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cb002177400/0x4642c20bf2f34ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f34ed2 expref: 14 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560760.275319:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb002177400, rc 0) 00000100:00100000:3.0:1787560760.275372:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+14:17906:x1874392862860928:12345-0@lo:101:mount.lustre.0 Request processed in 141us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560760.275379:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787560760.275613:0:17906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862860928:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787560760.275635:0:17906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caec2168600/0x4642c20bf2f34ed2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34ed9 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560760.275646:0:17906:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caec2168600/0x4642c20bf2f34ed2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f34ed9 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560760.275660:0:17906:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787560760.275665:0:17906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec2168600/0x4642c20bf2f34ed2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34ed9 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560760.275673:0:17906:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caec2168600/0x4642c20bf2f34ed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34ed9 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560760.275680:0:17906:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787560760.275685:0:17906:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787560760.275691:0:17906:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9cafc6f14000 10000000:01000000:1.0:1787560760.275695:0:17906:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787560760.275698:0:17906:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1787560760.275701:0:17906:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787560760.275720:0:17906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f34ee0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560760.275739:0:17906:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f34ee0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560760.275749:0:17906:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f34ee0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560760.275763:0:17906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab12680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862861056:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787560760.275797:0:17906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560760.275831:0:17906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafeec68540 going to sleep for 11 seconds 00000100:00100000:0.0:1787560760.275899:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862861056 00000100:00100000:0.0:1787560760.275904:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862861056 00000100:00100000:0.0:1787560760.275945:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787560760.275952:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+14:17906:x1874392862861056:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787560760.275962:0:17168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560760.275973:0:17168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caec3881a00/0x4642c20bf2f34ee7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f34ee0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560760.275988:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caec3881a00/0x4642c20bf2f34ee7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f34ee0 expref: 15 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560760.275997:0:17168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caec3881a00/0x4642c20bf2f34ee7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f34ee0 expref: 15 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560760.276004:0:17168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881a00, rc 0) 00000100:00100000:0.0:1787560760.276041:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+15:17906:x1874392862861056:12345-0@lo:101:mount.lustre.0 Request processed in 89us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560760.276048:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787560760.276171:0:17906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab12680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862861056:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787560760.276183:0:17906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f34ee0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34ee7 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560760.276191:0:17906:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f34ee0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f34ee7 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787560760.281194:0:17906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1787560760.282047:0:17906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787560760.288287:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787560760.288883:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1787560760.288899:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1787560760.288912:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1787560760.288929:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1787560760.288943:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1787560760.288957:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1787560760.288972:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1787560760.288986:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1787560760.289063:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1787560760.289102:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1787560760.289116:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1787560760.289128:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:1.0:1787560760.289141:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1787560760.289152:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1787560760.289165:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1787560760.289177:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1787560760.289191:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1787560760.289205:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1787560760.289219:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1787560760.289232:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1787560760.289244:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1787560760.289256:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1787560760.289292:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1787560760.289299:0:17906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1787560760.289753:0:17906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab12680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862861184:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787560760.289844:0:17906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560760.289897:0:17906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe33fcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787560760.291357:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862861184 00000100:00100000:2.0:1787560760.291373:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862861184 00000100:00100000:2.0:1787560760.291514:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787560760.291529:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+15:17906:x1874392862861184:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560760.291784:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+15:17906:x1874392862861184:12345-0@lo:501:mount.lustre.0 Request processed in 259us (1939us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560760.291793:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787560760.292095:0:17906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab12680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862861184:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787560760.292155:0:17906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab12680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862861312:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787560760.292215:0:17906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560760.292254:0:17906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe33fcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787560760.292326:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862861312 00000100:00100000:3.0:1787560760.292332:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862861312 00000100:00100000:3.0:1787560760.292381:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787560760.292391:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+15:17906:x1874392862861312:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787560760.297016:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+15:17906:x1874392862861312:12345-0@lo:503:mount.lustre.0 Request processed in 4614us (4788us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560760.297034:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787560760.297210:0:17906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab12680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862861312:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787560760.298903:0:17906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787560760.299222:0:17906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab12680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862861440:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787560760.299956:0:17906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560760.300018:0:17906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd176ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787560760.300173:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862861440 00000100:00100000:2.0:1787560760.300183:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862861440 00000100:00100000:2.0:1787560760.300276:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787560760.300288:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+15:17906:x1874392862861440:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787560760.301676:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+15:17906:x1874392862861440:12345-0@lo:502:mount.lustre.0 Request processed in 1383us (1714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560760.301688:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787560760.301810:0:17906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab12680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862861440:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787560760.302178:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787560760.302213:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1787560760.302229:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1787560760.302241:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1787560760.302253:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1787560760.302266:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1787560760.302280:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1787560760.302293:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1787560760.302323:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1787560760.302350:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1787560760.302365:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1787560760.302379:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1787560760.302391:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1787560760.302415:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1787560760.302428:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1787560760.302476:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1787560760.302489:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1787560760.302504:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1787560760.302519:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1787560760.302531:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1787560760.302545:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1787560760.302559:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1787560760.302574:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1787560760.302590:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1787560760.302801:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1787560760.302815:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1787560760.302829:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1787560760.302842:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1787560760.302855:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1787560760.302867:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1787560760.302879:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1787560760.302904:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1787560760.302920:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1787560760.302932:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1787560760.302945:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1787560760.302959:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1787560760.302971:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1787560760.302982:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1787560760.302995:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1787560760.303008:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1787560760.303019:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1787560760.303029:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1787560760.303041:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1787560760.303051:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1787560760.303110:0:17906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe19880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862861568:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787560760.303198:0:17906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560760.305155:0:17906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc8af8240 going to sleep for 11 seconds 00000100:00100000:1.0:1787560760.305371:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862861568 00000100:00100000:1.0:1787560760.305410:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862861568 00000100:00100000:1.0:1787560760.305496:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787560760.305508:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+15:17906:x1874392862861568:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787560760.305985:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+15:17906:x1874392862861568:12345-0@lo:502:mount.lustre.0 Request processed in 478us (2785us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560760.306004:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787560760.306279:0:17906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe19880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862861568:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787560760.306402:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1787560760.306419:0:17906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1787560760.308698:0:17910:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560760.308717:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560760.308720:0:17910:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1787560760.308726:0:17910:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1787560760.308730:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787560760.308751:0:17910:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9caec2fb19b8) 00000020:00000080:3.0:1787560760.308781:0:17910:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1787560760.308787:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787560760.308912:0:17910:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787560760.308922:0:17910:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4642c20bf2f34ef5 00000020:00000080:3.0:1787560760.309279:0:17910:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1787560760.309286:0:17910:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560760.309290:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560760.309292:0:17910:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1787560760.309295:0:17910:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560760.309299:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560760.309301:0:17910:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1787560760.309305:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787560760.311537:0:17910:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9caec2fb3370) 00000020:00000080:3.0:1787560760.311569:0:17910:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1787560760.311589:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787560760.311592:0:17910:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1787560760.311955:0:17910:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1787560760.311968:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787560760.312243:0:17910:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cafc6f14000 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1787560760.312264:0:17910:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9cafef9f99b8) 00000020:00000080:3.0:1787560760.312290:0:17910:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1787560760.312917:0:17910:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787560760.312928:0:17910:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4642c20bf2f34f0a 00000020:00000080:3.0:1787560760.313186:0:17910:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1787560760.313195:0:17910:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787560760.313200:0:17910:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x4642c20bf2f34f11 00080000:01000000:3.0:1787560760.313210:0:17910:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787560760.313215:0:17910:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4642c20bf2f34f18 00010000:00010000:2.0:1787560760.474760:0:17910:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1787560760.477643:0:17910:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1787560760.479111:0:17910:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787560760.486260:0:17910:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1787560760.486275:0:17910:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560760.486283:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560760.486286:0:17910:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1787560760.486290:0:17910:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560760.486307:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560760.486310:0:17910:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1787560760.486314:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787560760.486320:0:17910:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:00000080:0.0:1787560760.486356:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787560760.486373:0:17910:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9caffb993370) 00000020:00000080:0.0:1787560760.486406:0:17910:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1787560760.486419:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787560760.486751:0:17910:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1787560760.486759:0:17910:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787560760.486766:0:17910:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4642c20bf2f34f26 00010000:00080000:0.0:1787560760.486794:0:17910:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9caffbb0b800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.129@tcp at head 00010000:00010000:3.0:1787560760.501011:0:17910:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1787560760.527226:0:17910:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787560760.527240:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787560760.527304:0:17910:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787560760.527328:0:17910:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4642c20bf2f34f2d 00000100:00080000:3.0:1787560760.527338:0:17910:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787560760.527343:0:17910:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9caffbb0b800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787560760.527385:0:17910:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafffe19880 x1874392862861696/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787560760.527413:0:17910:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1787560760.527487:0:17910:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560760.527490:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560760.527492:0:17910:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1787560760.527496:0:17910:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787560760.527498:0:17910:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1787560760.527500:0:17910:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787560760.527501:0:17910:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787560760.527502:0:17910:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787560760.527505:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560760.527506:0:17910:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787560760.527508:0:17910:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560760.527511:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560760.527513:0:17910:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1787560760.527515:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787560760.527555:0:17910:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787560760.527571:0:17910:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560760.527574:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560760.527576:0:17910:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1787560760.527579:0:17910:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787560760.527580:0:17910:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1787560760.527581:0:17910:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787560760.527583:0:17910:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787560760.527584:0:17910:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787560760.527586:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560760.527588:0:17910:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787560760.527590:0:17910:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787560760.527593:0:17910:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787560760.527596:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560760.527597:0:17910:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787560760.527599:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787560760.527603:0:17910:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:01000000:3.0:1787560760.527627:0:17910:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1787560760.527629:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787560760.527642:0:17910:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9cafef9fcd28) 00000020:00000080:3.0:1787560760.527654:0:17910:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1787560760.527659:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787560760.527723:0:17910:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1787560760.527729:0:17910:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787560760.527738:0:17910:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4642c20bf2f34f3b 00010000:00080000:3.0:1787560760.527776:0:17910:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9caffcbc6800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.129@tcp at head 00010000:00010000:3.0:1787560760.528019:0:17910:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:0.0:1787560760.528480:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787560760.528485:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787560760.528488:0:8:0:(import.c:65:import_set_state_nolock()) ffff9caffba9c000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787560760.528493:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 477 00000100:00080000:0.0:1787560760.528497:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787560760.528501:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9caffba9c000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:0.0:1787560760.528525:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafffe4f480 x1874392862861824/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787560760.528538:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787560760.528541:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787560760.528544:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787560760.528547:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787560760.528873:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862861696:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787560760.528945:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560760.529001:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862861824:0@lo:38:kworker.0 00000100:00100000:2.0:1787560760.529025:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560760.529076:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862861696 00000100:00100000:2.0:1787560760.529083:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862861696 00000100:00100000:2.0:1787560760.529106:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862861824 00000100:00100000:2.0:1787560760.529108:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862861824 00000100:00100000:2.0:1787560760.529133:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787560760.529139:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1874392862861696:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787560760.529161:0:17178:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:2.0:1787560760.529205:0:17178:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4642c20bf2f34f42 00000004:00100000:2.0:1787560760.529220:0:17178:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787560760.529226:0:17178:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1787560760.529620:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862861952:0@lo:400:kworker.0 00000100:00100000:3.0:1787560760.529667:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560760.530237:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862861952 00000100:00100000:2.0:1787560760.530243:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862861952 00000100:00100000:2.0:1787560760.530291:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787560760.530299:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862861952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560760.530358:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862861952:12345-0@lo:400:kworker.0 Request processed in 60us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560760.530365:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787560760.530814:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cafffe4e300 x1874392862861952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560760.530829:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862861952:0@lo:400:kworker.0 00000040:01000000:3.0:1787560760.531033:0:17910:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787560760.531676:0:17910:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1787560760.534530:0:17178:0:(import.c:65:import_set_state_nolock()) ffff9cafeabcc000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787560760.534630:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3622:x1874392862861696:12345-0@lo:38:llog_process_th.0 Request processed in 5487us (5682us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560760.534641:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787560760.534670:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787560760.534676:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1874392862861824:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1787560760.534717:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1874392862861824:12345-0@lo:38:kworker.0 Request processed in 40us (5690us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787560760.534723:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787560760.535230:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787560760.535240:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1787560760.535249:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787560760.535264:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787560760.535267:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffbb0b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787560760.535289:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862861696:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787560760.535304:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787560760.535309:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffba9c000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787560760.535313:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787560760.535316:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862861824:0@lo:38:kworker.0 00000100:00100000:0.0:1787560760.537042:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862862080:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787560760.537125:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560760.537277:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862862080 00000100:00100000:2.0:1787560760.537296:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862862080 00000100:00100000:2.0:1787560760.537350:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787560760.537360:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3623:x1874392862862080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787560760.539042:0:17179:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787560760.541017:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3623:x1874392862862080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3652us (3885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560760.541028:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787560760.541270:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862862080:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1787560760.541618:0:17910:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787560760.543300:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1787560760.544658:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:2.0:1787560760.552333:0:17915:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787560760.552344:0:17915:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787560760.553334:0:17910:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787560760.553347:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787560760.553603:0:17910:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787560760.553627:0:17910:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4642c20bf2f34f49 00000100:00080000:3.0:1787560760.553639:0:17910:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787560760.553645:0:17910:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9caffcbc6800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787560760.553680:0:17910:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafffe18a80 x1874392862862208/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787560760.553746:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862862208:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787560760.553817:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874392862862208 offset 0 length 520: 4 00000100:00080000:3.0:1787560760.553996:0:17910:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787560760.554061:0:17910:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560760.554065:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560760.554067:0:17910:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787560760.554078:0:17910:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787560760.554081:0:17910:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1787560760.554082:0:17910:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787560760.554084:0:17910:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787560760.554085:0:17910:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787560760.554087:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560760.554089:0:17910:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787560760.554091:0:17910:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787560760.554095:0:17910:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787560760.554098:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560760.554100:0:17910:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787560760.554102:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787560760.554106:0:17910:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:01000000:3.0:1787560760.554127:0:17910:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1787560760.554129:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787560760.554142:0:17910:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9cafef9f8000) 00000020:00000080:3.0:1787560760.554165:0:17910:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1787560760.554171:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787560760.554243:0:17910:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1787560760.554250:0:17910:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787560760.554256:0:17910:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4642c20bf2f34f57 00010000:00080000:3.0:1787560760.554285:0:17910:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cafc5251800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.129@tcp at head 00010000:00010000:3.0:1787560760.555013:0:17910:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1787560760.555087:0:17910:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787560760.555101:0:17910:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:1.0:1787560760.556266:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787560760.556274:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787560760.556276:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787560760.556279:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1787560760.558330:0:17910:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787560760.559256:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1787560760.559375:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1787560760.561820:0:17917:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787560760.561826:0:17917:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787560760.563255:0:17910:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787560760.563267:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787560760.563305:0:17910:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787560760.563325:0:17910:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4642c20bf2f34f5e 00000100:00080000:3.0:1787560760.563334:0:17910:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787560760.563339:0:17910:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9cafc5251800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787560760.563371:0:17910:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafffe19c00 x1874392862862336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787560760.563399:0:17910:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1787560760.563555:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862862336:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787560760.563607:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874392862862336 offset 0 length 520: 4 00000100:00100000:2.0:1787560760.563754:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2900 going to sleep for 0 seconds 00000020:01000000:3.0:1787560760.564113:0:17910:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560760.564118:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560760.564119:0:17910:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787560760.564122:0:17910:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560760.564126:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560760.564127:0:17910:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787560760.564129:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787560760.564131:0:17910:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787560760.564133:0:17910:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560760.564135:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560760.564143:0:17910:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787560760.564146:0:17910:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560760.564148:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560760.564149:0:17910:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787560760.564153:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787560760.564181:0:17910:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560760.564183:0:17910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560760.564184:0:17910:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787560760.564187:0:17910:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:2.0:1787560760.564378:0:17906:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1787560760.564408:0:17906:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787560760.564448:0:17906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f34ee0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34ee7 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560760.564459:0:17906:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f34ee0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34ee7 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560760.564467:0:17906:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cafc6f14000 from 1 10000000:01000000:2.0:1787560760.564469:0:17906:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787560760.564497:0:17906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec2169200/0x4642c20bf2f34f65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560760.564506:0:17906:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caec2169200/0x4642c20bf2f34f65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560760.564517:0:17906:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caec2169200/0x4642c20bf2f34f65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560760.564533:0:17906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862862464:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787560760.564577:0:17906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560760.564609:0:17906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd08cdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787560760.565533:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862862464 00000100:00100000:3.0:1787560760.565542:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862862464 00000100:00100000:3.0:1787560760.565588:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787560760.565597:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4088c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+15:17906:x1874392862862464:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787560760.565610:0:17168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560760.565623:0:17168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cb002177800/0x4642c20bf2f34f6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f34f65 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560760.565647:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cb002177800/0x4642c20bf2f34f6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f34f65 expref: 16 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560760.565656:0:17168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cb002177800/0x4642c20bf2f34f6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f34f65 expref: 16 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560760.565665:0:17168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb002177800, rc 0) 00000100:00100000:3.0:1787560760.565715:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4088c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+16:17906:x1874392862862464:12345-0@lo:101:mount.lustre.0 Request processed in 118us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560760.565721:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787560760.566911:0:17906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862862464:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787560760.566933:0:17906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caec2169200/0x4642c20bf2f34f65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34f6c expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560760.566943:0:17906:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caec2169200/0x4642c20bf2f34f65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f34f6c expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560760.567792:0:17906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862862592:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787560760.567850:0:17906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560760.568227:0:17906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd08cdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787560760.568309:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862862592 00000100:00100000:0.0:1787560760.568316:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862862592 00000100:00100000:0.0:1787560760.568363:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787560760.568372:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+16:17906:x1874392862862592:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787560760.568391:0:17166:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787560760.568407:0:17166:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787560760.568410:0:17166:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1787560760.568514:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+16:17906:x1874392862862592:12345-0@lo:256:mount.lustre.0 Request processed in 142us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560760.568522:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787560760.568717:0:17906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862862592:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787560760.574148:0:17906:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787560760.574207:0:17906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec2169200/0x4642c20bf2f34f65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34f6c expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560760.574221:0:17906:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caec2169200/0x4642c20bf2f34f65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34f6c expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560760.574230:0:17906:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cafc6f14000 from 1 10000000:01000000:2.0:1787560760.574232:0:17906:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787560760.574270:0:17906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec2169a00/0x4642c20bf2f34f73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560760.574278:0:17906:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caec2169a00/0x4642c20bf2f34f73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560760.574289:0:17906:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caec2169a00/0x4642c20bf2f34f73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560760.574324:0:17906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862862720:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787560760.574398:0:17906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560760.574454:0:17906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd08cdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787560760.578658:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862862720 00000100:00100000:0.0:1787560760.578674:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862862720 00000100:00100000:0.0:1787560760.578754:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787560760.578766:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4088050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+16:17906:x1874392862862720:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787560760.578783:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560760.578801:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caec3880400/0x4642c20bf2f34f7a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f34f73 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560760.578827:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caec3880400/0x4642c20bf2f34f7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f34f73 expref: 17 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560760.578838:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caec3880400/0x4642c20bf2f34f7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f34f73 expref: 17 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560760.578847:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3880400, rc 0) 00000100:00100000:0.0:1787560760.578930:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4088050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+17:17906:x1874392862862720:12345-0@lo:101:mount.lustre.0 Request processed in 167us (4531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560760.578938:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787560760.579260:0:17906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862862720:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787560760.579281:0:17906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caec2169a00/0x4642c20bf2f34f73 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34f7a expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560760.579290:0:17906:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caec2169a00/0x4642c20bf2f34f73 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f34f7a expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787560760.579489:0:17906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787560760.579532:0:17906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862862848:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560760.579567:0:17906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560760.579597:0:17906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd08cd000 going to sleep for 11 seconds 00000100:00080000:2.0:1787560760.579613:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560760.579617:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787560760.579620:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560760.579623:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787560760.579778:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862862848 00000100:00100000:0.0:1787560760.579784:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862862848 00000100:00100000:0.0:1787560760.579822:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787560760.579830:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+17:17906:x1874392862862848:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787560760.579930:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+17:17906:x1874392862862848:12345-0@lo:501:mount.lustre.0 Request processed in 101us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560760.579938:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787560760.580159:0:17906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862862848:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560760.580184:0:17906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862862976:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787560760.580216:0:17906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560760.580239:0:17906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd08cd000 going to sleep for 11 seconds 00000100:00100000:1.0:1787560760.580282:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862862976 00000100:00100000:1.0:1787560760.580286:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862862976 00000100:00100000:1.0:1787560760.580314:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787560760.580321:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+17:17906:x1874392862862976:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787560760.580404:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+17:17906:x1874392862862976:12345-0@lo:503:mount.lustre.0 Request processed in 83us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560760.580417:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787560760.580620:0:17906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862862976:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787560760.580973:0:17906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787560760.581161:0:17906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862863104:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787560760.581202:0:17906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560760.581278:0:17906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd08cdd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787560760.586633:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862863104 00000100:00100000:1.0:1787560760.586651:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862863104 00000100:00100000:1.0:1787560760.586737:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787560760.586750:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+17:17906:x1874392862863104:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787560760.586936:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+17:17906:x1874392862863104:12345-0@lo:502:mount.lustre.0 Request processed in 189us (5732us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560760.586944:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787560760.587162:0:17906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862863104:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787560760.587488:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787560760.587517:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:2.0:1787560760.587530:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:2.0:1787560760.587542:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:2.0:1787560760.587554:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:2.0:1787560760.587582:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:2.0:1787560760.587597:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:2.0:1787560760.587609:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:2.0:1787560760.587620:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787560760.587632:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:2.0:1787560760.587661:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:2.0:1787560760.587697:0:17906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862863232:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787560760.587742:0:17906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560760.587774:0:17906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd08cdd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787560760.587972:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862863232 00000100:00100000:1.0:1787560760.587985:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862863232 00000100:00100000:1.0:1787560760.588305:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787560760.588315:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+17:17906:x1874392862863232:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787560760.589175:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+17:17906:x1874392862863232:12345-0@lo:502:mount.lustre.0 Request processed in 101us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560760.589185:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787560760.589717:0:17906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862863232:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787560760.589813:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:2.0:1787560760.589827:0:17906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1787560760.590903:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560760.590912:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560760.590915:0:17919:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787560760.590921:0:17919:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cafc6f14000 00000020:00000080:1.0:1787560760.590924:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787560760.590931:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560760.590933:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560760.590934:0:17919:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787560760.590937:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560760.590939:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560760.590940:0:17919:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787560760.590944:0:17919:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cafc6f14000 00000020:00000080:1.0:1787560760.590946:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787560760.591179:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560760.591184:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560760.591185:0:17919:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787560760.591187:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560760.591189:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560760.591191:0:17919:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787560760.591194:0:17919:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cafc6f14000 00000020:00000080:1.0:1787560760.591197:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787560760.591215:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560760.591218:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560760.591219:0:17919:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787560760.591220:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560760.591223:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560760.591232:0:17919:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787560760.591236:0:17919:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cafc6f14000 00000020:00000080:1.0:1787560760.591237:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787560760.591259:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560760.591263:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560760.591264:0:17919:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787560760.591267:0:17919:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1787560760.604114:0:17906:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787560760.604162:0:17906:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787560760.604188:0:17906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec2169a00/0x4642c20bf2f34f73 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34f7a expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560760.604201:0:17906:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caec2169a00/0x4642c20bf2f34f73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34f7a expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560760.604256:0:17906:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787560760.604259:0:17906:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cafc6f14000 10000000:01000000:0.0:1787560760.604262:0:17906:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cafc6f14000 10000000:01000000:0.0:1787560760.604266:0:17906:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787560760.604273:0:17906:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cafc6f14000 from 1 10000000:01000000:0.0:1787560760.604276:0:17906:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787560760.604316:0:17906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3881c00/0x4642c20bf2f34f81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560760.604324:0:17906:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caec3881c00/0x4642c20bf2f34f81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560760.604334:0:17906:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caec3881c00/0x4642c20bf2f34f81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560760.604357:0:17906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862863360:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787560760.604465:0:17906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560760.604504:0:17906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe06da6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560760.604656:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862863360 00000100:00100000:1.0:1787560760.604664:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862863360 00000100:00100000:1.0:1787560760.604712:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787560760.604721:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+17:17906:x1874392862863360:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787560760.604733:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560760.604746:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cb0021fec00/0x4642c20bf2f34f88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f34f81 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560760.604770:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cb0021fec00/0x4642c20bf2f34f88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f34f81 expref: 18 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560760.604780:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cb0021fec00/0x4642c20bf2f34f88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f34f81 expref: 18 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560760.604789:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb0021fec00, rc 0) 00000100:00100000:1.0:1787560760.604833:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:17906:x1874392862863360:12345-0@lo:101:mount.lustre.0 Request processed in 113us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560760.604840:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787560760.604898:0:17906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862863360:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787560760.604911:0:17906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caec3881c00/0x4642c20bf2f34f81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34f88 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560760.604921:0:17906:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caec3881c00/0x4642c20bf2f34f81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f34f88 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787560760.612908:0:17906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1787560760.613225:0:17906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787560760.613404:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1787560760.613450:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:1.0:1787560760.613469:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:1.0:1787560760.613483:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:1.0:1787560760.613496:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:1.0:1787560760.613507:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:1.0:1787560760.613518:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:1.0:1787560760.613549:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:1.0:1787560760.613564:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:1.0:1787560760.613576:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:1.0:1787560760.613589:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:1.0:1787560760.613600:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:1.0:1787560760.613611:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:1.0:1787560760.613623:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:1.0:1787560760.613634:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:1.0:1787560760.613646:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:1.0:1787560760.613659:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:1.0:1787560760.613669:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:1.0:1787560760.613680:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:1.0:1787560760.613690:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:1.0:1787560760.613701:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:1.0:1787560760.613711:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:1.0:1787560760.613723:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:1.0:1787560760.613749:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:1.0:1787560760.613765:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:1.0:1787560760.613777:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:1.0:1787560760.613789:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:1.0:1787560760.613802:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:1.0:1787560760.613820:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:1.0:1787560760.613834:0:17906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1787560760.613912:0:17906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862863488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787560760.613979:0:17906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560760.614027:0:17906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c5180 going to sleep for 11 seconds 00000100:00100000:3.0:1787560760.614250:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862863488 00000100:00100000:3.0:1787560760.614259:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862863488 00000100:00100000:3.0:1787560760.614304:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787560760.614312:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:17906:x1874392862863488:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787560760.614425:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:17906:x1874392862863488:12345-0@lo:501:mount.lustre.0 Request processed in 113us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560760.614453:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787560760.620699:0:17906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862863488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787560760.620763:0:17906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862863616:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787560760.620841:0:17906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560760.620889:0:17906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c5180 going to sleep for 11 seconds 00000100:00100000:2.0:1787560760.621210:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862863616 00000100:00100000:2.0:1787560760.621218:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862863616 00000100:00100000:2.0:1787560760.621273:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787560760.621283:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:17906:x1874392862863616:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787560760.621399:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:17906:x1874392862863616:12345-0@lo:503:mount.lustre.0 Request processed in 117us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560760.621412:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787560760.622209:0:17906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862863616:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787560760.636777:0:17906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787560760.636872:0:17906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862863744:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787560760.636956:0:17906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560760.637017:0:17906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c5000 going to sleep for 11 seconds 00000100:00100000:0.0:1787560760.637726:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862863744 00000100:00100000:0.0:1787560760.637736:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862863744 00000100:00100000:0.0:1787560760.637792:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787560760.637801:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:17906:x1874392862863744:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787560760.637939:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:17906:x1874392862863744:12345-0@lo:502:mount.lustre.0 Request processed in 137us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560760.637946:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787560760.638053:0:17906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862863744:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787560760.638547:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1787560760.638578:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:1.0:1787560760.638592:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:1.0:1787560760.638605:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:1.0:1787560760.638616:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:1.0:1787560760.638626:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:1.0:1787560760.638637:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:1.0:1787560760.638649:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:1.0:1787560760.638675:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:1.0:1787560760.638690:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:1.0:1787560760.638703:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:1.0:1787560760.638714:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:1.0:1787560760.638725:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:1.0:1787560760.638751:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:1.0:1787560760.638765:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:1.0:1787560760.638778:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:1.0:1787560760.638790:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:1.0:1787560760.638804:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:1.0:1787560760.638816:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:1.0:1787560760.638829:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:1.0:1787560760.638841:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:1.0:1787560760.638853:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:1.0:1787560760.639542:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:1.0:1787560760.639561:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:1.0:1787560760.639595:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:1.0:1787560760.639610:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:1.0:1787560760.639622:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:1.0:1787560760.639635:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:1.0:1787560760.639648:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:1.0:1787560760.639661:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:1.0:1787560760.639673:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:1.0:1787560760.639685:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:1.0:1787560760.639697:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:1.0:1787560760.639707:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:1.0:1787560760.639719:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:1.0:1787560760.639732:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:1.0:1787560760.639745:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:1.0:1787560760.639758:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:1.0:1787560760.639771:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:1.0:1787560760.639783:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:1.0:1787560760.639807:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:1.0:1787560760.639821:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:1.0:1787560760.639833:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:1.0:1787560760.639845:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:1.0:1787560760.639857:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:1.0:1787560760.639869:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:1.0:1787560760.639892:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:1.0:1787560760.639904:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:1.0:1787560760.639953:0:17906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862863872:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787560760.648584:0:17906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560760.648644:0:17906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c5000 going to sleep for 11 seconds 00000100:00100000:2.0:1787560760.649489:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862863872 00000100:00100000:2.0:1787560760.649501:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862863872 00000100:00100000:2.0:1787560760.649563:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787560760.649574:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:17906:x1874392862863872:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787560760.649729:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:17906:x1874392862863872:12345-0@lo:502:mount.lustre.0 Request processed in 156us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560760.649737:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787560760.657274:0:17906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862863872:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787560760.657549:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:1.0:1787560760.657577:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:1.0:1787560760.657613:0:17906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862864000:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787560760.657683:0:17906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560760.657732:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862864000 00000100:00100000:1.0:1787560760.657740:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862864000 00000100:00100000:1.0:1787560760.657783:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787560760.657793:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:17906:x1874392862864000:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787560760.657895:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:17906:x1874392862864000:12345-0@lo:502:mount.lustre.0 Request processed in 103us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560760.657902:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787560760.657951:0:17906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c5000 going to sleep for 11 seconds 00000100:00100000:1.0:1787560760.657965:0:17906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862864000:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787560760.658019:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:1.0:1787560760.658028:0:17906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1787560760.670253:0:17924:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1787560760.670270:0:17924:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9cafef9fb370) 00000020:00000080:3.0:1787560760.670292:0:17924:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1787560760.673659:0:17924:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cafc6f14000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1787560760.675586:0:17924:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cafc6f14000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1787560760.675595:0:17924:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cafc6f14000 3 00010000:00080000:0.0:1787560760.675641:0:17924:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9caffbb08800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.129@tcp at head 00010000:00010000:0.0:1787560760.683688:0:17924:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1787560760.683895:0:17924:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1787560760.683947:0:17924:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787560760.683961:0:17924:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x4642c20bf2f34f96 00000100:00080000:0.0:1787560760.683972:0:17924:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787560760.683978:0:17924:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9caffbb08800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:0.0:1787560760.684024:0:17924:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafffe4f800 x1874392862864128/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787560760.684051:0:17924:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787560760.684564:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874392862864128:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787560760.684632:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560760.686013:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862864128 00000100:00100000:2.0:1787560760.686025:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862864128 00000100:00100000:2.0:1787560760.686081:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787560760.686090:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1874392862864128:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787560760.686118:0:17173:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:2.0:1787560760.686155:0:17173:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x4642c20bf2f34f9d 00000004:00100000:2.0:1787560760.686169:0:17173:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787560760.686198:0:17173:0:(import.c:65:import_set_state_nolock()) ffff9cafeabc8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787560760.686263:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874392862864128:12345-0@lo:38:llog_process_th.0 Request processed in 174us (1631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560760.686271:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787560760.691221:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cafffe4f800 x1874392862864128/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787560770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560760.691236:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787560760.691245:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787560760.691254:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787560760.691259:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787560760.691262:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffbb08800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787560760.691269:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874392862864128:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1787560760.691729:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787560760.691735:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787560760.691738:0:8:0:(import.c:65:import_set_state_nolock()) ffff9caffba9c000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787560760.691744:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9caffba9c000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560760.691764:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffcb08380 x1874392862864384/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787560760.691796:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560760.691800:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787560760.691803:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560760.691806:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787560760.691833:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560760.691836:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787560760.691838:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560760.691841:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787560760.691857:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f08f2f56-c18f-4579-88a9-05007f76ffc9:3624:1874392862864256:0@lo:400:kworker.0 00000100:00100000:2.0:1787560760.691922:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560760.691974:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862864512:0@lo:400:kworker.0 00000100:00100000:2.0:1787560760.692013:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560760.692035:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787560760.692040:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862864640:0@lo:400:kworker.0 00000100:00100000:2.0:1787560760.692081:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560760.692115:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862864512 00000100:00100000:2.0:1787560760.692122:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862864512 00000100:00100000:2.0:1787560760.692163:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787560760.692171:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862864512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560760.692219:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862864512:12345-0@lo:400:kworker.0 Request processed in 48us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560760.692226:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787560760.692256:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862864640 00000100:00100000:2.0:1787560760.692260:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862864640 00000100:00100000:2.0:1787560760.692284:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787560760.692289:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3625:x1874392862864640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560760.692325:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3625:x1874392862864640:12345-0@lo:400:kworker.0 Request processed in 36us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560760.692331:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787560760.692352:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862864384:0@lo:38:kworker.0 00000100:00100000:2.0:1787560760.692377:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560760.692400:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862864384 00000100:00100000:2.0:1787560760.692404:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862864384 00000100:00100000:2.0:1787560760.692420:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787560760.692424:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1874392862864384:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1787560760.692493:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1874392862864384:12345-0@lo:38:kworker.0 Request processed in 68us (116us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787560760.692499:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787560760.692526:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862864640:0@lo:400:kworker.0 00010000:00080000:2.0:1787560760.692537:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9caffcb08000 x1874392862864512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560760.692546:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862864512:0@lo:400:kworker.0 00000100:00080000:2.0:1787560760.692571:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffba9c000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787560760.692575:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787560760.692577:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862864384:0@lo:38:kworker.0 00000100:00100000:0.0:1787560760.693353:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862864256 00000100:00100000:0.0:1787560760.693361:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862864256 00000100:00100000:0.0:1787560760.693392:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787560760.693400:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:3624:x1874392862864256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560760.693474:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:3624:x1874392862864256:12345-0@lo:400:kworker.0 Request processed in 75us (1552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560760.693481:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000040:00080000:2.0:1787560760.697566:0:17924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000100:00100000:3.0:1787560760.698176:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f08f2f56-c18f-4579-88a9-05007f76ffc9:3624:1874392862864256:0@lo:400:kworker.0 00000020:01000000:0.0:1787560760.701603:0:17906:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787560760.701650:0:17906:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787560760.701673:0:17906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3881c00/0x4642c20bf2f34f81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34f88 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560760.701700:0:17906:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caec3881c00/0x4642c20bf2f34f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34f88 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787560760.701764:0:17906:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787560760.701766:0:17906:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787560760.701767:0:17906:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787560760.701769:0:17906:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787560760.701770:0:17906:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787560760.701771:0:17906:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787560760.701773:0:17906:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787560760.701774:0:17906:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787560760.701776:0:17906:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787560760.701779:0:17906:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1787560760.701782:0:17906:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787560760.701784:0:17906:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787560760.701785:0:17906:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787560760.701786:0:17906:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787560760.701787:0:17906:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787560760.701788:0:17906:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787560760.701789:0:17906:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787560760.701790:0:17906:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787560760.701791:0:17906:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787560760.701820:0:17906:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1787560760.701840:0:17906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862864768:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787560760.701921:0:17906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560760.701960:0:17906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc890180 going to sleep for 11 seconds 00000100:00100000:1.0:1787560760.702368:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862864768 00000100:00100000:1.0:1787560760.702375:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862864768 00000100:00100000:1.0:1787560760.704225:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787560760.704242:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:17906:x1874392862864768:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787560760.704272:0:17167:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787560760.704296:0:17167:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1787560760.726913:0:17153:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1787560760.744244:0:17167:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787560760.744268:0:17167:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1787560760.744423:0:17189:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787560760.744465:0:17189:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787560760.744492:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cb002176200/0x4642c20bf2f34fa4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560760.744511:0:17189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caec2169000/0x4642c20bf2f34ea8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f34ea1 expref: 18 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560760.744537:0:17189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cb002177800/0x4642c20bf2f34f6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f34f65 expref: 18 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560760.744544:0:17189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cb002176200/0x4642c20bf2f34fa4 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560760.744585:0:17189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cb002177800/0x4642c20bf2f34f6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f34f65 expref: 18 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560760.744598:0:17189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cb002177800/0x4642c20bf2f34f6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f34f65 expref: 18 pid: 17168 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560760.744613:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17189:1874392862864896:0@lo:104: 00000100:00100000:3.0:1787560760.744690:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787560760.744749:0:17189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caec2169000/0x4642c20bf2f34ea8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f34ea1 expref: 18 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560760.744756:0:17189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9caec2169000/0x4642c20bf2f34ea8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f34ea1 expref: 18 pid: 17167 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560760.744764:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe18e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17189:1874392862865024:0@lo:104: 00000100:00100000:3.0:1787560760.744785:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560760.744803:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc59576c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560760.744961:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862864896 00000100:00100000:2.0:1787560760.744969:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862864896 00000100:00100000:2.0:1787560760.745026:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862865024 00000100:00100000:2.0:1787560760.745029:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862865024 00000100:00100000:2.0:1787560760.745043:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787560760.745050:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f08f2f56-c18f-4579-88a9-05007f76ffc9+4:17189:x1874392862864896:12345-0@lo:104: 00010000:00010000:2.0:1787560760.745079:0:17156:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9caec2169200/0x4642c20bf2f34f65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f34f6c expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560760.745148:0:17156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787560760.745154:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f08f2f56-c18f-4579-88a9-05007f76ffc9+4:17189:x1874392862864896:12345-0@lo:104: Request processed in 105us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560760.745161:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787560760.745179:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787560760.745186:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f08f2f56-c18f-4579-88a9-05007f76ffc9+3:17189:x1874392862865024:12345-0@lo:104: 00010000:00010000:2.0:1787560760.745194:0:17156:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f34ea1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f34ea8 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560760.745226:0:17156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787560760.745231:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f08f2f56-c18f-4579-88a9-05007f76ffc9+3:17189:x1874392862865024:12345-0@lo:104: Request processed in 47us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560760.745237:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1787560760.745554:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787560760.745554:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560760.745561:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caec2169200/0x4642c20bf2f34f65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f34f6c expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560760.745569:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169200 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560760.745573:0:17161:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caec2169200/0x4642c20bf2f34f65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f34f6c expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560760.745588:0:17161:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caec2169200/0x4642c20bf2f34f65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f34f6c expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560760.745595:0:17161:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caec2169200/0x4642c20bf2f34f65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f34f6c expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560760.745600:0:17161:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787560760.745645:0:17161:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caec2169200/0x4642c20bf2f34f65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f34f6c expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560760.745651:0:17161:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560760.745672:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caec2169200/0x4642c20bf2f34f65 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f34f6c expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560760.745679:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caec2169200/0x4642c20bf2f34f65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f34f6c expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560760.745693:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560760.745695:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560760.745696:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560760.745706:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f08f2f56-c18f-4579-88a9-05007f76ffc9:3623:1874392862865152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787560760.745949:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560760.746005:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862865152 00000100:00100000:3.0:1787560760.746010:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862865152 00010000:00010000:3.0:1787560760.746032:0:17158:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cb002177800/0x4642c20bf2f34f6c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f34f65 expref: 19 pid: 17168 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560760.746116:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787560760.746124:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+19:3623:x1874392862865152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560760.746135:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560760.746141:0:17159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cb002177800/0x4642c20bf2f34f6c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f34f65 expref: 19 pid: 17168 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560760.746153:0:17159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cb002177800/0x4642c20bf2f34f6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f34f65 expref: 19 pid: 17168 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560760.746169:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560760.746201:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+19:3623:x1874392862865152:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560760.746207:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787560760.746209:0:17158:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787560760.746215:0:17158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1787560760.746238:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f08f2f56-c18f-4579-88a9-05007f76ffc9:3623:1874392862865152:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787560760.746247:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cb002177800/0x4642c20bf2f34f6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f34f65 expref: 18 pid: 17168 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560760.746259:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17189:1874392862864896:0@lo:104: 00000100:00100000:3.0:1787560760.746267:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe18e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17189:1874392862865024:0@lo:104: 00010000:00010000:3.0:1787560760.746280:0:17189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cb002176200/0x4642c20bf2f34fa4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560760.746286:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560760.746291:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f34ea1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f34ea8 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560760.746297:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ffe00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:1.0:1787560760.746301:0:17162:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f34ea1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f34ea8 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560760.746308:0:17162:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f34ea1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f34ea8 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560760.746314:0:17162:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f34ea1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f34ea8 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560760.746329:0:17162:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787560760.746355:0:17162:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f34ea1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f34ea8 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560760.746361:0:17162:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560760.746374:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f34ea1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f34ea8 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560760.746393:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f34ea1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f34ea8 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560760.746406:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560760.746408:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560760.746409:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560760.746422:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787560760.746551:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+17:17906:x1874392862864768:12345-0@lo:253:mount.lustre.0 Request processed in 42312us (44629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560760.746560:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787560760.746595:0:17906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:17906:1874392862864768:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787560760.746605:0:17906:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787560760.746608:0:17906:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787560760.746610:0:17906:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787560760.746611:0:17906:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000100:00100000:1.0:1787560760.746611:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f08f2f56-c18f-4579-88a9-05007f76ffc9:3623:1874392862865280:0@lo:103:ldlm_bl.0 00000020:01000004:2.0:1787560760.746619:0:17906:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560760.746620:0:17906:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560760.746621:0:17906:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560760.746623:0:17906:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787560760.746625:0:17906:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560760.746627:0:17906:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1787560760.746646:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:02000000:2.0:1787560760.746650:0:17906:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1787560760.746675:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862865280 00000100:00100000:1.0:1787560760.746680:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862865280 00010000:00010000:1.0:1787560760.746695:0:17160:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caec2169000/0x4642c20bf2f34ea8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f34ea1 expref: 17 pid: 17167 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560760.746714:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787560760.746720:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f08f2f56-c18f-4579-88a9-05007f76ffc9+17:3623:x1874392862865280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560760.746727:0:17160:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560760.746732:0:17160:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caec2169000/0x4642c20bf2f34ea8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f34ea1 expref: 17 pid: 17167 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560760.746740:0:17160:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caec2169000/0x4642c20bf2f34ea8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f34ea1 expref: 17 pid: 17167 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560760.748562:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560760.748568:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560760.749928:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caec2169000/0x4642c20bf2f34ea8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f34ea1 expref: 17 pid: 17167 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560760.749947:0:17160:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cb002176200/0x4642c20bf2f34fa4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560760.749955:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cb002176200/0x4642c20bf2f34fa4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787560760.749975:0:17160:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011267045s 00010000:00010000:1.0:1787560760.749980:0:17160:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cb002176200/0x4642c20bf2f34fa4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560760.749986:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cb002176200/0x4642c20bf2f34fa4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560760.749992:0:17160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cb002176200/0x4642c20bf2f34fa4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560760.749999:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cb002176200/0x4642c20bf2f34fa4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560760.750006:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb002176200 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560760.750010:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cb002176200/0x4642c20bf2f34fa4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560760.750018:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cb002176200/0x4642c20bf2f34fa4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560760.750038:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cb002176200/0x4642c20bf2f34fa4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560760.750063:0:17160:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560760.750156:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f08f2f56-c18f-4579-88a9-05007f76ffc9+16:3623:x1874392862865280:12345-0@lo:103:ldlm_bl.0 Request processed in 3435us (3508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560760.750167:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787560760.750663:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f08f2f56-c18f-4579-88a9-05007f76ffc9:3623:1874392862865280:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787560760.751193:0:17189:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cb002176200/0x4642c20bf2f34fa4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560760.751203:0:17189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cb002176200/0x4642c20bf2f34fa4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560760.751209:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cb002176200/0x4642c20bf2f34fa4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:2.0:1787560760.769278:0:17906:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1787560760.769347:0:17932:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1787560760.769357:0:17932:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1787560760.769904:0:17933:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787560760.770291:0:17906:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:0.0:1787560760.770420:0:17933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787560760.779592:0:17933:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787560760.779673:0:17933:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:2.0:1787560760.780357:0:17906:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1787560760.780402:0:17906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787560760.780876:0:17906:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787560760.780883:0:17906:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1787560760.780921:0:17906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787560760.781900:0:17906:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787560760.782476:0:17906:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787560760.782508:0:17906:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1787560760.782598:0:17906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787560760.785866:0:17934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab13100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17934:1874392862865408:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787560760.785942:0:17934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560760.785987:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862865408 00000100:00100000:1.0:1787560760.786007:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862865408 00000100:00100000:1.0:1787560760.786052:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787560760.786228:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17934:x1874392862865408:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787560760.786304:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17934:x1874392862865408:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 242us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560760.786312:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787560760.786339:0:17934:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560760.786361:0:17934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab13100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17934:1874392862865408:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1787560760.786389:0:17934:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787560760.786414:0:17934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab13100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17934:1874392862865536:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787560760.786464:0:17934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560760.786484:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862865536 00000100:00100000:1.0:1787560760.786488:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862865536 00000100:00100000:1.0:1787560760.786509:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787560760.786515:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17934:x1874392862865536:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787560760.786601:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17934:x1874392862865536:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 86us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560760.786608:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787560760.786638:0:17934:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560760.786652:0:17934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab13100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17934:1874392862865536:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787560760.786701:0:17934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab13100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17934:1874392862865664:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787560760.786824:0:17934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560760.786845:0:17934:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c5840 going to sleep for 11 seconds 00000100:00100000:0.0:1787560760.788318:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862865664 00000100:00100000:0.0:1787560760.788330:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862865664 00000100:00100000:0.0:1787560760.788417:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787560760.788427:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17934:x1874392862865664:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787560760.788513:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17934:x1874392862865664:12345-0@lo:900:lod0001_rec0000.0 Request processed in 88us (1689us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560760.788533:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00080000:10000000:2.0:1787560760.788851:0:17906:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:2.0:1787560760.791309:0:17906:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1787560760.794324:0:17906:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787560760.794361:0:17906:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb6db41517988 00100000:10000000:2.0:1787560760.794368:0:17906:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00010000:00080000:1.0:1787560760.794812:0:17934:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cafeab13100 x1874392862865664/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787560776 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560760.794828:0:17934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab13100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17934:1874392862865664:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787560760.794904:0:17934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab13100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17934:1874392862865792:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787560760.794961:0:17934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560760.795181:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862865792 00000100:00100000:2.0:1787560760.795187:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862865792 00000100:00100000:2.0:1787560760.795235:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787560760.795244:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17934:x1874392862865792:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787560760.795331:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17934:x1874392862865792:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 87us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560760.795337:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787560760.795382:0:17934:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560760.795397:0:17934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab13100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17934:1874392862865792:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1787560760.795472:0:17934:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787560760.799340:0:17934:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787560760.799415:0:17934:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787560760.799419:0:17934:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000020:01000004:3.0:1787560760.801193:0:17906:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787560760.801222:0:17906:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.129@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787560760.801238:0:17906:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787560760.801261:0:17906:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1787560760.805304:0:17906:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787560760.805548:0:17906:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787560760.884407:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560761.587564:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2900 going to sleep for 0 seconds 00000040:00080000:3.0:1787560761.716510:0:17927:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787560761.907670:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787560761.908863:0:17170:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787560761.908868:0:17170:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cafc6f14000 from 8 10000000:01000000:3.0:1787560761.908873:0:17170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787560761.908916:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb002176200/0x4642c20bf2f34fab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560761.908927:0:17170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cb002176200/0x4642c20bf2f34fab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560761.908950:0:17170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cb002176200/0x4642c20bf2f34fab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560761.908976:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe18e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862865920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787560761.909043:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560761.909109:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec22aa780 going to sleep for 11 seconds 00000100:00100000:2.0:1787560761.909183:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862865920 00000100:00100000:2.0:1787560761.909192:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862865920 00000100:00100000:2.0:1787560761.909250:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787560761.909260:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+16:17170:x1874392862865920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560761.909276:0:17168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560761.909290:0:17168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caec2169e00/0x4642c20bf2f34fb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f34fab expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560761.909316:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caec2169e00/0x4642c20bf2f34fb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f34fab expref: 17 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560761.909327:0:17168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caec2169e00/0x4642c20bf2f34fb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f34fab expref: 17 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560761.909347:0:17168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2169e00, rc 0) 00000100:00100000:2.0:1787560761.909387:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+17:17170:x1874392862865920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560761.909394:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787560761.909622:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe18e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862865920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787560761.909637:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cb002176200/0x4642c20bf2f34fab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34fb2 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560761.909645:0:17170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cb002176200/0x4642c20bf2f34fab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f34fb2 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560761.909693:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe18e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862866048:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787560761.909735:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560761.909755:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec22aa780 going to sleep for 11 seconds 00000100:00100000:2.0:1787560761.910840:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862866048 00000100:00100000:2.0:1787560761.910849:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862866048 00000100:00100000:2.0:1787560761.910891:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787560761.910899:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+17:17170:x1874392862866048:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787560761.910917:0:17167:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787560761.910937:0:17167:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787560761.910940:0:17167:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1787560761.911028:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+17:17170:x1874392862866048:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 129us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560761.911035:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787560761.911179:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe18e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862866048:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787560761.911223:0:17170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787560761.911232:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb002176200/0x4642c20bf2f34fab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34fb2 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560761.911242:0:17170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cb002176200/0x4642c20bf2f34fab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34fb2 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560761.911252:0:17170:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787560761.911255:0:17170:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9caffff56000 from 8 10000000:01000000:3.0:1787560761.911263:0:17170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787560761.911289:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb002177800/0x4642c20bf2f34fb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560761.911298:0:17170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cb002177800/0x4642c20bf2f34fb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560761.911307:0:17170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cb002177800/0x4642c20bf2f34fb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560761.911324:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe18e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862866176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787560761.911368:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560761.911395:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec22aa780 going to sleep for 11 seconds 00000100:00100000:2.0:1787560761.912550:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862866176 00000100:00100000:2.0:1787560761.912559:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862866176 00000100:00100000:2.0:1787560761.912593:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787560761.912601:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+17:17170:x1874392862866176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560761.912612:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560761.912627:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caec2169000/0x4642c20bf2f34fc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f34fb9 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560761.912650:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caec2169000/0x4642c20bf2f34fc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f34fb9 expref: 18 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560761.912660:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caec2169000/0x4642c20bf2f34fc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f34fb9 expref: 18 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560761.912668:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2169000, rc 0) 00000100:00100000:2.0:1787560761.912711:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:17170:x1874392862866176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560761.912718:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787560761.912907:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe18e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862866176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560761.912921:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cb002177800/0x4642c20bf2f34fb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34fc0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560761.912931:0:17170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cb002177800/0x4642c20bf2f34fb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f34fc0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560761.912977:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862866304:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787560761.913008:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560761.913033:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe06da240 going to sleep for 11 seconds 00000100:00100000:2.0:1787560761.913052:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862866304 00000100:00100000:2.0:1787560761.913056:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862866304 00000100:00100000:2.0:1787560761.913089:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787560761.913095:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:17170:x1874392862866304:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787560761.913107:0:17168:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787560761.913120:0:17168:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787560761.913122:0:17168:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1787560761.913186:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:17170:x1874392862866304:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 90us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560761.913193:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787560761.913221:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862866304:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787560761.913256:0:17170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787560761.913262:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb002177800/0x4642c20bf2f34fb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34fc0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560761.913269:0:17170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cb002177800/0x4642c20bf2f34fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34fc0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560762.611579:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2900 going to sleep for 0 seconds 00000040:00080000:3.0:1787560762.740862:0:17927:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787560762.932027:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560763.636494:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2900 going to sleep for 0 seconds 00010000:00010000:3.0:1787560763.957233:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560764.659597:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2900 going to sleep for 0 seconds 00010000:00010000:1.0:1787560764.979705:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787560765.622254:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787560765.691774:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2900 going to sleep for 0 seconds 00000100:00080000:2.0:1787560766.004334:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787560766.004341:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787560766.004344:0:36:0:(import.c:65:import_set_state_nolock()) ffff9caffba9c000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787560766.004358:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9caffba9c000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560766.004383:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffcb08000 x1874392862866560/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787560766.004457:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560766.004461:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787560766.004464:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560766.004467:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787560766.004503:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560766.004507:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787560766.004510:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560766.004513:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787560766.004600:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862866432:0@lo:400:kworker.0 00000100:00100000:2.0:1787560766.004673:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560766.004719:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862867072:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787560766.004747:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560766.004773:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787560766.004779:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862866688:0@lo:400:kworker.0 00000100:00100000:2.0:1787560766.004821:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560766.004855:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862866432 00000100:00100000:2.0:1787560766.004862:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862866432 00000100:00100000:2.0:1787560766.004908:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787560766.004917:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:3625:x1874392862866432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560766.004965:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:3625:x1874392862866432:12345-0@lo:400:kworker.0 Request processed in 49us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560766.004973:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787560766.005016:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862867072 00000100:00100000:2.0:1787560766.005020:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862867072 00000100:00100000:2.0:1787560766.005062:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787560766.005068:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862867072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787560766.005094:0:17178:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787560766.005127:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862867072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560766.005133:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787560766.005151:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862866688 00000100:00100000:2.0:1787560766.005154:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862866688 00000100:00100000:2.0:1787560766.005178:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787560766.005184:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862866688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560766.005213:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862866688:12345-0@lo:400:kworker.0 Request processed in 30us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560766.005220:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787560766.005257:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9caffcb08a80 x1874392862866688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560766.005271:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862866688:0@lo:400:kworker.0 00000100:00100000:2.0:1787560766.005282:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862866432:0@lo:400:kworker.0 00000100:00100000:2.0:1787560766.005296:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862867072:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787560766.006190:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560766.006247:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862866816:0@lo:400:kworker.0 00000100:00100000:1.0:1787560766.006293:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560766.006330:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787560766.006336:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862866944:0@lo:400:kworker.0 00000100:00100000:1.0:1787560766.006360:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560766.006398:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862866560:0@lo:38:kworker.0 00000100:00100000:1.0:1787560766.006659:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560766.006695:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862866944 00000100:00100000:1.0:1787560766.006701:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862866944 00000100:00100000:1.0:1787560766.006737:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787560766.006745:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862866944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560766.009380:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862866944:12345-0@lo:400:kworker.0 Request processed in 2625us (3008us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560766.009395:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787560766.009555:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9caffcb0b800 x1874392862866944/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560766.009569:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862866944:0@lo:400:kworker.0 00000100:00100000:2.0:1787560766.009696:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862866816 00000100:00100000:2.0:1787560766.009705:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862866816 00000100:00100000:2.0:1787560766.009739:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862866560 00000100:00100000:2.0:1787560766.009742:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862866560 00000100:00100000:2.0:1787560766.009753:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787560766.009761:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862866816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560766.009861:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862866816:12345-0@lo:400:kworker.0 Request processed in 100us (3566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560766.009868:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787560766.009882:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787560766.009887:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1874392862866560:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787560766.009912:0:17178:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:2.0:1787560766.009946:0:17178:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4642c20bf2f34fc7 00000004:00100000:2.0:1787560766.009960:0:17178:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787560766.009965:0:17178:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1787560766.010559:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862866816:0@lo:400:kworker.0 00000100:00080000:3.0:1787560766.044733:0:17178:0:(import.c:65:import_set_state_nolock()) ffff9cafeabca800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787560766.044831:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3622:x1874392862866560:12345-0@lo:38:kworker.0 Request processed in 34940us (38403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560766.044841:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1787560766.044925:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787560766.044935:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787560766.044940:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787560766.044943:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffba9c000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1787560766.044971:0:3622:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000004f29f241): req@ffff9cafeab10700 x1874392862858368/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560766.044991:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862866560:0@lo:38:kworker.0 00000100:00100000:1.0:1787560766.045076:0:17215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560766.045100:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2900 going to sleep for 11 seconds 00000100:00100000:1.0:1787560766.045115:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862858368 00000100:00100000:1.0:1787560766.045122:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862858368 00000100:00100000:1.0:1787560766.045154:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787560766.045162:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17215:x1874392862858368:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787560766.045240:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17215:x1874392862858368:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 78us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560766.045247:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787560766.045272:0:17215:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17215:1874392862858368:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1787560766.045299:0:17215:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787560766.045333:0:17215:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17215:1874392862867200:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787560766.045361:0:17215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560766.045380:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc2f0dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787560766.045389:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862867200 00000100:00100000:1.0:1787560766.045392:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862867200 00000100:00100000:1.0:1787560766.045407:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787560766.045412:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17215:x1874392862867200:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787560766.045532:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17215:x1874392862867200:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 119us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560766.045538:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787560766.045562:0:17215:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17215:1874392862867200:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787560766.045623:0:17215:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17215:1874392862867328:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787560766.045647:0:17215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560766.045671:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc2f0dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787560766.045684:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862867328 00000100:00100000:2.0:1787560766.045688:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862867328 00000100:00100000:2.0:1787560766.045709:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787560766.045715:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17215:x1874392862867328:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787560766.045770:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17215:x1874392862867328:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 55us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560766.045776:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787560766.045896:0:17215:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17215:1874392862867328:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1787560766.045933:0:17215:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787560766.047166:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787560766.047180:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862867456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787560766.047225:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560766.047260:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862867456 00000100:00100000:3.0:1787560766.047265:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862867456 00000100:00100000:3.0:1787560766.047292:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787560766.047299:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3625:x1874392862867456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787560766.047324:0:17179:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787560766.047362:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3625:x1874392862867456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560766.047373:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787560766.047408:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862867456:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1787560766.054310:0:17215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787560766.054403:0:17215:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 23, retries 0 00000004:00080000:1.0:1787560766.054409:0:17215:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:02000400:1.0:1787560766.345000:0:18176:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787560767.027525:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560752/real 1787560752] req@ffff9cafeab10e00 x1874392862859392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560767 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560767.027556:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cafeab10e00 x1874392862859392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560767 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787560767.027575:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec3380800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00010000:00010000:2.0:1787560767.027583:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787560767.027588:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787560767.027592:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862859392:0@lo:8:kworker.0 00000100:00080000:2.0:1787560767.027654:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560767.027658:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787560767.027661:0:36:0:(import.c:65:import_set_state_nolock()) ffff9caec3380800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787560767.027666:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 471 00000100:00080000:2.0:1787560767.027671:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787560767.027676:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9caec3380800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560767.027695:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffcb08a80 x1874392862867840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787560767.027714:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f08f2f56-c18f-4579-88a9-05007f76ffc9:3623:1874392862867584:0@lo:400:kworker.0 00000100:00080000:2.0:1787560767.027727:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560767.027730:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787560767.027753:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560767.027756:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787560767.027758:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560767.027761:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787560767.027773:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560767.027780:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862867712:0@lo:400:kworker.0 00000100:00100000:1.0:1787560767.027812:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862868224:0@lo:400:kworker.0 00000100:00100000:2.0:1787560767.027823:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560767.027834:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560767.027854:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862867968:0@lo:400:kworker.0 00000100:00100000:2.0:1787560767.027877:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560767.027902:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787560767.027907:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862868096:0@lo:400:kworker.0 00000100:00100000:2.0:1787560767.027928:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560767.027958:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862868224 00000100:00100000:2.0:1787560767.027962:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862867584 00000100:00100000:2.0:1787560767.027965:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862867584 00000100:00100000:1.0:1787560767.027965:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862868224 00000100:00100000:1.0:1787560767.028001:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862867968 00000100:00100000:1.0:1787560767.028003:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862867968 00000100:00100000:2.0:1787560767.028004:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787560767.028013:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:3623:x1874392862867584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560767.028015:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787560767.028020:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862868224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560767.028070:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:3623:x1874392862867584:12345-0@lo:400:kworker.0 Request processed in 57us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560767.028077:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787560767.028086:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862867712 00000100:00100000:0.0:1787560767.028090:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862867712 00000100:00100000:2.0:1787560767.028104:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862868096 00000100:00100000:2.0:1787560767.028108:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862868096 00000100:00100000:0.0:1787560767.028109:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787560767.028115:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3624:x1874392862867712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560767.028125:0:17175:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787560767.028132:0:17175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787560767.028153:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3624:x1874392862867712:12345-0@lo:400:kworker.0 Request processed in 37us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560767.028159:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787560767.028172:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787560767.028195:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862868096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560767.028224:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862868096:12345-0@lo:400:kworker.0 Request processed in 30us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560767.028229:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787560767.028265:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862867712:0@lo:400:kworker.0 00000100:00100000:2.0:1787560767.028288:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862868096:0@lo:400:kworker.0 00000100:00100000:2.0:1787560767.028307:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862867840:0@lo:8:kworker.0 00000400:00000100:2.0:1787560767.028326:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874392862867840 offset 0 length 520: 4 00000100:00100000:3.0:1787560767.028538:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787560767.028547:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862867968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560767.028589:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862867968:12345-0@lo:400:kworker.0 Request processed in 43us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560767.028595:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787560767.028744:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9caffcb0ad80 x1874392862867968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560767.028756:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862867968:0@lo:400:kworker.0 00000100:00100000:1.0:1787560767.036314:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862868224:12345-0@lo:400:kworker.0 Request processed in 7138us (7324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560767.036334:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787560767.043588:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9caffcb09f80 x1874392862868224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560767.043608:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862868224:0@lo:400:kworker.0 00000100:00100000:2.0:1787560767.043621:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f08f2f56-c18f-4579-88a9-05007f76ffc9:3623:1874392862867584:0@lo:400:kworker.0 00000020:00000004:2.0:1787560767.510324:0:18230:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787560767.510608:0:18230:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787560768.053775:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560753/real 1787560753] req@ffff9cafeab12300 x1874392862859904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560768 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560768.053805:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cafeab12300 x1874392862859904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560768 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787560768.053826:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec32fd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787560768.053855:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787560768.053859:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862859904:0@lo:8:kworker.0 00010000:00010000:1.0:1787560768.054003:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787560768.054203:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560768.054207:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787560768.054210:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560768.054213:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787560768.054216:0:36:0:(import.c:65:import_set_state_nolock()) ffff9caec32fd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787560768.054221:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 472 00000100:00080000:3.0:1787560768.054226:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787560768.054232:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9caec32fd800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787560768.054250:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafffe19180 x1874392862868608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787560768.054288:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560768.054291:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787560768.054299:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560768.054302:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787560768.054331:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862868480:0@lo:400:kworker.0 00000100:00100000:1.0:1787560768.054376:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862868864:0@lo:400:kworker.0 00000100:00100000:3.0:1787560768.054393:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560768.054424:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560768.054451:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787560768.054458:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862868736:0@lo:400:kworker.0 00000100:00100000:1.0:1787560768.054458:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787560768.054463:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f08f2f56-c18f-4579-88a9-05007f76ffc9:3623:1874392862868352:0@lo:400:kworker.0 00000100:00100000:3.0:1787560768.054483:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560768.054492:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560768.054508:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862868992:0@lo:400:kworker.0 00000100:00100000:3.0:1787560768.054510:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862868736 00000100:00100000:3.0:1787560768.054516:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862868736 00000100:00100000:1.0:1787560768.054543:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560768.054601:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862868480 00000100:00100000:2.0:1787560768.054606:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862868480 00000100:00100000:2.0:1787560768.054627:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862868864 00000100:00100000:2.0:1787560768.054629:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862868864 00000100:00100000:2.0:1787560768.054643:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787560768.054651:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3625:x1874392862868480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560768.054706:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3625:x1874392862868480:12345-0@lo:400:kworker.0 Request processed in 55us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560768.054719:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787560768.054736:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787560768.054743:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862868864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560768.054775:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862868864:12345-0@lo:400:kworker.0 Request processed in 32us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560768.054780:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787560768.054798:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862868352 00000100:00100000:2.0:1787560768.054801:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862868352 00000100:00100000:2.0:1787560768.054825:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787560768.054831:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:3623:x1874392862868352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560768.054857:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:3623:x1874392862868352:12345-0@lo:400:kworker.0 Request processed in 27us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560768.054863:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787560768.054902:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862868608:0@lo:8:kworker.0 00000400:00000100:2.0:1787560768.054925:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874392862868608 offset 0 length 520: 4 00000100:00100000:2.0:1787560768.054967:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862868480:0@lo:400:kworker.0 00000100:00100000:1.0:1787560768.057261:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862868864:0@lo:400:kworker.0 00000100:00100000:1.0:1787560768.057285:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f08f2f56-c18f-4579-88a9-05007f76ffc9:3623:1874392862868352:0@lo:400:kworker.0 00000100:00100000:3.0:1787560768.064474:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862868992 00000100:00100000:3.0:1787560768.064489:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862868992 00000100:00100000:2.0:1787560768.064512:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787560768.064533:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787560768.064540:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862868992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560768.064636:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862868736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560768.064745:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862868992:12345-0@lo:400:kworker.0 Request processed in 204us (10200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560768.064752:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1787560768.064777:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cafffe19880 x1874392862868992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560768.064793:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862868992:0@lo:400:kworker.0 00000100:00100000:2.0:1787560768.064875:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862868736:12345-0@lo:400:kworker.0 Request processed in 354us (10391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560768.064883:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1787560768.065095:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cafffe18e00 x1874392862868736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560768.065123:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862868736:0@lo:400:kworker.0 00000020:00000004:2.0:1787560768.496703:0:18280:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787560768.496944:0:18280:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787560769.076731:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787560769.591227:0:18328:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffead7afd70 20000000:00000080:3.0:1787560769.591246:0:18328:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cafc47bd400 uarg=0000000000000000 20000000:01000000:3.0:1787560769.591294:0:18328:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787560769.591301:0:18328:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787560769.591305:0:18328:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787560769.596828:0:18329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1787560769.597093:0:18328:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787560769.609837:0:18328:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787560769.609867:0:18328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cafda2f7e00/0x4642c20bf2f34fce lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560769.609885:0:18328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cb0021ff800/0x4642c20bf2f34e77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f34e70 expref: 17 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560769.610019:0:18328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caec3880400/0x4642c20bf2f34f7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f34f73 expref: 17 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560769.610027:0:18328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cafda2f7e00/0x4642c20bf2f34fce lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560769.610067:0:18328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caec3880400/0x4642c20bf2f34f7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f34f73 expref: 17 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560769.610080:0:18328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9caec3880400/0x4642c20bf2f34f7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f34f73 expref: 17 pid: 17166 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560769.610094:0:18328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3badc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18328:1874392862869120:0@lo:104: 00000100:00100000:3.0:1787560769.610154:0:18328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787560769.610240:0:18328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cb0021ff800/0x4642c20bf2f34e77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f34e70 expref: 17 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560769.610248:0:18328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cb0021ff800/0x4642c20bf2f34e77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f34e70 expref: 17 pid: 17167 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560769.610255:0:18328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3badf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18328:1874392862869248:0@lo:104: 00000100:00100000:3.0:1787560769.610276:0:18328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560769.610385:0:18328:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc5957a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787560769.610752:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862869120 00000100:00100000:0.0:1787560769.610760:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862869120 00000100:00100000:0.0:1787560769.610796:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862869248 00000100:00100000:0.0:1787560769.610799:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862869248 00000100:00100000:0.0:1787560769.610814:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787560769.610822:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+4:18328:x1874392862869120:12345-0@lo:104: 00010000:00010000:0.0:1787560769.610834:0:17157:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9caec2169a00/0x4642c20bf2f34f73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f34f7a expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560769.611072:0:17157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787560769.611079:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+4:18328:x1874392862869120:12345-0@lo:104: Request processed in 257us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560769.611085:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787560769.611100:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787560769.611106:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+3:18328:x1874392862869248:12345-0@lo:104: 00010000:00010000:0.0:1787560769.611114:0:17157:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9caec2168e00/0x4642c20bf2f34e70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f34e77 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560769.611236:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787560769.611243:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caec2169a00/0x4642c20bf2f34f73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f34f7a expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560769.611250:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169a00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:1.0:1787560769.611254:0:17161:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caec2169a00/0x4642c20bf2f34f73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f34f7a expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560769.611262:0:17161:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caec2169a00/0x4642c20bf2f34f73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f34f7a expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560769.611269:0:17161:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caec2169a00/0x4642c20bf2f34f73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f34f7a expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560769.611275:0:17161:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787560769.611332:0:17161:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caec2169a00/0x4642c20bf2f34f73 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f34f7a expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560769.611349:0:17161:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560769.611369:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caec2169a00/0x4642c20bf2f34f73 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f34f7a expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560769.611375:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caec2169a00/0x4642c20bf2f34f73 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f34f7a expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560769.611387:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560769.611390:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caec2168e00/0x4642c20bf2f34e70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f34e77 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560769.611396:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168e00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:1.0:1787560769.611399:0:17161:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caec2168e00/0x4642c20bf2f34e70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f34e77 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560769.611406:0:17161:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caec2168e00/0x4642c20bf2f34e70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f34e77 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560769.611412:0:17161:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caec2168e00/0x4642c20bf2f34e70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f34e77 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560769.611417:0:17161:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1787560769.611470:0:18328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3badc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18328:1874392862869120:0@lo:104: 00000100:00100000:3.0:1787560769.611479:0:18328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3badf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18328:1874392862869248:0@lo:104: 00010000:00010000:3.0:1787560769.611501:0:18328:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cafda2f7e00/0x4642c20bf2f34fce lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560769.611569:0:17157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1787560769.611576:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+3:18328:x1874392862869248:12345-0@lo:104: Request processed in 469us (1299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560769.611582:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787560769.611605:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862869376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787560769.611637:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787560769.611710:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560769.611721:0:17929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862869376 00000100:00100000:3.0:1787560769.611726:0:17929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862869376 00010000:00010000:3.0:1787560769.611746:0:17929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caec3880400/0x4642c20bf2f34f7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f34f73 expref: 18 pid: 17166 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560769.611777:0:17929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787560769.611784:0:17929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:3625:x1874392862869376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787560769.611795:0:17929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560769.611800:0:17929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caec3880400/0x4642c20bf2f34f7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f34f73 expref: 18 pid: 17166 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560769.611810:0:17929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caec3880400/0x4642c20bf2f34f7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f34f73 expref: 18 pid: 17166 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560769.611823:0:17929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caec3880400/0x4642c20bf2f34f7a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f34f73 expref: 18 pid: 17166 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560769.611835:0:17929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560769.611864:0:17929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f08f2f56-c18f-4579-88a9-05007f76ffc9+17:3625:x1874392862869376:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560769.611870:0:17929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787560769.612208:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862869376:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560769.612363:0:17161:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caec2168e00/0x4642c20bf2f34e70 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f34e77 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560769.612371:0:17161:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787560769.612404:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1787560769.612421:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caec2168e00/0x4642c20bf2f34e70 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f34e77 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560769.612445:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caec2168e00/0x4642c20bf2f34e70 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f34e77 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560769.612467:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560769.612468:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560769.612470:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560769.614050:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862869504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560769.614107:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560769.614213:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862869504 00000100:00100000:2.0:1787560769.614219:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862869504 00010000:00010000:2.0:1787560769.614258:0:17159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cb0021ff800/0x4642c20bf2f34e77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f34e70 expref: 17 pid: 17167 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560769.614320:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787560769.614328:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+17:3625:x1874392862869504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787560769.614341:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560769.614346:0:17159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cb0021ff800/0x4642c20bf2f34e77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f34e70 expref: 17 pid: 17167 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560769.614358:0:17159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cb0021ff800/0x4642c20bf2f34e77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f34e70 expref: 17 pid: 17167 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560769.614373:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cb0021ff800/0x4642c20bf2f34e77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f34e70 expref: 17 pid: 17167 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560769.614387:0:17159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cafda2f7e00/0x4642c20bf2f34fce lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560769.614394:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafda2f7e00/0x4642c20bf2f34fce lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560769.614409:0:17159:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cafda2f7e00/0x4642c20bf2f34fce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560769.614416:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cafda2f7e00/0x4642c20bf2f34fce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560769.614422:0:17159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cafda2f7e00/0x4642c20bf2f34fce lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560769.614458:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cafda2f7e00/0x4642c20bf2f34fce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560769.614474:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7e00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:2.0:1787560769.614478:0:17159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cafda2f7e00/0x4642c20bf2f34fce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560769.614486:0:17159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cafda2f7e00/0x4642c20bf2f34fce lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560769.614500:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cafda2f7e00/0x4642c20bf2f34fce lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560769.614511:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560769.614549:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+16:3625:x1874392862869504:12345-0@lo:103:ldlm_bl.0 Request processed in 221us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560769.614556:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787560769.614619:0:18328:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cafda2f7e00/0x4642c20bf2f34fce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560769.614628:0:18328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cafda2f7e00/0x4642c20bf2f34fce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560769.614635:0:18328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafda2f7e00/0x4642c20bf2f34fce lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560769.615593:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862869504:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787560770.100189:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560770.100252:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560760/real 1787560760] req@ffff9cafffe19c00 x1874392862862336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560770 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560770.100280:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cafffe19c00 x1874392862862336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560770 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560770.100291:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560760/real 1787560760] req@ffff9cafffe18a80 x1874392862862208/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560770 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560770.100302:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cafffe18a80 x1874392862862208/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560770 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787560770.100322:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafc5251800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787560770.100343:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787560770.100347:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862862336:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787560770.100352:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffcbc6800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787560770.100357:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787560770.100360:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862862208:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787560770.100703:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560770.100707:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787560770.100710:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560770.100713:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787560770.100733:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560770.100736:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787560770.100739:0:36:0:(import.c:65:import_set_state_nolock()) ffff9caffcbc6800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787560770.100744:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 479 00000100:00080000:2.0:1787560770.100749:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787560770.100754:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9caffcbc6800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560770.100772:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffcb08e00 x1874392862870144/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787560770.100798:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560770.100802:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787560770.100803:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cafc5251800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787560770.100806:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 479 00000100:00080000:2.0:1787560770.100808:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787560770.100812:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9cafc5251800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560770.100826:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffcb0ad80 x1874392862870272/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787560770.100852:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862869760:0@lo:400:kworker.0 00000100:00100000:2.0:1787560770.100915:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560770.100957:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787560770.100964:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f08f2f56-c18f-4579-88a9-05007f76ffc9:3624:1874392862869632:0@lo:400:kworker.0 00000100:00100000:2.0:1787560770.100991:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560770.101030:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862870400:0@lo:400:kworker.0 00000100:00100000:2.0:1787560770.101055:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560770.101079:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862870016:0@lo:400:kworker.0 00000100:00100000:2.0:1787560770.101101:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560770.101116:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787560770.101122:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862869888:0@lo:400:kworker.0 00000100:00100000:2.0:1787560770.101143:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560770.101168:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862869760 00000100:00100000:2.0:1787560770.101174:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862869760 00000100:00100000:2.0:1787560770.101206:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862870016 00000100:00100000:2.0:1787560770.101209:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862870016 00000100:00100000:2.0:1787560770.101223:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787560770.101239:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3624:x1874392862869760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560770.101288:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3624:x1874392862869760:12345-0@lo:400:kworker.0 Request processed in 50us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560770.101295:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787560770.101312:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787560770.101319:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862870016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560770.101347:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862870016:12345-0@lo:400:kworker.0 Request processed in 29us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560770.101353:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787560770.101369:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862869632 00000100:00100000:2.0:1787560770.101372:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862869632 00000100:00100000:2.0:1787560770.101394:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787560770.101400:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+16:3624:x1874392862869632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560770.101426:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+16:3624:x1874392862869632:12345-0@lo:400:kworker.0 Request processed in 26us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560770.101458:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787560770.101482:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862870400 00000100:00100000:2.0:1787560770.101486:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862870400 00000100:00100000:2.0:1787560770.101508:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862869888 00000100:00100000:2.0:1787560770.101511:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862869888 00000100:00100000:2.0:1787560770.101526:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787560770.101532:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862870400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560770.101560:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862870400:12345-0@lo:400:kworker.0 Request processed in 28us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560770.101566:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787560770.101578:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787560770.101583:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862869888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560770.101629:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862869888:12345-0@lo:400:kworker.0 Request processed in 45us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560770.101635:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787560770.101675:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9caffcb0bb80 x1874392862869888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560770.101686:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862869888:0@lo:400:kworker.0 00000100:00100000:2.0:1787560770.101695:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862870016:0@lo:400:kworker.0 00000100:00100000:2.0:1787560770.101722:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862870144:0@lo:8:kworker.0 00000400:00000100:2.0:1787560770.101754:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874392862870144 offset 0 length 520: 4 00000100:00100000:2.0:1787560770.101768:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862870272:0@lo:8:kworker.0 00000400:00000100:2.0:1787560770.101785:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874392862870272 offset 0 length 520: 4 00000100:00100000:2.0:1787560770.101812:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f08f2f56-c18f-4579-88a9-05007f76ffc9:3624:1874392862869632:0@lo:400:kworker.0 00010000:00080000:2.0:1787560770.101823:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cafffe18a80 x1874392862870400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560770.101831:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862870400:0@lo:400:kworker.0 00000100:00100000:2.0:1787560770.101839:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862869760:0@lo:400:kworker.0 00000100:00100000:1.0:1787560771.123714:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787560771.123735:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862870528:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787560771.123804:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787560771.124140:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560771.124217:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862870528 00000100:00100000:2.0:1787560771.124226:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862870528 00000100:00100000:1.0:1787560771.124238:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787560771.124256:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862870656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787560771.124273:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787560771.124282:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862870528:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787560771.124293:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:2.0:1787560771.124312:0:17179:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787560771.124315:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1787560771.124322:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1787560771.124356:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862870528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560771.124376:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787560771.124389:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862870656 00000100:00100000:2.0:1787560771.124392:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862870656 00000100:00100000:2.0:1787560771.124406:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787560771.124411:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3626:x1874392862870656:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787560771.124421:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862870528:0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787560771.124426:0:17179:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787560771.124475:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3626:x1874392862870656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560771.124482:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787560771.124519:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862870656:0@lo:41:osp-pre-1-0.0 10000000:01000000:3.0:1787560771.317345:0:17170:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787560771.317352:0:17170:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cafc6f14000 from 13 10000000:01000000:3.0:1787560771.317357:0:17170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787560771.317399:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f34fd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560771.317410:0:17170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f34fd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560771.317422:0:17170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f34fd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560771.324393:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3badf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862870784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787560771.324489:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560771.326467:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc5957a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787560771.336524:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862870784 00000100:00100000:0.0:1787560771.336540:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862870784 00000100:00100000:0.0:1787560771.336592:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787560771.336603:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+16:17170:x1874392862870784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787560771.336619:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560771.336639:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caec3880400/0x4642c20bf2f34fdc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f34fd5 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560771.336680:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caec3880400/0x4642c20bf2f34fdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f34fd5 expref: 17 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560771.336692:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caec3880400/0x4642c20bf2f34fdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f34fd5 expref: 17 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560771.336702:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3880400, rc 0) 00000100:00100000:0.0:1787560771.336795:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+17:17170:x1874392862870784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (12295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560771.336802:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787560771.337110:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3badf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862870784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787560771.337129:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f34fd5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34fdc expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560771.337138:0:17170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f34fd5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f34fdc expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560771.337231:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862870912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787560771.337279:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560771.337322:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc7ed4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787560771.337421:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862870912 00000100:00100000:2.0:1787560771.337426:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862870912 00000100:00100000:2.0:1787560771.337486:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787560771.337494:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+17:17170:x1874392862870912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560771.337614:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+17:17170:x1874392862870912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560771.337622:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787560771.338932:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862870912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787560771.338978:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862871040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787560771.339042:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560771.339079:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc7ed4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787560771.339186:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862871040 00000100:00100000:2.0:1787560771.339192:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862871040 00000100:00100000:2.0:1787560771.339227:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787560771.339236:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4934050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+17:17170:x1874392862871040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560771.339349:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4934050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+17:17170:x1874392862871040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560771.339365:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787560771.339544:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862871040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787560771.357750:0:18394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787560771.358090:0:17170:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787560771.358114:0:17170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787560771.358126:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f34fd5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34fdc expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560771.358138:0:17170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f34fd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34fdc expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560771.358149:0:17170:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787560771.358152:0:17170:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9caffff56000 from 13 10000000:01000000:0.0:1787560771.358156:0:17170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787560771.358192:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3881400/0x4642c20bf2f34fe3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560771.358202:0:17170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caec3881400/0x4642c20bf2f34fe3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560771.358212:0:17170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caec3881400/0x4642c20bf2f34fe3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560771.358251:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862871168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787560771.358314:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560771.358358:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caff3251a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787560771.358518:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862871168 00000100:00100000:3.0:1787560771.358525:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862871168 00000100:00100000:3.0:1787560771.358573:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787560771.358582:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4935450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+17:17170:x1874392862871168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787560771.358594:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560771.358606:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafda2f7400/0x4642c20bf2f34fea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f34fe3 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560771.358627:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafda2f7400/0x4642c20bf2f34fea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f34fe3 expref: 18 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560771.358637:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafda2f7400/0x4642c20bf2f34fea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f34fe3 expref: 18 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560771.358646:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f7400, rc 0) 00000100:00100000:3.0:1787560771.358694:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4935450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:17170:x1874392862871168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560771.358700:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787560771.359064:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862871168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787560771.359078:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caec3881400/0x4642c20bf2f34fe3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34fea expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560771.359087:0:17170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caec3881400/0x4642c20bf2f34fe3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f34fea expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560771.359137:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862871296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560771.359163:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560771.359184:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caff3251a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787560771.359199:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862871296 00000100:00100000:0.0:1787560771.359202:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862871296 00000100:00100000:3.0:1787560771.359591:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787560771.359600:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4934c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:17170:x1874392862871296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560771.359700:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4934c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:17170:x1874392862871296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560771.359708:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787560771.359825:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862871296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560771.359853:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862871424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787560771.359893:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560771.359919:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caff3251a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787560771.360087:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862871424 00000100:00100000:3.0:1787560771.360092:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862871424 00000100:00100000:3.0:1787560771.360126:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787560771.360133:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4936450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:17170:x1874392862871424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787560771.360203:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4936450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:17170:x1874392862871424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560771.360210:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787560771.360360:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862871424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787560771.362128:0:18396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787560771.362900:0:17170:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787560771.362987:0:17170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787560771.363006:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3881400/0x4642c20bf2f34fe3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34fea expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560771.363032:0:17170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caec3881400/0x4642c20bf2f34fe3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34fea expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1787560771.638424:0:17907:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1787560772.148608:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787560772.983244:0:17927:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787560773.174060:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560774.195743:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560775.221553:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787560775.222479:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560775.222484:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787560775.222487:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560775.222490:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787560775.222509:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560775.222513:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787560775.222515:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560775.222536:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787560775.222665:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3baed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862871680:0@lo:400:kworker.0 00000100:00100000:0.0:1787560775.222765:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560775.222831:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560775.222838:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862871808:0@lo:400:kworker.0 00000100:00100000:0.0:1787560775.222867:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560775.222919:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862871808 00000100:00100000:0.0:1787560775.222928:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862871808 00000100:00100000:0.0:1787560775.223000:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787560775.223012:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862871808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560775.223073:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862871808:12345-0@lo:400:kworker.0 Request processed in 63us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560775.223081:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787560775.223131:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9caec3baf100 x1874392862871808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560775.223147:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862871808:0@lo:400:kworker.0 00000100:00100000:1.0:1787560775.223401:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862871936:0@lo:400:kworker.0 00000100:00100000:1.0:1787560775.223468:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560775.223492:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787560775.223498:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862871552:0@lo:400:kworker.0 00000100:00100000:1.0:1787560775.223529:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560775.223555:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862872064:0@lo:400:kworker.0 00000100:00100000:1.0:1787560775.223580:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560775.223624:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862871552 00000100:00100000:1.0:1787560775.223628:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862871552 00000100:00100000:1.0:1787560775.223660:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787560775.223667:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4935850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:3625:x1874392862871552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560775.223717:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4935850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:3625:x1874392862871552:12345-0@lo:400:kworker.0 Request processed in 49us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560775.223723:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787560775.223760:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862871552:0@lo:400:kworker.0 00000100:00100000:3.0:1787560775.224185:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862871680 00000100:00100000:3.0:1787560775.224190:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862871680 00000100:00100000:3.0:1787560775.224231:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862871936 00000100:00100000:3.0:1787560775.224234:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862871936 00000100:00100000:3.0:1787560775.224260:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787560775.224268:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862871680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560775.224326:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862871680:12345-0@lo:400:kworker.0 Request processed in 58us (1561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560775.224333:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787560775.224347:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787560775.224354:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862871936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560775.224388:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862871936:12345-0@lo:400:kworker.0 Request processed in 35us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560775.224395:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787560775.224560:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3baed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862871680:0@lo:400:kworker.0 00000100:00100000:2.0:1787560775.224707:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862872064 00000100:00100000:2.0:1787560775.224712:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862872064 00000100:00100000:2.0:1787560775.224762:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787560775.224770:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862872064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560775.224814:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862872064:12345-0@lo:400:kworker.0 Request processed in 46us (1233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560775.224821:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1787560775.225017:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9caec3baf800 x1874392862872064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560775.225047:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862872064:0@lo:400:kworker.0 00000100:00100000:1.0:1787560775.225065:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862871936:0@lo:400:kworker.0 00000040:00080000:0.0:1787560775.864661:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787560776.244921:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862872192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787560776.245037:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560776.245192:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862872192 00000100:00100000:0.0:1787560776.245204:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862872192 00000100:00100000:0.0:1787560776.245281:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787560776.245292:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862872192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787560776.245338:0:17178:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787560776.245392:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862872192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560776.245400:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787560776.245477:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862872192:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787560776.245878:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560776.255156:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862872320:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787560776.255265:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560776.255354:0:18389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862872320 00000100:00100000:0.0:1787560776.255363:0:18389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862872320 00000100:00100000:0.0:1787560776.255422:0:18389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787560776.255453:0:18389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862872320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787560776.255504:0:18389:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787560776.255565:0:18389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862872320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560776.255573:0:18389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787560776.255645:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862872320:0@lo:41:osp-pre-1-0.0 00000020:01000004:2.0:1787560776.925178:0:18678:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787560776.925183:0:18678:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787560776.925184:0:18678:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787560776.925303:0:18678:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9cafc68d7800 00000020:01000004:2.0:1787560776.925322:0:18678:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787560776.925337:0:18678:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787560776.925352:0:18678:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9caff490cd28) 00000020:00000080:2.0:1787560776.925371:0:18678:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787560776.974029:0:18678:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787560776.975557:0:18678:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1787560776.976003:0:18678:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1787560776.976601:0:18678:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787560776.977785:0:18678:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1787560776.978173:0:18678:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787560776.979255:0:18678:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:1.0:1787560776.984391:0:18678:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787560776.988372:0:18678:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1787560776.988389:0:18678:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787560776.988404:0:18678:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4642c20bf2f34ff8 00000020:01000004:1.0:1787560776.988411:0:18678:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787560776.988464:0:18678:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.129@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787560776.988468:0:18678:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787560776.988475:0:18678:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1787560776.988481:0:18678:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1787560776.988496:0:18678:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9cafeabd0000) 00000020:00000080:1.0:1787560776.988508:0:18678:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1787560776.989645:0:18678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787560776.989804:0:18678:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1787560776.989810:0:18678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787560776.993749:0:18678:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787560776.993761:0:18678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787560776.995031:0:18678:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787560776.995047:0:18678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787560776.997208:0:18678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787560776.997653:0:18678:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787560776.997660:0:18678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787560777.001740:0:18678:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787560777.001754:0:18678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787560777.024602:0:18678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787560777.025068:0:18678:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787560777.025077:0:18678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787560777.026348:0:18678:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787560777.026358:0:18678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787560777.028064:0:18678:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787560777.028076:0:18678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787560777.032335:0:18678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787560777.032767:0:18678:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787560777.032773:0:18678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787560777.035200:0:18678:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787560777.035221:0:18678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787560777.086195:0:18678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787560777.086588:0:18678:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787560777.086595:0:18678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787560777.087763:0:18678:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787560777.087772:0:18678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787560777.090191:0:18678:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787560777.090335:0:18678:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1787560777.090342:0:18678:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.129@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787560777.104400:0:18678:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787560777.104494:0:18678:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.129@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787560777.104499:0:18678:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787560777.104501:0:18678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787560777.104502:0:18678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560777.104503:0:18678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560777.104505:0:18678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560777.104506:0:18678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560777.104508:0:18678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787560777.104509:0:18678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560777.104511:0:18678:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787560777.104515:0:18678:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787560777.104517:0:18678:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787560777.104518:0:18678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787560777.104519:0:18678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560777.104520:0:18678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560777.104521:0:18678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560777.104523:0:18678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560777.104524:0:18678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787560777.104525:0:18678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560777.104526:0:18678:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787560777.104552:0:18678:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787560777.104570:0:18678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862872448:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787560777.104657:0:18678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560777.104702:0:18678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caff52273c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560777.104767:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862872448 00000100:00100000:1.0:1787560777.104775:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862872448 00000100:00100000:1.0:1787560777.104840:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787560777.104850:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4936850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:18678:x1874392862872448:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787560777.105098:0:17167:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787560777.105103:0:17167:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1787560777.105107:0:17167:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787560777.105485:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4936850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:18678:x1874392862872448:12345-0@lo:253:mount.lustre.0 Request processed in 635us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560777.105493:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787560777.105604:0:18678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862872448:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787560777.105616:0:18678:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787560777.105619:0:18678:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787560777.105620:0:18678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787560777.105621:0:18678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560777.105622:0:18678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560777.105631:0:18678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560777.105633:0:18678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560777.105634:0:18678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787560777.105636:0:18678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560777.105637:0:18678:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787560777.105654:0:18678:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cafc68d7800 from lustre-OST0000 10000000:01000000:2.0:1787560777.105690:0:18678:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787560777.105693:0:18678:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787560777.105700:0:18678:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9caff4908000 local copy 00010000:00010000:2.0:1787560777.105710:0:18678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb002177000/0x4642c20bf2f34db3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34dba expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560777.105785:0:18678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862872576:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560777.105813:0:18678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560777.106207:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862872576 00000100:00100000:3.0:1787560777.106213:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862872576 00000100:00100000:3.0:1787560777.106280:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787560777.106290:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4937850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:18678:x1874392862872576:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787560777.106353:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4937850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:18678:x1874392862872576:12345-0@lo:501:mount.lustre.0 Request processed in 65us (539us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787560777.106359:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787560777.106554:0:18678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caff5227180 going to sleep for 11 seconds 00000100:00100000:3.0:1787560777.106575:0:18678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862872576:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787560777.106587:0:18678:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787560777.106606:0:18678:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787560777.106612:0:18678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb002177000/0x4642c20bf2f34db3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34dba expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560777.106621:0:18678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cb002177000/0x4642c20bf2f34db3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34dba expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560777.106643:0:18678:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cafc68d7800 10000000:01000000:3.0:1787560777.106647:0:18678:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787560777.106651:0:18678:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787560777.106653:0:18678:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787560777.106658:0:18678:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787560777.106660:0:18678:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787560777.106679:0:18678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f35006 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560777.106685:0:18678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f35006 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560777.106694:0:18678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f35006 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560777.106707:0:18678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862872704:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787560777.106736:0:18678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560777.106795:0:18678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafeec68c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787560777.108770:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862872704 00000100:00100000:1.0:1787560777.108785:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862872704 00000100:00100000:1.0:1787560777.109109:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787560777.109121:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4936c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+18:18678:x1874392862872704:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787560777.109136:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560777.109154:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cb0021ff000/0x4642c20bf2f3500d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f35006 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560777.109179:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cb0021ff000/0x4642c20bf2f3500d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f35006 expref: 19 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560777.109190:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cb0021ff000/0x4642c20bf2f3500d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f35006 expref: 19 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560777.109218:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb0021ff000, rc 0) 00000100:00100000:1.0:1787560777.109295:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4936c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+19:18678:x1874392862872704:12345-0@lo:101:mount.lustre.0 Request processed in 176us (2557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560777.109302:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787560777.109378:0:18678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862872704:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787560777.109395:0:18678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f35006 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3500d expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560777.109405:0:18678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f35006 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f3500d expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787560777.110827:0:18678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787560777.111592:0:18678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787560777.118782:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787560777.118833:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787560777.118857:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787560777.118871:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787560777.118883:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787560777.118896:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787560777.120269:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787560777.120287:0:18678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787560777.120400:0:18678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862872832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787560777.120479:0:18678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560777.120525:0:18678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafeec68600 going to sleep for 11 seconds 00000100:00100000:1.0:1787560777.121495:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862872832 00000100:00100000:1.0:1787560777.121505:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862872832 00000100:00100000:1.0:1787560777.121556:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787560777.121566:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+19:18678:x1874392862872832:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787560777.121735:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+19:18678:x1874392862872832:12345-0@lo:501:mount.lustre.0 Request processed in 170us (1255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560777.121743:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787560777.121868:0:18678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862872832:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560777.121910:0:18678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862872960:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787560777.121996:0:18678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560777.122018:0:18678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caff5227180 going to sleep for 11 seconds 00000100:00100000:1.0:1787560777.122163:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862872960 00000100:00100000:1.0:1787560777.122167:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862872960 00000100:00100000:1.0:1787560777.122199:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787560777.122206:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+19:18678:x1874392862872960:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787560777.124469:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+19:18678:x1874392862872960:12345-0@lo:503:mount.lustre.0 Request processed in 2223us (2433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560777.124483:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787560777.125033:0:18678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862872960:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787560777.125462:0:18678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787560777.125557:0:18678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862873088:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787560777.125611:0:18678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560777.125732:0:18678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2336a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787560777.125793:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862873088 00000100:00100000:3.0:1787560777.125800:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862873088 00000100:00100000:0.0:1787560777.131293:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787560777.131320:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2162850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+19:18678:x1874392862873088:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787560777.134229:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2162850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+19:18678:x1874392862873088:12345-0@lo:502:mount.lustre.0 Request processed in 2915us (8608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560777.134245:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787560777.134371:0:18678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862873088:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787560777.134671:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787560777.134701:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787560777.134731:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787560777.134746:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787560777.134759:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787560777.134771:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787560777.134784:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787560777.134797:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787560777.134809:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1787560777.134821:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1787560777.134834:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1787560777.134846:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1787560777.134894:0:18678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862873216:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787560777.137169:0:18678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560777.140664:0:18678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafeec686c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560777.142205:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862873216 00000100:00100000:2.0:1787560777.142218:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862873216 00000100:00100000:2.0:1787560777.142280:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787560777.142290:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2162c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+19:18678:x1874392862873216:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787560777.142487:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2162c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+19:18678:x1874392862873216:12345-0@lo:502:mount.lustre.0 Request processed in 197us (5323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560777.142496:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787560777.143005:0:18678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862873216:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787560777.143085:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1787560777.143104:0:18678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1787560777.145654:0:18695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787560777.145666:0:18695:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1787560777.145672:0:18695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560777.145674:0:18695:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787560777.145681:0:18695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787560777.145698:0:18695:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9caff3248000) 00000020:00000080:3.0:1787560777.145723:0:18695:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787560777.145729:0:18695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787560777.145797:0:18695:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cafc68d7800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787560777.145804:0:18695:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787560777.145821:0:18695:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4642c20bf2f3501b 00010000:00010000:3.0:1787560777.154279:0:18695:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1787560777.156236:0:18695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1787560777.157787:0:18695:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1787560777.168291:0:18695:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787560777.168304:0:18695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560777.168310:0:18695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560777.168312:0:18695:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787560777.168315:0:18695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787560777.168318:0:18695:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1787560777.168319:0:18695:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787560777.168321:0:18695:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787560777.168322:0:18695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787560777.168324:0:18695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560777.168325:0:18695:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787560777.168327:0:18695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560777.168330:0:18695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560777.168331:0:18695:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787560777.168334:0:18695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787560777.168335:0:18695:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787560777.168338:0:18695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560777.168339:0:18695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560777.168352:0:18695:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787560777.168356:0:18695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560777.168359:0:18695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560777.168360:0:18695:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787560777.168364:0:18695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787560777.168723:0:18695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560777.168729:0:18695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560777.168731:0:18695:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787560777.168735:0:18695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1787560777.174362:0:18678:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787560777.174596:0:18678:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787560777.174617:0:18678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f35006 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3500d expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560777.174630:0:18678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f35006 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3500d expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560777.174764:0:18678:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cafc68d7800 from 1 10000000:01000000:1.0:1787560777.174768:0:18678:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787560777.174805:0:18678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffa00/0x4642c20bf2f35022 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560777.174814:0:18678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffa00/0x4642c20bf2f35022 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560777.174837:0:18678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffa00/0x4642c20bf2f35022 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560777.174872:0:18678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862873344:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787560777.175350:0:18678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560777.175397:0:18678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2540 going to sleep for 11 seconds 00000100:00100000:2.0:1787560777.175567:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862873344 00000100:00100000:2.0:1787560777.175575:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862873344 00000100:00100000:2.0:1787560777.175621:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787560777.175630:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+19:18678:x1874392862873344:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787560777.175645:0:17168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560777.175659:0:17168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caec2168400/0x4642c20bf2f35029 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f35022 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560777.175683:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caec2168400/0x4642c20bf2f35029 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f35022 expref: 20 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560777.175705:0:17168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caec2168400/0x4642c20bf2f35029 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f35022 expref: 20 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560777.175715:0:17168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec2168400, rc 0) 00000100:00100000:2.0:1787560777.175757:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+20:18678:x1874392862873344:12345-0@lo:101:mount.lustre.0 Request processed in 128us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560777.175765:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787560777.178183:0:18678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862873344:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787560777.178212:0:18678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffa00/0x4642c20bf2f35022 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35029 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560777.178225:0:18678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffa00/0x4642c20bf2f35022 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35029 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787560777.186399:0:18678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787560777.186708:0:18678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787560777.187133:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787560777.187159:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787560777.187178:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787560777.187183:0:18678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787560777.187255:0:18678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862873472:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560777.187317:0:18678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560777.187364:0:18678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2336540 going to sleep for 11 seconds 00000100:00100000:1.0:1787560777.187463:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862873472 00000100:00100000:1.0:1787560777.187471:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862873472 00000100:00100000:1.0:1787560777.187512:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787560777.187521:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+20:18678:x1874392862873472:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787560777.187628:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+20:18678:x1874392862873472:12345-0@lo:501:mount.lustre.0 Request processed in 107us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560777.187636:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787560777.188163:0:18678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862873472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787560777.188200:0:18678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862873600:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787560777.188245:0:18678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560777.188276:0:18678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc7ed4300 going to sleep for 11 seconds 00000100:00100000:2.0:1787560777.188543:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862873600 00000100:00100000:2.0:1787560777.188548:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862873600 00000100:00100000:2.0:1787560777.188580:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787560777.188587:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+20:18678:x1874392862873600:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787560777.188672:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+20:18678:x1874392862873600:12345-0@lo:503:mount.lustre.0 Request processed in 85us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560777.188679:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787560777.192549:0:18678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862873600:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787560777.193044:0:18678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787560777.193123:0:18678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862873728:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787560777.193206:0:18678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560777.193256:0:18678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe0790600 going to sleep for 11 seconds 00000100:00100000:0.0:1787560777.198068:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862873728 00000100:00100000:0.0:1787560777.198083:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862873728 00000100:00100000:0.0:1787560777.198142:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787560777.198151:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2163450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+20:18678:x1874392862873728:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787560777.198329:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2163450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+20:18678:x1874392862873728:12345-0@lo:502:mount.lustre.0 Request processed in 179us (5122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560777.198338:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787560777.198503:0:18678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862873728:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787560777.198727:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787560777.198759:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787560777.198773:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787560777.198787:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787560777.198802:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787560777.198831:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787560777.198850:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787560777.198864:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1787560777.198878:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787560777.198892:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1787560777.198904:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1787560777.198938:0:18678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862873856:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787560777.199000:0:18678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560777.199039:0:18678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc7ed4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787560777.199046:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862873856 00000100:00100000:0.0:1787560777.199051:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862873856 00000100:00100000:0.0:1787560777.199086:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787560777.199094:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+20:18678:x1874392862873856:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787560777.199165:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+20:18678:x1874392862873856:12345-0@lo:502:mount.lustre.0 Request processed in 71us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560777.199172:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787560777.199231:0:18678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862873856:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787560777.199275:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1787560777.199282:0:18678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1787560777.202525:0:18699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787560777.202540:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560777.202543:0:18699:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787560777.202551:0:18699:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cafc68d7800 00000020:00000080:2.0:1787560777.202569:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787560777.202578:0:18699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560777.202581:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560777.202582:0:18699:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787560777.202585:0:18699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787560777.202587:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560777.202589:0:18699:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787560777.202592:0:18699:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cafc68d7800 00000020:00000080:2.0:1787560777.202595:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787560777.202824:0:18699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560777.202829:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560777.202830:0:18699:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787560777.202833:0:18699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787560777.202837:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560777.202838:0:18699:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787560777.202841:0:18699:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cafc68d7800 00000020:00000080:2.0:1787560777.202843:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787560777.211601:0:18699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560777.211634:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560777.211636:0:18699:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787560777.211640:0:18699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787560777.211645:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560777.211646:0:18699:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787560777.211651:0:18699:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cafc68d7800 00000020:00000080:2.0:1787560777.211653:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787560777.211716:0:18699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560777.211719:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560777.211720:0:18699:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787560777.211723:0:18699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1787560777.211884:0:18678:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787560777.212002:0:18678:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787560777.212026:0:18678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffa00/0x4642c20bf2f35022 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35029 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560777.212040:0:18678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffa00/0x4642c20bf2f35022 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35029 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560777.212094:0:18678:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787560777.212097:0:18678:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cafc68d7800 10000000:01000000:0.0:1787560777.212100:0:18678:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cafc68d7800 10000000:01000000:0.0:1787560777.212104:0:18678:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787560777.212115:0:18678:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cafc68d7800 from 1 10000000:01000000:0.0:1787560777.212117:0:18678:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787560777.212151:0:18678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3880600/0x4642c20bf2f35030 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560777.212161:0:18678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caec3880600/0x4642c20bf2f35030 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560777.212172:0:18678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caec3880600/0x4642c20bf2f35030 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560777.212197:0:18678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862873984:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787560777.212260:0:18678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560777.212298:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862873984 00000100:00100000:0.0:1787560777.212304:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862873984 00000100:00100000:0.0:1787560777.212346:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787560777.212355:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+20:18678:x1874392862873984:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787560777.212368:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560777.212380:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caec3880200/0x4642c20bf2f35037 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f35030 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560777.212401:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caec3880200/0x4642c20bf2f35037 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f35030 expref: 21 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560777.212411:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caec3880200/0x4642c20bf2f35037 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f35030 expref: 21 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560777.212419:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3880200, rc 0) 00000100:00100000:0.0:1787560777.212469:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:18678:x1874392862873984:12345-0@lo:101:mount.lustre.0 Request processed in 114us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560777.216723:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787560777.216819:0:18678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe15fc780 going to sleep for 11 seconds 00000100:00100000:0.0:1787560777.216852:0:18678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862873984:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787560777.216878:0:18678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caec3880600/0x4642c20bf2f35030 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35037 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560777.216893:0:18678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caec3880600/0x4642c20bf2f35030 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35037 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787560777.234292:0:18678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1787560777.234640:0:18678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787560777.235031:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787560777.235058:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787560777.235071:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787560777.235084:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787560777.235096:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787560777.235108:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787560777.235121:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787560777.235133:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787560777.235145:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787560777.235156:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787560777.235190:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787560777.235206:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787560777.235218:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787560777.235229:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787560777.235242:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787560777.235255:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787560777.235267:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787560777.235279:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787560777.235292:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787560777.235306:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787560777.235320:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787560777.235333:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787560777.235346:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787560777.235360:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787560777.235373:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1787560777.235384:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1787560777.238254:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1787560777.238286:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1787560777.238311:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1787560777.238324:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1787560777.238336:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1787560777.238347:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1787560777.238358:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1787560777.238368:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1787560777.238379:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1787560777.238390:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1787560777.239023:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1787560777.239062:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1787560777.239068:0:18678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1787560777.239169:0:18678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862874112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787560777.239235:0:18678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560777.239278:0:18678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc7ed4180 going to sleep for 11 seconds 00000100:00100000:2.0:1787560777.239551:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862874112 00000100:00100000:2.0:1787560777.239559:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862874112 00000100:00100000:2.0:1787560777.239601:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787560777.239610:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:18678:x1874392862874112:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560777.239737:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:18678:x1874392862874112:12345-0@lo:501:mount.lustre.0 Request processed in 128us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560777.239745:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787560777.243310:0:18678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862874112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787560777.243372:0:18678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862874240:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787560777.243469:0:18678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560777.243499:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862874240 00000100:00100000:0.0:1787560777.243506:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862874240 00000100:00100000:3.0:1787560777.243509:0:18678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc7ed4180 going to sleep for 11 seconds 00000100:00100000:0.0:1787560777.243555:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787560777.243565:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:18678:x1874392862874240:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787560777.243689:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:18678:x1874392862874240:12345-0@lo:503:mount.lustre.0 Request processed in 124us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560777.243696:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787560777.246370:0:18678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862874240:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787560777.246817:0:18678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787560777.249268:0:18678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862874368:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787560777.249348:0:18678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560777.249392:0:18678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2336480 going to sleep for 11 seconds 00000100:00100000:0.0:1787560777.250080:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862874368 00000100:00100000:0.0:1787560777.250090:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862874368 00000100:00100000:0.0:1787560777.250141:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787560777.250151:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:18678:x1874392862874368:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787560777.250278:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:18678:x1874392862874368:12345-0@lo:502:mount.lustre.0 Request processed in 128us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560777.250286:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787560777.250481:0:18678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862874368:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787560777.250704:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787560777.250732:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787560777.250744:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787560777.250757:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787560777.250768:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787560777.250778:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787560777.250790:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787560777.250800:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787560777.250812:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787560777.250822:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787560777.250836:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787560777.250886:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787560777.254100:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787560777.254168:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787560777.254182:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787560777.254195:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787560777.254207:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787560777.254220:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787560777.254232:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787560777.254259:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787560777.254272:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787560777.254284:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787560777.254296:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787560777.254309:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787560777.254321:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1787560777.254333:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1787560777.254345:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1787560777.254373:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1787560777.254387:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1787560777.254398:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1787560777.254411:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1787560777.254423:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1787560777.254454:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1787560777.254469:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1787560777.254484:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1787560777.254497:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1787560777.254510:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1787560777.254522:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1787560777.254534:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1787560777.254547:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1787560777.254559:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1787560777.254572:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1787560777.254585:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1787560777.254611:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1787560777.254625:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1787560777.254637:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1787560777.254649:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1787560777.254661:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1787560777.254716:0:18678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862874496:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787560777.254788:0:18678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560777.254837:0:18678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2336480 going to sleep for 11 seconds 00000100:00100000:0.0:1787560777.255278:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862874496 00000100:00100000:0.0:1787560777.255287:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862874496 00000100:00100000:0.0:1787560777.255334:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787560777.255343:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:18678:x1874392862874496:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787560777.255482:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:18678:x1874392862874496:12345-0@lo:502:mount.lustre.0 Request processed in 139us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560777.255490:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787560777.257214:0:18678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862874496:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787560777.258516:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1787560777.258573:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1787560777.258616:0:18678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862874624:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787560777.258688:0:18678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560777.258779:0:18678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2336480 going to sleep for 11 seconds 00000100:00100000:0.0:1787560777.268315:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862874624 00000100:00100000:0.0:1787560777.268330:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862874624 00000100:00100000:0.0:1787560777.268394:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787560777.268403:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc2c81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:18678:x1874392862874624:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787560777.268584:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc2c81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:18678:x1874392862874624:12345-0@lo:502:mount.lustre.0 Request processed in 182us (9895us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560777.268593:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787560777.268819:0:18678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862874624:0@lo:502:mount.lustre.0 00010000:00010000:1.0:1787560777.268850:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787560777.268922:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1787560777.268936:0:18678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787560777.271518:0:18705:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787560777.271536:0:18705:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9caff31d4d28) 00000020:00000080:2.0:1787560777.271561:0:18705:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1787560777.271651:0:18705:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cafc68d7800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787560777.271656:0:18705:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cafc68d7800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787560777.271659:0:18705:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cafc68d7800 3 00010000:00080000:2.0:1787560777.271710:0:18705:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9caec403a800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.129@tcp at head 00010000:00010000:2.0:1787560777.278142:0:18705:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1787560777.278341:0:18705:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787560777.278391:0:18705:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787560777.278418:0:18705:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4642c20bf2f35045 00000100:00080000:2.0:1787560777.278444:0:18705:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787560777.278450:0:18705:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9caec403a800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560777.278487:0:18705:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafffe1bb80 x1874392862874752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787560777.278523:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1874392862874752:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787560777.278593:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560777.278655:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862874752 00000100:00100000:2.0:1787560777.278668:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862874752 00000100:00100000:2.0:1787560777.278699:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787560777.278707:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1874392862874752:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787560777.278730:0:17174:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:2.0:1787560777.278757:0:17174:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4642c20bf2f3504c 00000004:00100000:2.0:1787560777.278772:0:17174:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787560777.278802:0:17174:0:(import.c:65:import_set_state_nolock()) ffff9caec2fcc000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787560777.278849:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1874392862874752:12345-0@lo:38:llog_process_th.0 Request processed in 140us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560777.278856:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787560777.278892:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cafffe1bb80 x1874392862874752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787560787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560777.278903:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787560777.278911:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1787560777.278917:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787560777.278921:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787560777.278923:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec403a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787560777.278929:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1874392862874752:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1787560777.278947:0:18705:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787560777.280261:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787560777.280266:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787560777.280269:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787560777.280272:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787560777.280295:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787560777.280299:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787560777.280302:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787560777.280305:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787560777.280338:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862875136:0@lo:400:kworker.0 00000100:00100000:0.0:1787560777.280384:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560777.280414:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560777.280420:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862875264:0@lo:400:kworker.0 00000100:00100000:0.0:1787560777.280474:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560777.280524:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862875136 00000100:00100000:0.0:1787560777.280530:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862875136 00000100:00100000:2.0:1787560777.280531:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862875264 00000100:00100000:2.0:1787560777.280534:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862875264 00000100:00100000:2.0:1787560777.280567:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787560777.280567:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787560777.280576:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862875264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560777.280576:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862875136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560777.280619:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862875136:12345-0@lo:400:kworker.0 Request processed in 44us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560777.280625:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787560777.287022:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862875264:12345-0@lo:400:kworker.0 Request processed in 6438us (6538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560777.287037:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787560777.287200:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862874880:0@lo:400:kworker.0 00000100:00100000:2.0:1787560777.287257:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560777.287341:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787560777.287348:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862875008:0@lo:400:kworker.0 00000100:00100000:2.0:1787560777.287374:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560777.287458:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862875008 00000100:00100000:2.0:1787560777.287466:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862875008 00000100:00100000:2.0:1787560777.287516:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787560777.287524:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862875008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560777.287576:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862875008:12345-0@lo:400:kworker.0 Request processed in 52us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560777.287582:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1787560777.287620:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cafffe4c700 x1874392862875008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560777.287635:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862875008:0@lo:400:kworker.0 00010000:00080000:0.0:1787560777.288814:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cafffe4ea00 x1874392862875264/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560777.288830:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862875264:0@lo:400:kworker.0 00000020:01000004:0.0:1787560777.289574:0:18705:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787560777.289590:0:18705:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9caffb990000) 00000020:00000080:0.0:1787560777.289612:0:18705:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1787560777.289715:0:18705:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cafc68d7800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787560777.289719:0:18705:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cafc68d7800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787560777.289721:0:18705:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cafc68d7800 3 00010000:00080000:0.0:1787560777.289747:0:18705:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9caec231d800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.129@tcp at head 00010000:00010000:0.0:1787560777.291856:0:18705:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1787560777.293496:0:18705:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1787560777.293545:0:18705:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787560777.293556:0:18705:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x4642c20bf2f3505a 00000100:00080000:0.0:1787560777.293566:0:18705:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787560777.293572:0:18705:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9caec231d800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:0.0:1787560777.293606:0:18705:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafffe4e680 x1874392862875392/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787560777.293623:0:18705:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787560777.293654:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787560777.293664:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787560777.293667:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787560777.293669:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787560777.293673:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787560777.293676:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787560777.293678:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787560777.293681:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787560777.295942:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862874880 00000100:00100000:1.0:1787560777.295965:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862874880 00000100:00100000:1.0:1787560777.296017:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787560777.296027:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862874880:12345-0@lo:400:kworker.0 00000040:00080000:0.0:1787560777.296081:0:18705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000100:00100000:1.0:1787560777.296117:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862874880:12345-0@lo:400:kworker.0 Request processed in 92us (8859us total) trans 0 rc 0/0 00000020:01000000:0.0:1787560777.296129:0:18678:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 00000100:00100000:1.0:1787560777.296132:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 10000000:01000000:0.0:1787560777.296156:0:18678:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787560777.296170:0:18678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3880600/0x4642c20bf2f35030 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35037 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560777.296181:0:18678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caec3880600/0x4642c20bf2f35030 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35037 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560777.296203:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862874880:0@lo:400:kworker.0 00000020:01000004:0.0:1787560777.296223:0:18678:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787560777.296225:0:18678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787560777.296227:0:18678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787560777.296228:0:18678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787560777.296229:0:18678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787560777.296230:0:18678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787560777.296232:0:18678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787560777.296234:0:18678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000100:00100000:1.0:1787560777.296235:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862875136:0@lo:400:kworker.0 00000020:01000004:0.0:1787560777.296235:0:18678:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787560777.296239:0:18678:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787560777.296241:0:18678:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787560777.296242:0:18678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787560777.296244:0:18678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787560777.296248:0:18678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787560777.296249:0:18678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787560777.296250:0:18678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787560777.296251:0:18678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787560777.296252:0:18678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787560777.296253:0:18678:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787560777.296271:0:18678:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787560777.296286:0:18678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862875520:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787560777.296329:0:18678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560777.296364:0:18678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc336c480 going to sleep for 11 seconds 00000100:00100000:1.0:1787560777.297010:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862875520 00000100:00100000:1.0:1787560777.297016:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862875520 00000100:00100000:1.0:1787560777.297056:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787560777.297064:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc2c83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:18678:x1874392862875520:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787560777.297087:0:17166:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787560777.297101:0:17166:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787560777.298513:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3622:1874392862875392:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787560777.298573:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560777.300263:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862875392 00000100:00100000:0.0:1787560777.300274:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862875392 00000100:00100000:0.0:1787560777.300316:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787560777.300324:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3622:x1874392862875392:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787560777.300352:0:18203:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:0.0:1787560777.300387:0:18203:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x4642c20bf2f35061 00000004:00100000:0.0:1787560777.300403:0:18203:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787560777.300455:0:18203:0:(import.c:65:import_set_state_nolock()) ffff9caec231b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787560777.300532:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1874392862875392:12345-0@lo:38:llog_process_th.0 Request processed in 207us (1957us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560777.300540:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787560777.302263:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cafffe4e680 x1874392862875392/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787560787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560777.302277:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787560777.302286:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1787560777.302294:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787560777.302299:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787560777.302303:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec231d800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787560777.302309:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3622:1874392862875392:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1787560777.308030:0:17166:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787560777.308050:0:17166:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787560777.308610:0:17189:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787560777.308615:0:17189:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787560777.308636:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9caec3881200/0x4642c20bf2f35068 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560777.308654:0:17189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caec2169e00/0x4642c20bf2f34fb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f34fab expref: 21 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560777.308663:0:17189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caec2169000/0x4642c20bf2f34fc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f34fb9 expref: 21 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560777.308682:0:17189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9caec3881200/0x4642c20bf2f35068 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560777.308732:0:17189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caec2169000/0x4642c20bf2f34fc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f34fb9 expref: 21 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560777.308747:0:17189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9caec2169000/0x4642c20bf2f34fc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f34fb9 expref: 21 pid: 17166 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560777.308762:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17189:1874392862875648:0@lo:104: 00000100:00100000:0.0:1787560777.308822:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787560777.308892:0:17189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caec2169e00/0x4642c20bf2f34fb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f34fab expref: 21 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560777.308901:0:17189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9caec2169e00/0x4642c20bf2f34fb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f34fab expref: 21 pid: 17168 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560777.308910:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17189:1874392862875776:0@lo:104: 00000100:00100000:1.0:1787560777.309284:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862875648 00000100:00100000:1.0:1787560777.309292:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862875648 00000100:00100000:1.0:1787560777.309337:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787560777.309345:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+3:17189:x1874392862875648:12345-0@lo:104: 00010000:00010000:1.0:1787560777.309357:0:17157:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cb002177800/0x4642c20bf2f34fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f34fc0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560777.309420:0:17157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787560777.309427:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+3:17189:x1874392862875648:12345-0@lo:104: Request processed in 83us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560777.309454:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787560777.309537:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560777.309564:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc336cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787560777.309582:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17189:1874392862875648:0@lo:104: 00000100:00100000:1.0:1787560777.309629:0:17157:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787560777.309640:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862875776 00000100:00100000:1.0:1787560777.309643:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862875776 00000100:00100000:1.0:1787560777.309668:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787560777.309674:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3149050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+3:17189:x1874392862875776:12345-0@lo:104: 00010000:00010000:1.0:1787560777.309682:0:17157:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cb002176200/0x4642c20bf2f34fab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f34fb2 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560777.309730:0:17157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787560777.309735:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3149050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+3:17189:x1874392862875776:12345-0@lo:104: Request processed in 61us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560777.309742:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787560777.309775:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787560777.309781:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cb002177800/0x4642c20bf2f34fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f34fc0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560777.309789:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb002177800 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:1.0:1787560777.309794:0:17928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cb002177800/0x4642c20bf2f34fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f34fc0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560777.309803:0:17928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cb002177800/0x4642c20bf2f34fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f34fc0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560777.309811:0:17928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cb002177800/0x4642c20bf2f34fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f34fc0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560777.309824:0:17928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1787560777.311283:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc2c83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:18678:x1874392862875520:12345-0@lo:253:mount.lustre.0 Request processed in 14214us (14948us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560777.311295:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00010000:1.0:1787560777.311418:0:17928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cb002177800/0x4642c20bf2f34fb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f34fc0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560777.311439:0:17928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560777.311470:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cb002177800/0x4642c20bf2f34fb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f34fc0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560777.311478:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cb002177800/0x4642c20bf2f34fb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f34fc0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560777.311491:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560777.311494:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cb002176200/0x4642c20bf2f34fab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f34fb2 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560777.311500:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb002176200 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:1.0:1787560777.311504:0:17928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cb002176200/0x4642c20bf2f34fab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f34fb2 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560777.311512:0:17928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cb002176200/0x4642c20bf2f34fab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f34fb2 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560777.311519:0:17928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cb002176200/0x4642c20bf2f34fab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f34fb2 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560777.311525:0:17928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787560777.311542:0:17928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cb002176200/0x4642c20bf2f34fab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f34fb2 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560777.311548:0:17928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560777.311561:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cb002176200/0x4642c20bf2f34fab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f34fb2 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560777.311568:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cb002176200/0x4642c20bf2f34fab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f34fb2 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560777.311583:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560777.311585:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560777.311587:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560777.311613:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862875904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560777.311648:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560777.311676:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787560777.311682:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862876032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787560777.312220:0:18678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:18678:1874392862875520:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787560777.312232:0:18678:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787560777.312235:0:18678:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787560777.312236:0:18678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787560777.312238:0:18678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787560777.312239:0:18678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787560777.312240:0:18678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787560777.312247:0:18678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787560777.312248:0:18678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787560777.312250:0:18678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787560777.312251:0:18678:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787560777.312264:0:18678:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1787560777.312972:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560777.313532:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17189:1874392862875776:0@lo:104: 00000100:00100000:1.0:1787560777.313538:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787560777.313554:0:17189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9caec3881200/0x4642c20bf2f35068 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560777.313593:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862875904 00000100:00100000:1.0:1787560777.313599:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862875904 00010000:00010000:1.0:1787560777.313629:0:17160:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caec2169000/0x4642c20bf2f34fc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f34fb9 expref: 21 pid: 17166 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560777.313661:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862876032 00000100:00100000:1.0:1787560777.313664:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862876032 00010000:00010000:1.0:1787560777.313676:0:17160:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caec2169e00/0x4642c20bf2f34fb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f34fab expref: 22 pid: 17168 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560777.313707:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787560777.313714:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f08f2f56-c18f-4579-88a9-05007f76ffc9+22:3625:x1874392862875904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560777.313728:0:17160:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560777.313734:0:17160:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caec2169000/0x4642c20bf2f34fc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f34fb9 expref: 22 pid: 17166 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560777.313760:0:17160:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caec2169000/0x4642c20bf2f34fc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f34fb9 expref: 22 pid: 17166 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560777.313776:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caec2169000/0x4642c20bf2f34fc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f34fb9 expref: 22 pid: 17166 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560777.313789:0:17160:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560777.313824:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:3625:x1874392862875904:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (2175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560777.313831:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787560777.313855:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787560777.313862:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafefdc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f08f2f56-c18f-4579-88a9-05007f76ffc9+20:3625:x1874392862876032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560777.313870:0:17160:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560777.313874:0:17160:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caec2169e00/0x4642c20bf2f34fb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f34fab expref: 20 pid: 17168 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560777.313883:0:17160:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caec2169e00/0x4642c20bf2f34fb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f34fab expref: 20 pid: 17168 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560777.313893:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caec2169e00/0x4642c20bf2f34fb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f34fab expref: 20 pid: 17168 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560777.313905:0:17160:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9caec3881200/0x4642c20bf2f35068 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560777.316015:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caec3881200/0x4642c20bf2f35068 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787560777.316039:0:17160:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011267045s 00010000:00010000:1.0:1787560777.316055:0:17160:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9caec3881200/0x4642c20bf2f35068 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560777.316062:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9caec3881200/0x4642c20bf2f35068 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560777.316070:0:17160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9caec3881200/0x4642c20bf2f35068 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560777.316077:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9caec3881200/0x4642c20bf2f35068 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560777.316083:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881200 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560777.316088:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9caec3881200/0x4642c20bf2f35068 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560777.316095:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9caec3881200/0x4642c20bf2f35068 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560777.316122:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9caec3881200/0x4642c20bf2f35068 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560777.316133:0:17160:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787560777.316170:0:17189:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9caec3881200/0x4642c20bf2f35068 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560777.316183:0:17189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9caec3881200/0x4642c20bf2f35068 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560777.316189:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caec3881200/0x4642c20bf2f35068 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560777.316197:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafefdc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f08f2f56-c18f-4579-88a9-05007f76ffc9+19:3625:x1874392862876032:12345-0@lo:103:ldlm_bl.0 Request processed in 2332us (2655us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560777.316206:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787560777.316291:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862876032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560777.316301:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862875904:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1787560777.334847:0:18678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787560777.351421:0:18678:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787560777.351475:0:18678:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787560777.351530:0:18678:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787560777.351584:0:18678:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.129@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787560777.351601:0:18678:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787560777.351621:0:18678:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1787560777.354768:0:18678:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787560777.355275:0:18678:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787560778.304118:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787560778.534339:0:18758:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787560778.534644:0:18758:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1787560779.123859:0:17170:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787560779.123874:0:17170:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cafc6f14000 from 9 10000000:01000000:1.0:1787560779.123879:0:17170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787560779.123926:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f3506f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560779.123938:0:17170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f3506f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560779.124089:0:17170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f3506f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560779.124115:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862876160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787560779.124184:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560779.124230:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd17bb240 going to sleep for 11 seconds 00000100:00100000:0.0:1787560779.124309:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862876160 00000100:00100000:0.0:1787560779.124318:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862876160 00000100:00100000:0.0:1787560779.124374:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787560779.124384:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc2c80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+19:17170:x1874392862876160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787560779.124398:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560779.124412:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caec3880e00/0x4642c20bf2f35076 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f3506f expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560779.124471:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caec3880e00/0x4642c20bf2f35076 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f3506f expref: 20 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560779.124491:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caec3880e00/0x4642c20bf2f35076 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f3506f expref: 20 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560779.124500:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3880e00, rc 0) 00000100:00100000:0.0:1787560779.124546:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc2c80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+20:17170:x1874392862876160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560779.124553:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787560779.125629:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862876160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787560779.125654:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f3506f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35076 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560779.125666:0:17170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f3506f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35076 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560779.125734:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862876288:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787560779.125774:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560779.125814:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd17bb240 going to sleep for 11 seconds 00000100:00100000:3.0:1787560779.126002:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862876288 00000100:00100000:3.0:1787560779.126010:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862876288 00000100:00100000:3.0:1787560779.126044:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787560779.126052:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc2c82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+20:17170:x1874392862876288:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787560779.126070:0:17166:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787560779.126086:0:17166:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787560779.126090:0:17166:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1787560779.126178:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc2c82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+20:17170:x1874392862876288:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560779.126186:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787560779.126300:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862876288:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787560779.126359:0:17170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787560779.126367:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f3506f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35076 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560779.126376:0:17170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f3506f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35076 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560779.126386:0:17170:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787560779.126388:0:17170:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9caffff56000 from 9 10000000:01000000:1.0:1787560779.126391:0:17170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787560779.126413:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff800/0x4642c20bf2f3507d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560779.126421:0:17170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff800/0x4642c20bf2f3507d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560779.126458:0:17170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff800/0x4642c20bf2f3507d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560779.126580:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862876416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787560779.126611:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560779.126630:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd17bb240 going to sleep for 11 seconds 00000100:00100000:3.0:1787560779.126741:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862876416 00000100:00100000:3.0:1787560779.126746:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862876416 00000100:00100000:3.0:1787560779.126778:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787560779.126785:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc2c82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+20:17170:x1874392862876416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787560779.126794:0:17168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560779.126805:0:17168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafda2f6c00/0x4642c20bf2f35084 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f3507d expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560779.126821:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafda2f6c00/0x4642c20bf2f35084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f3507d expref: 21 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560779.127061:0:17168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafda2f6c00/0x4642c20bf2f35084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f3507d expref: 21 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560779.127079:0:17168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f6c00, rc 0) 00000100:00100000:3.0:1787560779.129892:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc2c82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:17170:x1874392862876416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3098us (3271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560779.129904:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787560779.130108:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862876416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787560779.130131:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff800/0x4642c20bf2f3507d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35084 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560779.130144:0:17170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff800/0x4642c20bf2f3507d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35084 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560779.130233:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862876544:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787560779.130289:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560779.130316:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd17bb240 going to sleep for 11 seconds 00000100:00100000:0.0:1787560779.134772:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862876544 00000100:00100000:0.0:1787560779.134789:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862876544 00000100:00100000:0.0:1787560779.134873:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787560779.134884:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc2c83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:17170:x1874392862876544:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787560779.134924:0:17167:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787560779.134938:0:17167:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787560779.134951:0:17167:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1787560779.135076:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc2c83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:17170:x1874392862876544:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 194us (4786us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560779.135084:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787560779.136230:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862876544:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787560779.136310:0:17170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787560779.136322:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff800/0x4642c20bf2f3507d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35084 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560779.136333:0:17170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff800/0x4642c20bf2f3507d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35084 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560779.318098:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560780.339574:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560781.363806:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560781.364621:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787560781.364641:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862876672:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787560781.364712:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560781.364821:0:18389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862876672 00000100:00100000:1.0:1787560781.364830:0:18389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862876672 00000100:00100000:1.0:1787560781.365045:0:18389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787560781.365056:0:18389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862876672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787560781.365090:0:18389:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787560781.365142:0:18389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862876672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560781.365149:0:18389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787560781.365188:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862876672:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787560781.369513:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862876800:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787560781.369589:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560781.372590:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862876800 00000100:00100000:0.0:1787560781.372605:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862876800 00000100:00100000:0.0:1787560781.372668:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787560781.372679:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862876800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787560781.372715:0:17179:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787560781.382081:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862876800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 9391us (12479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560781.382096:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787560781.390516:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862876800:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1787560782.196367:0:17927:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787560782.388218:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787560782.391612:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560782.391619:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787560782.391622:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560782.391625:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787560782.391649:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560782.391652:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787560782.391655:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560782.391667:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787560782.391751:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862876928:0@lo:400:kworker.0 00000100:00100000:2.0:1787560782.391837:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560782.391877:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862877440:0@lo:400:kworker.0 00000100:00100000:2.0:1787560782.391904:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560782.391939:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787560782.391945:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862877056:0@lo:400:kworker.0 00000100:00100000:2.0:1787560782.391980:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560782.391999:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862877568:0@lo:400:kworker.0 00000100:00100000:2.0:1787560782.392019:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560782.392046:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862877184:0@lo:400:kworker.0 00000100:00100000:2.0:1787560782.392245:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560782.392266:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862877696:0@lo:400:kworker.0 00000100:00100000:2.0:1787560782.392292:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560782.392309:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787560782.392315:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862877312:0@lo:400:kworker.0 00000100:00100000:2.0:1787560782.392337:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560782.392382:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862876928 00000100:00100000:2.0:1787560782.392390:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862876928 00000100:00100000:2.0:1787560782.392456:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787560782.392466:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc2c82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:3625:x1874392862876928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560782.392515:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc2c82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:3625:x1874392862876928:12345-0@lo:400:kworker.0 Request processed in 50us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560782.392522:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787560782.392560:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862877440 00000100:00100000:2.0:1787560782.392564:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862877440 00000100:00100000:2.0:1787560782.392584:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862877568 00000100:00100000:2.0:1787560782.392586:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862877568 00000100:00100000:2.0:1787560782.392615:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862877184 00000100:00100000:2.0:1787560782.392618:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862877184 00000100:00100000:2.0:1787560782.392628:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862877696 00000100:00100000:2.0:1787560782.392630:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862877696 00000100:00100000:2.0:1787560782.392645:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787560782.392651:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862877440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560782.392685:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862877440:12345-0@lo:400:kworker.0 Request processed in 33us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560782.392691:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787560782.392703:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787560782.392709:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862877568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560782.392735:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862877568:12345-0@lo:400:kworker.0 Request processed in 26us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560782.392741:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787560782.392751:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787560782.392757:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec398a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862877184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560782.392788:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec398a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862877184:12345-0@lo:400:kworker.0 Request processed in 31us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560782.392794:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787560782.392805:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787560782.392940:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862877696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560782.393040:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862877696:12345-0@lo:400:kworker.0 Request processed in 229us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560782.393104:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787560782.393125:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862877056 00000100:00100000:2.0:1787560782.393128:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862877056 00000100:00100000:2.0:1787560782.393182:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862877312 00000100:00100000:2.0:1787560782.393186:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862877312 00000100:00080000:1.0:1787560782.393255:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787560782.393259:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560782.394708:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787560782.404903:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862877056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560782.405165:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862877056:12345-0@lo:400:kworker.0 Request processed in 10445us (13181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560782.405176:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787560782.405211:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787560782.405220:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862877312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560782.405253:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862877312:12345-0@lo:400:kworker.0 Request processed in 35us (12916us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560782.405259:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787560782.416551:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862877056:0@lo:400:kworker.0 00010000:00080000:3.0:1787560782.416578:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caffcb0b480 x1874392862877568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560782.416600:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862877568:0@lo:400:kworker.0 00000100:00100000:3.0:1787560782.416613:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862876928:0@lo:400:kworker.0 00010000:00080000:3.0:1787560782.416625:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caffcb09f80 x1874392862877440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560782.416632:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862877440:0@lo:400:kworker.0 00000100:00100000:3.0:1787560782.416690:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862877312:0@lo:400:kworker.0 00010000:00080000:3.0:1787560782.416702:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cafffe1b480 x1874392862877184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560782.416711:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862877184:0@lo:400:kworker.0 00010000:00080000:3.0:1787560782.416721:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caffcb08380 x1874392862877696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560782.416729:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862877696:0@lo:400:kworker.0 00010000:00010000:2.0:1787560783.411553:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560784.443508:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787560785.076121:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787560785.460053:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787560785.554655:0:19048:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787560785.590622:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560770/real 1787560770] req@ffff9caffcb08e00 x1874392862870144/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560785 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560785.590650:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9caffcb08e00 x1874392862870144/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560785 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560785.590660:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560770/real 1787560770] req@ffff9caffcb0ad80 x1874392862870272/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560785 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560785.590671:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9caffcb0ad80 x1874392862870272/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560785 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787560785.590816:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffcbc6800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787560785.590917:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787560785.590922:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862870144:0@lo:8:kworker.0 00000100:00080000:1.0:1787560785.590928:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafc5251800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787560785.590933:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787560785.590936:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862870272:0@lo:8:kworker.0 00000100:00100000:2.0:1787560785.591061:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f08f2f56-c18f-4579-88a9-05007f76ffc9:3624:1874392862877824:0@lo:400:kworker.0 00000100:00100000:2.0:1787560785.591132:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560785.591206:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862877824 00000100:00100000:1.0:1787560785.591213:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862877824 00000100:00100000:1.0:1787560785.591260:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787560785.591269:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:3624:x1874392862877824:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787560785.591350:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787560785.591355:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787560785.591358:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787560785.591361:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787560785.591789:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:3624:x1874392862877824:12345-0@lo:400:kworker.0 Request processed in 519us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560785.591798:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787560785.591960:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f08f2f56-c18f-4579-88a9-05007f76ffc9:3624:1874392862877824:0@lo:400:kworker.0 00000100:00100000:2.0:1787560785.591973:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787560785.591979:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862878208:0@lo:400:kworker.0 00000100:00100000:2.0:1787560785.592011:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560785.594269:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862878208 00000100:00100000:1.0:1787560785.594284:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862878208 00000100:00100000:1.0:1787560785.594345:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787560785.594355:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec398ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862878208:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787560785.594500:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787560785.594505:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787560785.594508:0:8:0:(import.c:65:import_set_state_nolock()) ffff9caffcbc6800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787560785.594512:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 489 00000100:00080000:0.0:1787560785.594516:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787560785.594521:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9caffcbc6800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:0.0:1787560785.594560:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafffe4d500 x1874392862878336/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787560785.594577:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787560785.594580:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787560785.594582:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cafc5251800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787560785.594584:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 489 00000100:00080000:0.0:1787560785.594586:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787560785.594590:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9cafc5251800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:0.0:1787560785.594599:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafffe4dc00 x1874392862878464/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787560785.594635:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560785.594646:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862878592:0@lo:400:kworker.0 00000100:00100000:0.0:1787560785.595017:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560785.595059:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862877952:0@lo:400:kworker.0 00000100:00100000:0.0:1787560785.595088:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560785.595108:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862878720:0@lo:400:kworker.0 00000100:00100000:0.0:1787560785.595135:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560785.595153:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787560785.595159:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862878080:0@lo:400:kworker.0 00000100:00100000:0.0:1787560785.595193:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560785.595210:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862878848:0@lo:400:kworker.0 00000100:00100000:0.0:1787560785.595231:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560785.595258:0:18389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862877952 00000100:00100000:0.0:1787560785.595263:0:18389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862877952 00000100:00100000:0.0:1787560785.595290:0:18389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787560785.595304:0:18389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2007100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862877952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560785.595347:0:18389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2007100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862877952:12345-0@lo:400:kworker.0 Request processed in 43us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560785.595354:0:18389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787560785.595396:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862877952:0@lo:400:kworker.0 00000100:00100000:1.0:1787560785.595516:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec398ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862878208:12345-0@lo:400:kworker.0 Request processed in 1162us (3504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560785.595523:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787560785.595544:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862878592 00000100:00100000:1.0:1787560785.595548:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862878592 00000100:00100000:1.0:1787560785.595568:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862878720 00000100:00100000:1.0:1787560785.595571:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862878720 00000100:00100000:1.0:1787560785.595594:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862878080 00000100:00100000:1.0:1787560785.595597:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862878080 00000100:00100000:1.0:1787560785.595606:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862878848 00000100:00100000:1.0:1787560785.595608:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862878848 00000100:00100000:1.0:1787560785.595622:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787560785.595628:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862878592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560785.595665:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862878592:12345-0@lo:400:kworker.0 Request processed in 37us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560785.595671:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787560785.596583:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787560785.596598:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862878720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560785.596644:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862878720:12345-0@lo:400:kworker.0 Request processed in 52us (1507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560785.596651:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787560785.596669:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787560785.596676:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862878080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560785.596924:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787560785.596933:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862878848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560785.596967:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862878848:12345-0@lo:400:kworker.0 Request processed in 37us (1736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560785.596973:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787560785.597038:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862878080:12345-0@lo:400:kworker.0 Request processed in 363us (1844us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560785.597055:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1787560785.597082:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787560785.597086:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787560785.597113:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cafffe4ea00 x1874392862878592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560785.597125:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862878592:0@lo:400:kworker.0 00000100:00100000:1.0:1787560785.597155:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862878336:0@lo:8:kworker.0 00000100:00100000:1.0:1787560785.597193:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560785.597233:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862878464:0@lo:8:kworker.0 00000100:00100000:1.0:1787560785.597258:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787560785.597504:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cafffe4e680 x1874392862878720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560785.597514:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862878720:0@lo:400:kworker.0 00010000:00080000:0.0:1787560785.597532:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cafffe4c700 x1874392862878080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560785.597541:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862878080:0@lo:400:kworker.0 00010000:00080000:0.0:1787560785.597551:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cafffe4e300 x1874392862878848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560785.597559:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862878848:0@lo:400:kworker.0 00000100:00100000:0.0:1787560785.597586:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862878336 00000100:00100000:0.0:1787560785.597591:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862878336 00000100:00100000:0.0:1787560785.597607:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862878464 00000100:00100000:0.0:1787560785.597610:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862878464 00000100:00100000:0.0:1787560785.597620:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787560785.597626:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3622:x1874392862878336:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787560785.597653:0:18684:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:0.0:1787560785.597679:0:18684:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4642c20bf2f3508b 00000100:00100000:2.0:1787560785.598535:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862878208:0@lo:400:kworker.0 00002000:00100000:0.0:1787560785.598605:0:18684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9caec231f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1787560785.598611:0:18684:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1787560785.598624:0:18684:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787560785.598975:0:18684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1787560785.599000:0:18684:0:(import.c:65:import_set_state_nolock()) ffff9caec231c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787560785.599096:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3622:x1874392862878336:12345-0@lo:8:kworker.0 Request processed in 1468us (1902us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560785.599104:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787560785.599122:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787560785.599127:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3622:x1874392862878464:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787560785.599141:0:18684:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1787560785.604074:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cafffe4d500 x1874392862878336/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787560805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560785.604090:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787560785.604100:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1787560785.604108:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787560785.604114:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787560785.604117:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffcbc6800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787560785.604187:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787560785.604194:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862878336:0@lo:8:kworker.0 00000004:00080000:2.0:1787560785.605975:0:17916:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1787560785.606002:0:17916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3989c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17916:1874392862879104:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1787560785.606063:0:17916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560785.606093:0:17916:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec22aa840 going to sleep for 11 seconds 00000004:00080000:2.0:1787560785.606107:0:17915:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1787560785.606629:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec398bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862878976:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787560785.606663:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787560785.607323:0:17915:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 504946891130ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787560785.607331:0:17915:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1787560785.607370:0:18683:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787560785.607377:0:18683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1787560785.607994:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862879104 00000100:00100000:2.0:1787560785.608002:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862879104 00000100:00080000:1.0:1787560785.608605:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787560785.609071:0:19050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787560785.609085:0:19050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17916:x1874392862879104:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1787560785.610468:0:17907:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1787560785.611546:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862878976 00000100:00100000:1.0:1787560785.611557:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862878976 00000100:00100000:1.0:1787560785.611617:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787560785.611627:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3623:x1874392862878976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787560785.611657:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787560785.611735:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3623:x1874392862878976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (5071us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560785.611742:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787560785.611791:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec398bb80 x1874392862878976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560801 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560785.611812:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec398bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862878976:0@lo:13:osp-pre-0-1.0 00002000:00080000:1.0:1787560785.619951:0:19050:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1787560785.619959:0:19050:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1787560785.620055:0:19050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17916:x1874392862879104:12345-0@lo:7:osp-pre-0-1.0 Request processed in 10967us (13983us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560785.620070:0:19050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787560785.620168:0:17916:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec3989c00 x1874392862879104/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787560801 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560785.620187:0:17916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3989c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17916:1874392862879104:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1787560785.620204:0:17916:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:2.0:1787560785.620313:0:17916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3989c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17916:1874392862879232:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1787560785.620370:0:17916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560785.620399:0:17916:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec40ca840 going to sleep for 11 seconds 00000100:00100000:1.0:1787560785.620553:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862879232 00000100:00100000:1.0:1787560785.620560:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862879232 00000100:00100000:1.0:1787560785.620610:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787560785.620619:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec398b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17916:x1874392862879232:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1787560785.620714:0:18683:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1787560785.622507:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3622:x1874392862878464:12345-0@lo:8:kworker.0 Request processed in 23372us (25240us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787560785.622519:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787560785.622548:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec398b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17916:x1874392862879232:12345-0@lo:5:osp-pre-0-1.0 Request processed in 1928us (2186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560785.622557:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787560785.622566:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafc5251800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787560785.622572:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787560785.622577:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862878464:0@lo:8:kworker.0 00010000:00080000:2.0:1787560785.628698:0:17916:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec3989c00 x1874392862879232/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787560801 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560785.628717:0:17916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3989c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17916:1874392862879232:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1787560785.628734:0:17916:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1787560785.628785:0:17916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3989c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17916:1874392862879360:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1787560785.628856:0:17916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560785.628903:0:17916:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec40ca840 going to sleep for 11 seconds 00000100:00100000:1.0:1787560785.628964:0:19050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862879360 00000100:00100000:1.0:1787560785.628970:0:19050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862879360 00000100:00100000:1.0:1787560785.629022:0:19050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787560785.629032:0:19050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec398a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17916:x1874392862879360:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1787560785.629074:0:19050:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:2.0:1787560785.666427:0:18679:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1787560785.666464:0:18679:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1787560785.666639:0:19050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec398a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17916:x1874392862879360:12345-0@lo:5:osp-pre-0-1.0 Request processed in 37603us (37777us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787560785.666655:0:19050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787560785.667774:0:17916:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec3989c00 x1874392862879360/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787560801 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560785.667787:0:17916:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787560785.667803:0:17916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3989c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17916:1874392862879360:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1787560785.667831:0:17916:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1787560785.667886:0:17916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3989c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17916:1874392862879488:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1787560785.668041:0:17916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560785.668275:0:17916:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec40ca840 going to sleep for 11 seconds 00000100:00100000:0.0:1787560785.668638:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862879488 00000100:00100000:0.0:1787560785.668645:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862879488 00000100:00100000:0.0:1787560785.668815:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787560785.669013:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17916:x1874392862879488:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1787560785.669355:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17916:x1874392862879488:12345-0@lo:900:osp-pre-0-1.0 Request processed in 347us (1314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560785.669364:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787560785.669587:0:17916:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec3989c00 x1874392862879488/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787560801 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560785.669602:0:17916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3989c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17916:1874392862879488:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1787560786.483633:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862879616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787560786.483709:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560786.483806:0:18389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862879616 00000100:00100000:1.0:1787560786.483813:0:18389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862879616 00000100:00100000:1.0:1787560786.483878:0:18389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787560786.483897:0:18389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862879616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787560786.483931:0:18389:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787560786.483980:0:18389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862879616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560786.483987:0:18389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787560786.484134:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862879616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787560786.485548:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862879744:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787560786.485604:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560786.485660:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862879744 00000100:00100000:0.0:1787560786.485666:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862879744 00000100:00100000:0.0:1787560786.485710:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787560786.485718:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862879744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787560786.485749:0:17178:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787560786.485788:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862879744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560786.485795:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787560786.485845:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862879744:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787560786.487562:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787560786.753147:0:19101:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787560786.753385:0:19101:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787560787.507646:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560787.636546:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560767/real 1787560767] req@ffff9caffcb08a80 x1874392862867840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560787 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560787.636585:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9caffcb08a80 x1874392862867840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560787 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787560787.636613:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec3380800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787560787.636637:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787560787.636642:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862867840:0@lo:8:kworker.0 00000100:00100000:0.0:1787560787.636759:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f08f2f56-c18f-4579-88a9-05007f76ffc9:3626:1874392862879872:0@lo:400:kworker.0 00000100:00080000:2.0:1787560787.636763:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560787.636767:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787560787.636770:0:36:0:(import.c:65:import_set_state_nolock()) ffff9caec3380800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787560787.636777:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 486 00000100:00080000:2.0:1787560787.636783:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787560787.636790:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9caec3380800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560787.636813:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caec3988000 x1874392862880128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787560787.636827:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560787.636831:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787560787.636855:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560787.636859:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:0.0:1787560787.636860:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787560787.636861:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cafc5251800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787560787.636864:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 504 00000100:00080000:2.0:1787560787.636868:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787560787.636891:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9cafc5251800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560787.636905:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caec398b480 x1874392862880640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787560787.637050:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862880512:0@lo:400:kworker.0 00000100:00100000:0.0:1787560787.637083:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560787.637102:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec398b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862880000:0@lo:400:kworker.0 00000100:00100000:0.0:1787560787.637105:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787560787.637109:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec398aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862880384:0@lo:400:kworker.0 00000100:00100000:0.0:1787560787.637133:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560787.637139:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3989f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862880256:0@lo:400:kworker.0 00000100:00100000:0.0:1787560787.637155:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874392862881024:0@lo:400:kworker.0 00000100:00100000:2.0:1787560787.637169:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560787.637188:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862880896:0@lo:400:kworker.0 00000100:00100000:0.0:1787560787.637190:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560787.637206:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560787.637219:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862879872 00000100:00100000:0.0:1787560787.637228:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862879872 00000100:00100000:2.0:1787560787.637236:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862880256 00000100:00100000:2.0:1787560787.637239:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862880256 00000100:00100000:2.0:1787560787.637279:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862881024 00000100:00100000:2.0:1787560787.637282:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862881024 00000100:00100000:0.0:1787560787.637284:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787560787.637294:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:3626:x1874392862879872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560787.637307:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862880896 00000100:00100000:2.0:1787560787.637310:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862880896 00000100:00100000:2.0:1787560787.637329:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787560787.637335:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3be8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862880256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560787.637363:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:3626:x1874392862879872:12345-0@lo:400:kworker.0 Request processed in 70us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560787.637372:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787560787.637375:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3be8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862880256:12345-0@lo:400:kworker.0 Request processed in 41us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560787.637380:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787560787.637394:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787560787.637400:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874392862881024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560787.637411:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862880384 00000100:00100000:0.0:1787560787.637415:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862880384 00000100:00100000:2.0:1787560787.637454:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874392862881024:12345-0@lo:400:kworker.0 Request processed in 54us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560787.637461:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787560787.637462:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862880512 00000100:00100000:1.0:1787560787.637468:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862880512 00000100:00100000:0.0:1787560787.637472:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787560787.637474:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787560787.637482:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862880896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560787.637482:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862880384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560787.637515:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787560787.637520:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862880896:12345-0@lo:400:kworker.0 Request processed in 38us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560787.637520:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862880384:12345-0@lo:400:kworker.0 Request processed in 40us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560787.637528:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862880512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560787.637530:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787560787.637530:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787560787.637553:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560787.637563:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862880128:0@lo:8:kworker.0 00000100:00100000:2.0:1787560787.637578:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec398bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862880768:0@lo:400:kworker.0 00000100:00100000:1.0:1787560787.637584:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862880512:12345-0@lo:400:kworker.0 Request processed in 59us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560787.637593:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787560787.637604:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560787.637604:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560787.637627:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec398b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862880640:0@lo:8:kworker.0 00000100:00100000:2.0:1787560787.637632:0:18389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862880000 00000100:00100000:2.0:1787560787.637636:0:18389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862880000 00000100:00100000:0.0:1787560787.637647:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560787.637659:0:18389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787560787.637665:0:18389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3beb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862880000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560787.637696:0:18389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3beb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862880000:12345-0@lo:400:kworker.0 Request processed in 32us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560787.637701:0:18389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787560787.638134:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862880128 00000100:00100000:1.0:1787560787.638139:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862880128 00000100:00100000:2.0:1787560787.638144:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862880640 00000100:00100000:2.0:1787560787.638150:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862880640 00000100:00100000:0.0:1787560787.638180:0:19050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787560787.638186:0:19050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3622:x1874392862880128:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787560787.638217:0:19050:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:0.0:1787560787.638251:0:19050:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4642c20bf2f35092 00002000:00100000:0.0:1787560787.638268:0:19050:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9caec231e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787560787.638272:0:19050:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787560787.638282:0:19050:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1787560787.638312:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787560787.638321:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2007800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3622:x1874392862880640:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787560787.638336:0:18683:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1787560787.638353:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec3989f80 x1874392862880256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560787.638369:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3989f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862880256:0@lo:400:kworker.0 00002000:00080000:0.0:1787560787.638372:0:19050:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00010000:00080000:2.0:1787560787.638384:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec3be8700 x1874392862880896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560787.638391:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2007800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3622:x1874392862880640:12345-0@lo:8:kworker.0 Request processed in 68us (739us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787560787.638397:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862880896:0@lo:400:kworker.0 00000100:00080000:0.0:1787560787.638403:0:19050:0:(import.c:65:import_set_state_nolock()) ffff9caec231b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787560787.638405:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787560787.638462:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862880768 00000100:00100000:1.0:1787560787.638468:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862880768 00000100:00100000:2.0:1787560787.638472:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec398b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862880000:0@lo:400:kworker.0 00000100:00100000:0.0:1787560787.638473:0:19050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3622:x1874392862880128:12345-0@lo:8:kworker.0 Request processed in 285us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560787.638479:0:19050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787560787.638504:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787560787.638512:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec398aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862880384:0@lo:400:kworker.0 00000100:00100000:1.0:1787560787.638517:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3be9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862880768:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1787560787.638529:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec3be8000 x1874392862881024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560787.638540:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874392862881024:0@lo:400:kworker.0 00010000:00080000:0.0:1787560787.638554:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec3988e00 x1874392862880512/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560787.638562:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862880512:0@lo:400:kworker.0 00000100:00100000:0.0:1787560787.638574:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f08f2f56-c18f-4579-88a9-05007f76ffc9:3626:1874392862879872:0@lo:400:kworker.0 00000100:00100000:1.0:1787560787.638587:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3be9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862880768:12345-0@lo:400:kworker.0 Request processed in 74us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560787.638595:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787560787.638630:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787560787.638635:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787560787.638638:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787560787.638660:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec398bb80 x1874392862880768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560787.638667:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec398bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862880768:0@lo:400:kworker.0 00010000:00080000:1.0:1787560787.638694:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec3988000 x1874392862880128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787560812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560787.638704:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787560787.638712:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787560787.638721:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787560787.638727:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787560787.638729:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec3380800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787560787.638750:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787560787.638756:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862880128:0@lo:8:kworker.0 00000100:00080000:1.0:1787560787.638774:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafc5251800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000004:00080000:0.0:1787560787.638774:0:17197:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00080000:1.0:1787560787.638781:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787560787.638788:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec398b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862880640:0@lo:8:kworker.0 00000004:00080000:2.0:1787560787.638802:0:17198:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:1.0:1787560787.638824:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787560787.638825:0:17198:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17198:1874392862881280:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787560787.638838:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862881152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560787.638870:0:17198:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787560787.638875:0:17197:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 506978443238ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787560787.638894:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:00080000:0.0:1787560787.638895:0:17197:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1787560787.638903:0:17198:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec40caf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787560787.638920:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862881280 00000100:00100000:2.0:1787560787.638925:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862881280 00000100:00100000:1.0:1787560787.638947:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862881152 00000100:00100000:1.0:1787560787.638953:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862881152 00000100:00100000:2.0:1787560787.638969:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787560787.638977:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3beaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:17198:x1874392862881280:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787560787.639000:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787560787.639010:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3625:x1874392862881152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787560787.639034:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787560787.639088:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3625:x1874392862881152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560787.639095:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787560787.639116:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787560787.639138:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec3be8700 x1874392862881152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560787.639155:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862881152:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1787560787.641236:0:17153:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:2.0:1787560787.641388:0:18685:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1787560787.641400:0:18685:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1787560787.641407:0:18685:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00002000:00010000:0.0:1787560787.650537:0:18685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787560787.650560:0:18685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b786b935/0x4642c20bf2f35099 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.650583:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1787560787.650588:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560787.650597:0:18685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b786b935/0x4642c20bf2f35099 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.650641:0:18685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b786b935/0x4642c20bf2f35099 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.650660:0:18685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b786b935/0x4642c20bf2f35099 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.650670:0:18685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b786b935/0x4642c20bf2f35099 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.650697:0:18685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787560787.651074:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560787.651086:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b786b935/0x4642c20bf2f35099 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560787.651098:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880c00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560787.651104:0:17928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b786b935/0x4642c20bf2f35099 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560787.651114:0:17928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b786b935/0x4642c20bf2f35099 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560787.651141:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b786b935/0x4642c20bf2f35099 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560787.651161:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b786b935/0x4642c20bf2f35099 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560787.651188:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560787.651191:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560787.651199:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787560787.653033:0:18685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787560787.653050:0:18685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eff725e/0x4642c20bf2f350a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.653071:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1787560787.653077:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560787.653084:0:18685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009eff725e/0x4642c20bf2f350a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.653099:0:18685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009eff725e/0x4642c20bf2f350a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.653111:0:18685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eff725e/0x4642c20bf2f350a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.653133:0:18685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009eff725e/0x4642c20bf2f350a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.653167:0:18685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787560787.653392:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560787.653401:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009eff725e/0x4642c20bf2f350a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.653412:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881200 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:2.0:1787560787.653418:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009eff725e/0x4642c20bf2f350a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.653428:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009eff725e/0x4642c20bf2f350a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.654289:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009eff725e/0x4642c20bf2f350a0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.654299:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009eff725e/0x4642c20bf2f350a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.654354:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560787.654357:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560787.654359:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787560787.655329:0:18685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787560787.655340:0:18685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7b1ee9b/0x4642c20bf2f350a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.655358:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1787560787.655363:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560787.655370:0:18685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7b1ee9b/0x4642c20bf2f350a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.655385:0:18685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7b1ee9b/0x4642c20bf2f350a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.655397:0:18685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7b1ee9b/0x4642c20bf2f350a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.655405:0:18685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7b1ee9b/0x4642c20bf2f350a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.655455:0:18685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787560787.655533:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560787.655542:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7b1ee9b/0x4642c20bf2f350a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560787.655552:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880800 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560787.655557:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7b1ee9b/0x4642c20bf2f350a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560787.655568:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7b1ee9b/0x4642c20bf2f350a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560787.655585:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7b1ee9b/0x4642c20bf2f350a7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560787.655593:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7b1ee9b/0x4642c20bf2f350a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560787.655613:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560787.655615:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560787.655617:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787560787.655794:0:18685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787560787.655800:0:18685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fde73663/0x4642c20bf2f350ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.655816:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1787560787.655819:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560787.655824:0:18685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fde73663/0x4642c20bf2f350ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.655833:0:18685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fde73663/0x4642c20bf2f350ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.655842:0:18685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fde73663/0x4642c20bf2f350ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.655850:0:18685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fde73663/0x4642c20bf2f350ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.655918:0:18685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787560787.657505:0:18685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787560787.657524:0:18685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008191efc4/0x4642c20bf2f350b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.657542:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1787560787.657547:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560787.657553:0:18685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008191efc4/0x4642c20bf2f350b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.657568:0:18685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008191efc4/0x4642c20bf2f350b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.657591:0:18685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008191efc4/0x4642c20bf2f350b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.657600:0:18685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008191efc4/0x4642c20bf2f350b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560787.658183:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787560787.658193:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fde73663/0x4642c20bf2f350ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560787.658201:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbffc00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560787.658205:0:17928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fde73663/0x4642c20bf2f350ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560787.658223:0:17928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fde73663/0x4642c20bf2f350ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560787.658241:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fde73663/0x4642c20bf2f350ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560787.658246:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fde73663/0x4642c20bf2f350ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.658250:0:18685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787560787.658275:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560787.658287:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008191efc4/0x4642c20bf2f350b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.658294:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbfe000 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560787.658294:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560787.658296:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560787.658297:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008191efc4/0x4642c20bf2f350b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560787.658298:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560787.658304:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008191efc4/0x4642c20bf2f350b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.658318:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008191efc4/0x4642c20bf2f350b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.658325:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008191efc4/0x4642c20bf2f350b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.658346:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560787.658348:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560787.658349:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787560787.659012:0:18685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787560787.659022:0:18685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056a6fece/0x4642c20bf2f350bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.659037:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1787560787.659042:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560787.659048:0:18685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056a6fece/0x4642c20bf2f350bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.659061:0:18685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056a6fece/0x4642c20bf2f350bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.659072:0:18685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056a6fece/0x4642c20bf2f350bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.659081:0:18685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056a6fece/0x4642c20bf2f350bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.660425:0:18685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787560787.660468:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560787.660480:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056a6fece/0x4642c20bf2f350bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.660490:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbfee00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560787.660496:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056a6fece/0x4642c20bf2f350bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.660522:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056a6fece/0x4642c20bf2f350bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.660549:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056a6fece/0x4642c20bf2f350bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.660557:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056a6fece/0x4642c20bf2f350bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.660642:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560787.660645:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560787.660647:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787560787.662350:0:18685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787560787.662368:0:18685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710cff71/0x4642c20bf2f350c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.662390:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1787560787.662396:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560787.662403:0:18685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000710cff71/0x4642c20bf2f350c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.662423:0:18685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000710cff71/0x4642c20bf2f350c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.662451:0:18685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710cff71/0x4642c20bf2f350c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.662460:0:18685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000710cff71/0x4642c20bf2f350c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.662485:0:18685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787560787.662501:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560787.662508:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000710cff71/0x4642c20bf2f350c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.662517:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbfe600 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560787.662532:0:17928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000710cff71/0x4642c20bf2f350c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.662542:0:17928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000710cff71/0x4642c20bf2f350c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.662562:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000710cff71/0x4642c20bf2f350c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.662571:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000710cff71/0x4642c20bf2f350c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.662590:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560787.662592:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560787.662594:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787560787.666706:0:18685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787560787.666721:0:18685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed44d44d/0x4642c20bf2f350ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.666738:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1787560787.666742:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560787.666748:0:18685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed44d44d/0x4642c20bf2f350ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.666762:0:18685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed44d44d/0x4642c20bf2f350ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.666770:0:18685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed44d44d/0x4642c20bf2f350ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.666776:0:18685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed44d44d/0x4642c20bf2f350ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.666796:0:18685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787560787.666819:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560787.666827:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed44d44d/0x4642c20bf2f350ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560787.666837:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169200 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560787.666842:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed44d44d/0x4642c20bf2f350ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560787.666851:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed44d44d/0x4642c20bf2f350ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560787.666871:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed44d44d/0x4642c20bf2f350ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560787.666904:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed44d44d/0x4642c20bf2f350ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560787.666923:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560787.666925:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560787.666927:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787560787.667412:0:18685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787560787.667421:0:18685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f05c3dc8/0x4642c20bf2f350d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.667473:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1787560787.667477:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560787.667482:0:18685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f05c3dc8/0x4642c20bf2f350d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.667494:0:18685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f05c3dc8/0x4642c20bf2f350d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.667504:0:18685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f05c3dc8/0x4642c20bf2f350d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.667511:0:18685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f05c3dc8/0x4642c20bf2f350d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.667532:0:18685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787560787.667655:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560787.667663:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f05c3dc8/0x4642c20bf2f350d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560787.667672:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169000 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560787.667677:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f05c3dc8/0x4642c20bf2f350d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560787.667687:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f05c3dc8/0x4642c20bf2f350d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560787.667704:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f05c3dc8/0x4642c20bf2f350d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560787.667713:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f05c3dc8/0x4642c20bf2f350d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560787.667735:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560787.667738:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560787.667741:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787560787.668166:0:18685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787560787.668174:0:18685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071f4a766/0x4642c20bf2f350d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.668184:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1787560787.668187:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560787.668192:0:18685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071f4a766/0x4642c20bf2f350d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.668203:0:18685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071f4a766/0x4642c20bf2f350d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.668223:0:18685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071f4a766/0x4642c20bf2f350d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.668231:0:18685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071f4a766/0x4642c20bf2f350d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.668249:0:18685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787560787.668388:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560787.668396:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071f4a766/0x4642c20bf2f350d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.668406:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169e00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560787.668410:0:17928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071f4a766/0x4642c20bf2f350d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.668420:0:17928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071f4a766/0x4642c20bf2f350d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.668621:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071f4a766/0x4642c20bf2f350d8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.668640:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071f4a766/0x4642c20bf2f350d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.668658:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560787.668661:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560787.668663:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787560787.669078:0:18685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787560787.669085:0:18685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067aa9cc0/0x4642c20bf2f350df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.669095:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1787560787.669098:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560787.669102:0:18685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067aa9cc0/0x4642c20bf2f350df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.669112:0:18685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067aa9cc0/0x4642c20bf2f350df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.669120:0:18685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067aa9cc0/0x4642c20bf2f350df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.669127:0:18685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067aa9cc0/0x4642c20bf2f350df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.669661:0:18685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787560787.670352:0:18685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787560787.670362:0:18685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dba740cc/0x4642c20bf2f350e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.670378:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1787560787.670383:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560787.670390:0:18685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dba740cc/0x4642c20bf2f350e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.670403:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560787.670405:0:18685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dba740cc/0x4642c20bf2f350e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.670413:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067aa9cc0/0x4642c20bf2f350df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.670418:0:18685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dba740cc/0x4642c20bf2f350e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.670465:0:18685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dba740cc/0x4642c20bf2f350e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.670485:0:18685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787560787.670495:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560787.670499:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dba740cc/0x4642c20bf2f350e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.670507:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169800 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:2.0:1787560787.670520:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dba740cc/0x4642c20bf2f350e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.670530:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dba740cc/0x4642c20bf2f350e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.670551:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dba740cc/0x4642c20bf2f350e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.670559:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dba740cc/0x4642c20bf2f350e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.670651:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560787.670653:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560787.670656:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560787.671395:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168200 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560787.671402:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067aa9cc0/0x4642c20bf2f350df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.671414:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067aa9cc0/0x4642c20bf2f350df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.671448:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067aa9cc0/0x4642c20bf2f350df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787560787.671535:0:18685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787560787.671542:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067aa9cc0/0x4642c20bf2f350df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.671545:0:18685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036eb34cc/0x4642c20bf2f350ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.671564:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=507s v=(0 0) 00010000:00010000:3.0:1787560787.671574:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560787.671577:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560787.671580:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560787.671629:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560787.671639:0:18685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036eb34cc/0x4642c20bf2f350ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.671651:0:18685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036eb34cc/0x4642c20bf2f350ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.671660:0:18685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036eb34cc/0x4642c20bf2f350ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.671673:0:18685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036eb34cc/0x4642c20bf2f350ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.671705:0:18685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787560787.671738:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560787.671745:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036eb34cc/0x4642c20bf2f350ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.671754:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168a00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560787.671758:0:17928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036eb34cc/0x4642c20bf2f350ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.671766:0:17928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036eb34cc/0x4642c20bf2f350ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.671778:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036eb34cc/0x4642c20bf2f350ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.671785:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036eb34cc/0x4642c20bf2f350ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.671799:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560787.671801:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560787.671803:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787560787.672386:0:18685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787560787.672394:0:18685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b670e820/0x4642c20bf2f350f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.672404:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1787560787.672407:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560787.672412:0:18685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b670e820/0x4642c20bf2f350f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.672421:0:18685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b670e820/0x4642c20bf2f350f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.672447:0:18685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b670e820/0x4642c20bf2f350f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.672455:0:18685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b670e820/0x4642c20bf2f350f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.672474:0:18685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787560787.672580:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560787.672587:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b670e820/0x4642c20bf2f350f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.672596:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169a00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560787.672600:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b670e820/0x4642c20bf2f350f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.672609:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b670e820/0x4642c20bf2f350f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.672624:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b670e820/0x4642c20bf2f350f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.672632:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b670e820/0x4642c20bf2f350f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.672649:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560787.672651:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560787.672652:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787560787.672772:0:18685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787560787.672779:0:18685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053c29c68/0x4642c20bf2f350fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.672792:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1787560787.672795:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560787.672799:0:18685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053c29c68/0x4642c20bf2f350fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.673700:0:18685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053c29c68/0x4642c20bf2f350fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.673713:0:18685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053c29c68/0x4642c20bf2f350fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.673721:0:18685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053c29c68/0x4642c20bf2f350fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.673783:0:18685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787560787.674307:0:18685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787560787.674316:0:18685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c20cc5b0/0x4642c20bf2f35102 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.674329:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1787560787.674334:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560787.674339:0:18685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c20cc5b0/0x4642c20bf2f35102 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.674349:0:18685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c20cc5b0/0x4642c20bf2f35102 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.674369:0:18685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c20cc5b0/0x4642c20bf2f35102 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.674376:0:18685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c20cc5b0/0x4642c20bf2f35102 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.674503:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787560787.674512:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053c29c68/0x4642c20bf2f350fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.674522:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168e00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560787.674527:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053c29c68/0x4642c20bf2f350fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.674537:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053c29c68/0x4642c20bf2f350fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.674557:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053c29c68/0x4642c20bf2f350fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.674565:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053c29c68/0x4642c20bf2f350fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.674586:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560787.674590:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c20cc5b0/0x4642c20bf2f35102 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.674596:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2169600 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560787.674601:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c20cc5b0/0x4642c20bf2f35102 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.674608:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c20cc5b0/0x4642c20bf2f35102 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.674633:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c20cc5b0/0x4642c20bf2f35102 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.674642:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560787.674645:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560787.674648:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560787.674702:0:18685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787560787.674708:0:18685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c20cc5b0/0x4642c20bf2f35102 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.674713:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787560787.675291:0:18685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787560787.675299:0:18685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065a37503/0x4642c20bf2f35109 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.675309:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1787560787.675313:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560787.675319:0:18685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065a37503/0x4642c20bf2f35109 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.675331:0:18685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065a37503/0x4642c20bf2f35109 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.675340:0:18685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065a37503/0x4642c20bf2f35109 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.675363:0:18685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065a37503/0x4642c20bf2f35109 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.675656:0:18685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787560787.676035:0:18685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787560787.676041:0:18685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093984698/0x4642c20bf2f35110 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.676052:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1787560787.676055:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560787.676060:0:18685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093984698/0x4642c20bf2f35110 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.676071:0:18685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093984698/0x4642c20bf2f35110 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.676080:0:18685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093984698/0x4642c20bf2f35110 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.676089:0:18685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093984698/0x4642c20bf2f35110 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.676126:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787560787.676134:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065a37503/0x4642c20bf2f35109 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.676143:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168c00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560787.676149:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065a37503/0x4642c20bf2f35109 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.676167:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065a37503/0x4642c20bf2f35109 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.676185:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065a37503/0x4642c20bf2f35109 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.676192:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065a37503/0x4642c20bf2f35109 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.676211:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560787.676214:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093984698/0x4642c20bf2f35110 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.676219:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168800 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560787.676222:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093984698/0x4642c20bf2f35110 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.676230:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093984698/0x4642c20bf2f35110 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.676253:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093984698/0x4642c20bf2f35110 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.676262:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560787.676263:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560787.676265:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560787.676395:0:18685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787560787.676400:0:18685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093984698/0x4642c20bf2f35110 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787560787.676847:0:18685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787560787.676854:0:18685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc7bafae/0x4642c20bf2f35117 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.676864:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1787560787.676867:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560787.676872:0:18685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc7bafae/0x4642c20bf2f35117 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.676895:0:18685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc7bafae/0x4642c20bf2f35117 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.676904:0:18685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc7bafae/0x4642c20bf2f35117 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.676912:0:18685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc7bafae/0x4642c20bf2f35117 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.677041:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560787.677049:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc7bafae/0x4642c20bf2f35117 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.677057:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49e00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560787.677061:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc7bafae/0x4642c20bf2f35117 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.677069:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc7bafae/0x4642c20bf2f35117 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.677084:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc7bafae/0x4642c20bf2f35117 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.677092:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560787.677095:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560787.677096:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560787.677591:0:18685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787560787.677599:0:18685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc7bafae/0x4642c20bf2f35117 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787560787.678010:0:18685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787560787.678017:0:18685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c9df88/0x4642c20bf2f3511e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.678040:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1787560787.678044:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560787.678051:0:18685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c9df88/0x4642c20bf2f3511e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.678063:0:18685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c9df88/0x4642c20bf2f3511e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.678073:0:18685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c9df88/0x4642c20bf2f3511e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.678081:0:18685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c9df88/0x4642c20bf2f3511e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.678117:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560787.678124:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c9df88/0x4642c20bf2f3511e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.678139:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca48a00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560787.678145:0:17928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c9df88/0x4642c20bf2f3511e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.678218:0:17928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c9df88/0x4642c20bf2f3511e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.678234:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c9df88/0x4642c20bf2f3511e lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.678243:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560787.678245:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560787.678247:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560787.678314:0:18685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787560787.678319:0:18685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c9df88/0x4642c20bf2f3511e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787560787.678689:0:18685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787560787.678697:0:18685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004798767d/0x4642c20bf2f35125 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.678706:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1787560787.678710:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560787.678715:0:18685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004798767d/0x4642c20bf2f35125 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.678735:0:18685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004798767d/0x4642c20bf2f35125 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.678743:0:18685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004798767d/0x4642c20bf2f35125 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.678751:0:18685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004798767d/0x4642c20bf2f35125 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.678861:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560787.678869:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004798767d/0x4642c20bf2f35125 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.678877:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca48200 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560787.678891:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004798767d/0x4642c20bf2f35125 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.678900:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004798767d/0x4642c20bf2f35125 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.678913:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004798767d/0x4642c20bf2f35125 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.678922:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560787.678924:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560787.678925:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560787.679031:0:18685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787560787.679036:0:18685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004798767d/0x4642c20bf2f35125 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787560787.679529:0:18685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787560787.679536:0:18685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022c582c0/0x4642c20bf2f3512c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.679544:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1787560787.679548:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560787.679553:0:18685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022c582c0/0x4642c20bf2f3512c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.679563:0:18685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022c582c0/0x4642c20bf2f3512c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.679584:0:18685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022c582c0/0x4642c20bf2f3512c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.679592:0:18685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022c582c0/0x4642c20bf2f3512c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.679643:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560787.679649:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022c582c0/0x4642c20bf2f3512c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.679656:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca48800 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560787.679660:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022c582c0/0x4642c20bf2f3512c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.679669:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022c582c0/0x4642c20bf2f3512c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.679682:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022c582c0/0x4642c20bf2f3512c lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.679698:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560787.679700:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560787.679702:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560787.679791:0:18685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787560787.679797:0:18685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022c582c0/0x4642c20bf2f3512c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787560787.680144:0:18685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787560787.680150:0:18685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d8ec592/0x4642c20bf2f35133 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.680174:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1787560787.680178:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560787.680182:0:18685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d8ec592/0x4642c20bf2f35133 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.680193:0:18685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d8ec592/0x4642c20bf2f35133 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.680202:0:18685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d8ec592/0x4642c20bf2f35133 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.680222:0:18685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d8ec592/0x4642c20bf2f35133 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.680305:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560787.680312:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d8ec592/0x4642c20bf2f35133 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.680320:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca48600 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560787.680324:0:17928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d8ec592/0x4642c20bf2f35133 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.680332:0:17928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d8ec592/0x4642c20bf2f35133 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.680345:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d8ec592/0x4642c20bf2f35133 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.680354:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560787.680355:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560787.680357:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560787.680427:0:18685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787560787.680496:0:18685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d8ec592/0x4642c20bf2f35133 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787560787.680877:0:18685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787560787.680903:0:18685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000834a0dcf/0x4642c20bf2f3513a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.680914:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1787560787.680918:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560787.680923:0:18685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000834a0dcf/0x4642c20bf2f3513a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.680933:0:18685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000834a0dcf/0x4642c20bf2f3513a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.680942:0:18685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000834a0dcf/0x4642c20bf2f3513a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.680949:0:18685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000834a0dcf/0x4642c20bf2f3513a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.681029:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560787.681037:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000834a0dcf/0x4642c20bf2f3513a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.681058:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca48c00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560787.681061:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000834a0dcf/0x4642c20bf2f3513a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.681070:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000834a0dcf/0x4642c20bf2f3513a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.681083:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000834a0dcf/0x4642c20bf2f3513a lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560787.681091:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560787.681093:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560787.681095:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560787.681265:0:18685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787560787.681271:0:18685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000834a0dcf/0x4642c20bf2f3513a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787560787.681733:0:18685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787560787.681741:0:18685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bd2300a/0x4642c20bf2f35141 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.681751:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1787560787.681755:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560787.681761:0:18685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bd2300a/0x4642c20bf2f35141 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.681772:0:18685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bd2300a/0x4642c20bf2f35141 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.681782:0:18685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bd2300a/0x4642c20bf2f35141 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.681790:0:18685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009bd2300a/0x4642c20bf2f35141 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.681848:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560787.681855:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009bd2300a/0x4642c20bf2f35141 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.681863:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca48000 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560787.681867:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009bd2300a/0x4642c20bf2f35141 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.681894:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009bd2300a/0x4642c20bf2f35141 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.681908:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009bd2300a/0x4642c20bf2f35141 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.681917:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560787.681919:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560787.681921:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560787.682025:0:18685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787560787.682031:0:18685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bd2300a/0x4642c20bf2f35141 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787560787.682505:0:18685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787560787.682512:0:18685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0ef4953/0x4642c20bf2f35148 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.682522:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1787560787.682526:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560787.682530:0:18685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0ef4953/0x4642c20bf2f35148 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.682541:0:18685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0ef4953/0x4642c20bf2f35148 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.682550:0:18685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0ef4953/0x4642c20bf2f35148 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.682557:0:18685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0ef4953/0x4642c20bf2f35148 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.682614:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560787.682621:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0ef4953/0x4642c20bf2f35148 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.682629:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca48400 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560787.682633:0:17928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0ef4953/0x4642c20bf2f35148 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.682641:0:17928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0ef4953/0x4642c20bf2f35148 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.682652:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0ef4953/0x4642c20bf2f35148 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.682661:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560787.682663:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560787.682665:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560787.682709:0:18685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787560787.682714:0:18685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0ef4953/0x4642c20bf2f35148 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560787.682727:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787560787.683060:0:18685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787560787.683067:0:18685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4e51baa/0x4642c20bf2f3514f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.683086:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1787560787.683090:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560787.683094:0:18685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4e51baa/0x4642c20bf2f3514f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.683103:0:18685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4e51baa/0x4642c20bf2f3514f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.683111:0:18685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4e51baa/0x4642c20bf2f3514f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.683119:0:18685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4e51baa/0x4642c20bf2f3514f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.683244:0:18685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787560787.683609:0:18685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787560787.683616:0:18685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbff1a42/0x4642c20bf2f35156 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.683626:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1787560787.683629:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560787.683634:0:18685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbff1a42/0x4642c20bf2f35156 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.683645:0:18685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbff1a42/0x4642c20bf2f35156 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.683665:0:18685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbff1a42/0x4642c20bf2f35156 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560787.683673:0:18685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbff1a42/0x4642c20bf2f35156 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.683774:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787560787.683781:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4e51baa/0x4642c20bf2f3514f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.683789:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49600 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560787.683794:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4e51baa/0x4642c20bf2f3514f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.683803:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4e51baa/0x4642c20bf2f3514f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.683832:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4e51baa/0x4642c20bf2f3514f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.683840:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4e51baa/0x4642c20bf2f3514f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.683856:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560787.683859:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbff1a42/0x4642c20bf2f35156 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.683866:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49a00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560787.683870:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbff1a42/0x4642c20bf2f35156 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.683878:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbff1a42/0x4642c20bf2f35156 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.683913:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbff1a42/0x4642c20bf2f35156 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560787.683922:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560787.683924:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560787.683926:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560787.684028:0:18685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787560787.684033:0:18685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbff1a42/0x4642c20bf2f35156 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1787560787.684086:0:18685:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:2.0:1787560787.684232:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3beaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17198:x1874392862881280:12345-0@lo:5:osp-pre-0-0.0 Request processed in 45250us (45357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560787.684243:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787560787.684418:0:17198:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17198:1874392862881280:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787560787.684483:0:17198:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:1.0:1787560787.684544:0:17198:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17198:1874392862881408:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787560787.684591:0:17198:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560787.684624:0:17198:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd86bc540 going to sleep for 11 seconds 00000100:00100000:0.0:1787560787.684655:0:19050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862881408 00000100:00100000:0.0:1787560787.684664:0:19050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862881408 00000100:00100000:0.0:1787560787.684720:0:19050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787560787.684731:0:19050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17198:x1874392862881408:12345-0@lo:5:osp-pre-0-0.0 00010000:00010000:3.0:1787560787.684758:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787560787.684778:0:19050:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:2.0:1787560787.693173:0:18679:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1787560787.693231:0:18679:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787560787.693821:0:19050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17198:x1874392862881408:12345-0@lo:5:osp-pre-0-0.0 Request processed in 9072us (9209us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787560787.693835:0:19050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787560787.694077:0:17198:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1787560787.694089:0:17198:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17198:1874392862881408:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787560787.694108:0:17198:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000020:00000004:2.0:1787560787.900962:0:19151:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787560787.901215:0:19151:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787560788.532941:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560788.665513:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560768/real 1787560768] req@ffff9cafffe19180 x1874392862868608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560788 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560788.665545:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cafffe19180 x1874392862868608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560788 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787560788.665580:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec32fd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787560788.665595:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787560788.665599:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862868608:0@lo:8:kworker.0 00000100:00080000:2.0:1787560788.665742:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560788.665747:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787560788.665750:0:8:0:(import.c:65:import_set_state_nolock()) ffff9caec32fd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787560788.665754:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 487 00000100:00080000:2.0:1787560788.665759:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787560788.665765:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9caec32fd800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560788.665787:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caec3be8380 x1874392862881920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787560788.665827:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560788.665830:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787560788.665831:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cafc5251800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787560788.665835:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 506 00000100:00080000:2.0:1787560788.665838:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787560788.665841:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9cafc5251800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560788.665853:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caec3be9f80 x1874392862882432/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787560788.665909:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862881664:0@lo:400:kworker.0 00000100:00100000:2.0:1787560788.665980:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560788.666010:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3beb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862882304:0@lo:400:kworker.0 00000100:00100000:2.0:1787560788.666032:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560788.666053:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787560788.666058:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f08f2f56-c18f-4579-88a9-05007f76ffc9:3624:1874392862881536:0@lo:400:kworker.0 00000100:00100000:2.0:1787560788.666084:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560788.666107:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862882176:0@lo:400:kworker.0 00000100:00100000:2.0:1787560788.666127:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560788.666142:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862882816:0@lo:400:kworker.0 00000100:00100000:2.0:1787560788.666163:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560788.666199:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3beb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862881792:0@lo:400:kworker.0 00000100:00100000:2.0:1787560788.666223:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560788.666239:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862882560:0@lo:400:kworker.0 00000100:00100000:2.0:1787560788.666259:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560788.666287:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787560788.666292:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862882048:0@lo:400:kworker.0 00000100:00100000:2.0:1787560788.666315:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560788.666332:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862882688:0@lo:400:kworker.0 00000100:00100000:2.0:1787560788.666351:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560788.666382:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862882304 00000100:00100000:2.0:1787560788.666390:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862882304 00000100:00100000:2.0:1787560788.666456:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862881792 00000100:00100000:2.0:1787560788.666460:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862881792 00000100:00100000:2.0:1787560788.666482:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787560788.666491:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3be8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862882304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560788.666545:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3be8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862882304:12345-0@lo:400:kworker.0 Request processed in 55us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560788.666552:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787560788.666569:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787560788.666575:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec398bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862881792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560788.666607:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec398bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862881792:12345-0@lo:400:kworker.0 Request processed in 32us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560788.666613:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787560788.666631:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862881536 00000100:00100000:2.0:1787560788.666634:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862881536 00000100:00100000:2.0:1787560788.666658:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787560788.666665:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:3624:x1874392862881536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560788.666694:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:3624:x1874392862881536:12345-0@lo:400:kworker.0 Request processed in 30us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560788.666700:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787560788.666727:0:18389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862881664 00000100:00100000:2.0:1787560788.666736:0:18389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862881664 00000100:00100000:2.0:1787560788.666762:0:18389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862882176 00000100:00100000:2.0:1787560788.666765:0:18389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862882176 00000100:00100000:2.0:1787560788.666779:0:18389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787560788.666785:0:18389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862881664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560788.666819:0:18389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862881664:12345-0@lo:400:kworker.0 Request processed in 34us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560788.666826:0:18389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787560788.666836:0:18389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787560788.666842:0:18389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec398b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862882176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560788.666868:0:18389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec398b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862882176:12345-0@lo:400:kworker.0 Request processed in 26us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560788.666883:0:18389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787560788.666901:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862882816 00000100:00100000:2.0:1787560788.666905:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862882816 00000100:00100000:2.0:1787560788.666923:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862882560 00000100:00100000:2.0:1787560788.666926:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862882560 00000100:00100000:2.0:1787560788.666937:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862882048 00000100:00100000:2.0:1787560788.666939:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862882048 00000100:00100000:2.0:1787560788.666950:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862882688 00000100:00100000:2.0:1787560788.666952:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862882688 00000100:00100000:2.0:1787560788.666964:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787560788.666970:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862882816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560788.667000:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862882816:12345-0@lo:400:kworker.0 Request processed in 30us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560788.667006:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787560788.667018:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787560788.667024:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862882560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560788.667062:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862882560:12345-0@lo:400:kworker.0 Request processed in 38us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560788.667068:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787560788.667080:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787560788.667085:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3988e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862882048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560788.667111:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3988e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862882048:12345-0@lo:400:kworker.0 Request processed in 26us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560788.667117:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787560788.667128:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787560788.667134:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec398aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862882688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560788.667160:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec398aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862882688:12345-0@lo:400:kworker.0 Request processed in 27us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560788.667166:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787560788.667205:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862881920:0@lo:8:kworker.0 00000100:00100000:2.0:1787560788.667245:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560788.667264:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862882432:0@lo:8:kworker.0 00000100:00100000:2.0:1787560788.667285:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560788.667313:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862881920 00000100:00100000:2.0:1787560788.667317:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862881920 00000100:00100000:2.0:1787560788.667332:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862882432 00000100:00100000:2.0:1787560788.667335:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862882432 00000100:00100000:2.0:1787560788.667344:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787560788.667349:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec398b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3622:x1874392862881920:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787560788.667368:0:18685:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787560788.667401:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec398b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3622:x1874392862881920:12345-0@lo:8:kworker.0 Request processed in 51us (155us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787560788.667413:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787560788.667426:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787560788.667455:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3622:x1874392862882432:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787560788.667466:0:18685:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787560788.667493:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3622:x1874392862882432:12345-0@lo:8:kworker.0 Request processed in 61us (206us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787560788.667498:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1787560788.667532:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec3bea680 x1874392862882048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560788.667546:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862882048:0@lo:400:kworker.0 00010000:00080000:2.0:1787560788.667558:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec3bebb80 x1874392862882688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560788.667566:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862882688:0@lo:400:kworker.0 00000100:00100000:2.0:1787560788.667577:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3beb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862881792:0@lo:400:kworker.0 00010000:00080000:2.0:1787560788.667587:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec3be9180 x1874392862882560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560788.667596:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862882560:0@lo:400:kworker.0 00000100:00080000:2.0:1787560788.667634:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec32fd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787560788.667639:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787560788.667642:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862881920:0@lo:8:kworker.0 00000100:00080000:2.0:1787560788.667650:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafc5251800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787560788.667653:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787560788.667662:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862882432:0@lo:8:kworker.0 00000100:00100000:2.0:1787560788.667691:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f08f2f56-c18f-4579-88a9-05007f76ffc9:3624:1874392862881536:0@lo:400:kworker.0 00000100:00100000:2.0:1787560788.667702:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862882176:0@lo:400:kworker.0 00010000:00080000:2.0:1787560788.667711:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec3be9500 x1874392862882816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560788.667719:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862882816:0@lo:400:kworker.0 00000100:00100000:2.0:1787560788.667728:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862881664:0@lo:400:kworker.0 00000100:00100000:2.0:1787560788.667740:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3beb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862882304:0@lo:400:kworker.0 00010000:00010000:1.0:1787560789.555663:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560790.579597:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560791.092220:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560791.092246:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862882944:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787560791.092311:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560791.093596:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862882944 00000100:00100000:1.0:1787560791.093608:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862882944 00000100:00100000:1.0:1787560791.093674:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787560791.093684:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862882944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787560791.093713:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787560791.093778:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862882944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (1466us total) trans 0 rc 0/0 00000100:00080000:3.0:1787560791.093923:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787560791.094033:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787560791.094090:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862882944:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787560791.607646:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862883072:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787560791.607728:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560791.607959:0:18389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862883072 00000100:00100000:3.0:1787560791.607966:0:18389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862883072 00000100:00100000:3.0:1787560791.608008:0:18389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787560791.608016:0:18389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862883072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787560791.608048:0:18389:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787560791.608099:0:18389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862883072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560791.608107:0:18389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787560791.608151:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862883072:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787560791.609599:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787560791.609616:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862883200:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787560791.609666:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560791.610332:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862883200 00000100:00100000:0.0:1787560791.610340:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862883200 00000100:00100000:0.0:1787560791.610389:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787560791.610397:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862883200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787560791.610443:0:17178:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787560791.610491:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862883200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560791.610498:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787560791.610543:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862883200:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787560791.613209:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787560792.438021:0:17927:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787560792.627638:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560793.140939:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862883328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787560793.141010:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560793.141138:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862883328 00000100:00100000:0.0:1787560793.141146:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862883328 00000100:00100000:0.0:1787560793.141200:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787560793.141210:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862883328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787560793.141238:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787560793.141285:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862883328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560793.141293:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787560793.141314:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560793.141368:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862883328:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787560793.662749:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787560794.168049:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787560794.168056:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787560794.168076:0:8:0:(import.c:65:import_set_state_nolock()) ffff9caec32fd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787560794.168085:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 508 00000100:00080000:1.0:1787560794.168090:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787560794.168098:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9caec32fd800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1787560794.168123:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caec407ce00 x1874392862883840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787560794.168158:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787560794.168161:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787560794.168163:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cafc5251800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787560794.168167:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 508 00000100:00080000:1.0:1787560794.168169:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787560794.168172:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9cafc5251800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1787560794.168183:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caec407f100 x1874392862884352/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787560794.168234:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f08f2f56-c18f-4579-88a9-05007f76ffc9:3624:1874392862883456:0@lo:400:kworker.0 00000100:00100000:1.0:1787560794.168234:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862883584:0@lo:400:kworker.0 00000100:00100000:3.0:1787560794.168306:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862883968:0@lo:400:kworker.0 00000100:00100000:0.0:1787560794.170342:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862883712:0@lo:400:kworker.0 00000100:00100000:2.0:1787560794.174538:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560794.174608:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862884096:0@lo:400:kworker.0 00000100:00100000:2.0:1787560794.174648:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560794.174668:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862884736:0@lo:400:kworker.0 00000100:00100000:2.0:1787560794.174694:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560794.174752:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862884736 00000100:00100000:2.0:1787560794.174761:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862884736 00000100:00100000:2.0:1787560794.174822:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787560794.174832:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862884736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560794.174895:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862884736:12345-0@lo:400:kworker.0 Request processed in 65us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560794.174902:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1787560794.174925:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787560794.174982:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cafffe4c380 x1874392862884736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560794.174995:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862884736:0@lo:400:kworker.0 00000100:00100000:3.0:1787560794.182295:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560794.182358:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862883968 00000100:00100000:3.0:1787560794.182367:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862883968 00000100:00100000:3.0:1787560794.182419:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787560794.182444:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862883968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560794.182496:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862883968:12345-0@lo:400:kworker.0 Request processed in 69us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560794.182503:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787560794.182528:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862884096 00000100:00100000:3.0:1787560794.182533:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862884096 00000100:00100000:3.0:1787560794.182558:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787560794.182565:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3beb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862884096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560794.182616:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3beb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862884096:12345-0@lo:400:kworker.0 Request processed in 52us (7967us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560794.182622:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787560794.182669:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862884096:0@lo:400:kworker.0 00010000:00080000:3.0:1787560794.182705:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec407d880 x1874392862883968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560794.182716:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862883968:0@lo:400:kworker.0 00000100:00100000:3.0:1787560794.182727:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874392862884608:0@lo:400:kworker.0 00000100:00100000:3.0:1787560794.182754:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560794.182775:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862884608 00000100:00100000:3.0:1787560794.182778:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862884608 00000100:00100000:3.0:1787560794.182811:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787560794.182818:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874392862884608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560794.182877:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874392862884608:12345-0@lo:400:kworker.0 Request processed in 59us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560794.182884:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1787560794.182900:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787560794.182921:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cafffe4d500 x1874392862884608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560794.182931:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874392862884608:0@lo:400:kworker.0 00000100:00100000:1.0:1787560794.183604:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560794.183633:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862884224:0@lo:400:kworker.0 00000100:00100000:1.0:1787560794.183661:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560794.183707:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862883840:0@lo:8:kworker.0 00000100:00100000:1.0:1787560794.183735:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560794.183754:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862884352:0@lo:8:kworker.0 00000100:00100000:1.0:1787560794.183773:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560794.183804:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862883456 00000100:00100000:1.0:1787560794.183809:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862883456 00000100:00100000:1.0:1787560794.183857:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787560794.183874:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:3624:x1874392862883456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560794.183916:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:3624:x1874392862883456:12345-0@lo:400:kworker.0 Request processed in 44us (9389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560794.183922:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787560794.183949:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862884224 00000100:00100000:1.0:1787560794.183952:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862884224 00000100:00100000:1.0:1787560794.183981:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862883840 00000100:00100000:1.0:1787560794.183984:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862883840 00000100:00100000:1.0:1787560794.183992:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862884352 00000100:00100000:1.0:1787560794.183994:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862884352 00000100:00100000:1.0:1787560794.184003:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787560794.184009:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862884224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560794.184042:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862884224:12345-0@lo:400:kworker.0 Request processed in 33us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560794.184048:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787560794.184058:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787560794.184062:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3622:x1874392862883840:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787560794.184081:0:18684:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787560794.186362:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787560794.186376:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3622:x1874392862884352:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787560794.186402:0:18685:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787560794.186507:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3622:x1874392862884352:12345-0@lo:8:kworker.0 Request processed in 131us (2731us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787560794.186514:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787560794.187047:0:18389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862883584 00000100:00100000:3.0:1787560794.187057:0:18389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862883584 00000100:00100000:3.0:1787560794.187189:0:18389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787560794.187199:0:18389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862883584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560794.187258:0:18389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862883584:12345-0@lo:400:kworker.0 Request processed in 61us (3655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560794.187264:0:18389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1787560794.189550:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787560794.189616:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f08f2f56-c18f-4579-88a9-05007f76ffc9:3624:1874392862883456:0@lo:400:kworker.0 00000100:00100000:0.0:1787560794.193105:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560794.193157:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874392862884480:0@lo:400:kworker.0 00000100:00100000:0.0:1787560794.193192:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560794.193225:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862884480 00000100:00100000:0.0:1787560794.193232:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862884480 00000100:00100000:0.0:1787560794.193282:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787560794.193292:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874392862884480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560794.193341:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874392862884480:12345-0@lo:400:kworker.0 Request processed in 50us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560794.193348:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1787560794.193402:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cafffe4dc00 x1874392862884480/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560794.193417:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874392862884480:0@lo:400:kworker.0 00000100:00100000:0.0:1787560794.195906:0:19050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862883712 00000100:00100000:0.0:1787560794.195922:0:19050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862883712 00000100:00100000:0.0:1787560794.195991:0:19050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787560794.196002:0:19050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862883712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560794.196092:0:19050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862883712:12345-0@lo:400:kworker.0 Request processed in 92us (2997us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560794.196099:0:19050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787560794.196148:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862883584:0@lo:400:kworker.0 00000100:00100000:0.0:1787560794.196163:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862884224:0@lo:400:kworker.0 00000100:00100000:0.0:1787560794.196211:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862883712:0@lo:400:kworker.0 00000100:00080000:0.0:1787560794.208521:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafc5251800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787560794.208534:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787560794.208539:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862884352:0@lo:8:kworker.0 00000100:00100000:1.0:1787560794.228749:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3622:x1874392862883840:12345-0@lo:8:kworker.0 Request processed in 44674us (45002us total) trans 0 rc -19/-19 00000100:00080000:2.0:1787560794.228775:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec32fd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787560794.228781:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787560794.228785:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862883840:0@lo:8:kworker.0 00000100:00100000:1.0:1787560794.229685:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1787560794.675546:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787560795.322080:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:0.0:1787560795.671598:0:19497:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787560795.671603:0:19497:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1787560795.671605:0:19497:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1787560795.671925:0:19497:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9caec231a000 00000020:01000004:0.0:1787560795.671941:0:19497:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787560795.671957:0:19497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787560795.671970:0:19497:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9caffb9919b8) 00000020:00000080:0.0:1787560795.671986:0:19497:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00010000:00010000:1.0:1787560795.709074:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1787560795.754898:0:19497:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787560795.757165:0:19497:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787560795.757912:0:19497:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787560795.758216:0:19497:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787560795.758647:0:19497:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787560795.758905:0:19497:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787560795.759211:0:19497:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:2.0:1787560795.762304:0:19497:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787560795.762915:0:19497:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787560795.762942:0:19497:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787560795.762954:0:19497:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4642c20bf2f35164 00000020:01000004:3.0:1787560795.762962:0:19497:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1787560795.762989:0:19497:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.129@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787560795.762993:0:19497:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787560795.763000:0:19497:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787560795.763034:0:19497:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1787560795.763038:0:19497:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.129@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787560795.790984:0:19497:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787560795.791025:0:19497:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.129@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1787560795.791029:0:19497:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787560795.791031:0:19497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787560795.791037:0:19497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787560795.791038:0:19497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787560795.791039:0:19497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787560795.791040:0:19497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787560795.791041:0:19497:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787560795.791043:0:19497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787560795.791044:0:19497:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787560795.791047:0:19497:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1787560795.791049:0:19497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787560795.791051:0:19497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787560795.791052:0:19497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787560795.791053:0:19497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787560795.791053:0:19497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787560795.791055:0:19497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787560795.791056:0:19497:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787560795.791056:0:19497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787560795.791057:0:19497:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787560795.791083:0:19497:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787560795.791103:0:19497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862884864:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787560795.791175:0:19497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560795.791221:0:19497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc599d000 going to sleep for 11 seconds 00000100:00100000:0.0:1787560795.791567:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862884864 00000100:00100000:0.0:1787560795.791575:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862884864 00000100:00100000:0.0:1787560795.791630:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787560795.791640:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:19497:x1874392862884864:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787560795.791671:0:17167:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787560795.791674:0:17167:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787560795.791678:0:17167:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787560795.792730:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:19497:x1874392862884864:12345-0@lo:253:mount.lustre.0 Request processed in 1085us (1549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560795.792741:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787560795.794220:0:19497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862884864:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787560795.794239:0:19497:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787560795.794243:0:19497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787560795.794245:0:19497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787560795.794246:0:19497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787560795.794248:0:19497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787560795.794249:0:19497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787560795.794250:0:19497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787560795.794252:0:19497:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787560795.794254:0:19497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787560795.794256:0:19497:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787560795.794360:0:19497:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9caec231a000 from lustre-OST0001 10000000:01000000:1.0:1787560795.794395:0:19497:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787560795.794399:0:19497:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787560795.794409:0:19497:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9caff4908000 local copy 00010000:00010000:1.0:1787560795.794421:0:19497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb002177000/0x4642c20bf2f34db3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34dba expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560795.794683:0:19497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862884992:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787560795.794737:0:19497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560795.794894:0:19497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd84bbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787560795.794953:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862884992 00000100:00100000:2.0:1787560795.794965:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862884992 00000100:00100000:1.0:1787560795.795122:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787560795.795131:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:19497:x1874392862884992:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787560795.795217:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:19497:x1874392862884992:12345-0@lo:501:mount.lustre.0 Request processed in 87us (479us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787560795.795224:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787560795.795294:0:19497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862884992:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787560795.795309:0:19497:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787560795.795330:0:19497:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787560795.795337:0:19497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb002177000/0x4642c20bf2f34db3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34dba expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560795.795346:0:19497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cb002177000/0x4642c20bf2f34db3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34dba expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560795.795370:0:19497:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9caec231a000 10000000:01000000:2.0:1787560795.795375:0:19497:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787560795.795380:0:19497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787560795.795383:0:19497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787560795.795387:0:19497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787560795.795389:0:19497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787560795.795413:0:19497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f3516b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560795.795420:0:19497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f3516b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560795.795460:0:19497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f3516b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560795.795477:0:19497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862885120:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787560795.795508:0:19497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560795.795958:0:19497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc2c2c840 going to sleep for 11 seconds 00000100:00100000:0.0:1787560795.796030:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862885120 00000100:00100000:0.0:1787560795.796035:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862885120 00000100:00100000:0.0:1787560795.796076:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787560795.796084:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:19497:x1874392862885120:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787560795.796095:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560795.796117:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffcbff200/0x4642c20bf2f35172 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f3516b expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560795.796140:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffcbff200/0x4642c20bf2f35172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f3516b expref: 22 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560795.796150:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffcbff200/0x4642c20bf2f35172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f3516b expref: 22 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560795.796160:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbff200, rc 0) 00000100:00100000:0.0:1787560795.796203:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+22:19497:x1874392862885120:12345-0@lo:101:mount.lustre.0 Request processed in 120us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560795.796209:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787560795.796481:0:19497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862885120:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787560795.796502:0:19497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f3516b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35172 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560795.796512:0:19497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f3516b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35172 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787560795.801383:0:19497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787560795.802315:0:19497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787560795.806903:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787560795.806967:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787560795.806984:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787560795.806998:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787560795.807013:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787560795.807024:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787560795.807049:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787560795.807054:0:19497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787560795.807175:0:19497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862885248:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787560795.807240:0:19497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560795.809962:0:19497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd84bb300 going to sleep for 11 seconds 00000100:00100000:0.0:1787560795.811854:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862885248 00000100:00100000:0.0:1787560795.811867:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862885248 00000100:00100000:0.0:1787560795.812002:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787560795.812014:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+22:19497:x1874392862885248:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787560795.812218:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+22:19497:x1874392862885248:12345-0@lo:501:mount.lustre.0 Request processed in 205us (4976us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560795.812225:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787560795.812301:0:19497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862885248:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560795.812359:0:19497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862885376:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787560795.812412:0:19497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560795.812693:0:19497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc7ed4300 going to sleep for 11 seconds 00000100:00100000:1.0:1787560795.812853:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862885376 00000100:00100000:1.0:1787560795.812858:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862885376 00000100:00100000:1.0:1787560795.812885:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787560795.812892:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+22:19497:x1874392862885376:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787560795.813581:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+22:19497:x1874392862885376:12345-0@lo:503:mount.lustre.0 Request processed in 687us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560795.813588:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787560795.813930:0:19497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862885376:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787560795.814897:0:19497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787560795.814985:0:19497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862885504:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787560795.815050:0:19497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560795.815100:0:19497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc7ed4300 going to sleep for 11 seconds 00000100:00100000:3.0:1787560795.815704:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862885504 00000100:00100000:3.0:1787560795.815712:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862885504 00000100:00100000:3.0:1787560795.815872:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787560795.815882:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+22:19497:x1874392862885504:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787560795.816478:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+22:19497:x1874392862885504:12345-0@lo:502:mount.lustre.0 Request processed in 596us (1426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560795.816488:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787560795.816579:0:19497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862885504:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787560795.817071:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787560795.817102:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787560795.817116:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787560795.817128:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787560795.817141:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787560795.817153:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787560795.817165:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787560795.817176:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787560795.817188:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1787560795.817220:0:19497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862885632:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787560795.817269:0:19497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560795.817609:0:19497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caff5227000 going to sleep for 11 seconds 00000100:00100000:0.0:1787560795.817715:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862885632 00000100:00100000:0.0:1787560795.817722:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862885632 00000100:00100000:0.0:1787560795.817768:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787560795.817778:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4088c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+22:19497:x1874392862885632:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787560795.817904:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4088c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+22:19497:x1874392862885632:12345-0@lo:502:mount.lustre.0 Request processed in 127us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560795.817912:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787560795.818075:0:19497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862885632:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787560795.818125:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1787560795.818135:0:19497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1787560795.819073:0:19501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787560795.819082:0:19501:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1787560795.819088:0:19501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560795.819090:0:19501:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787560795.819095:0:19501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787560795.819110:0:19501:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9caff324b370) 00000020:00000080:3.0:1787560795.819135:0:19501:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787560795.819140:0:19501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787560795.819229:0:19501:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9caec231a000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787560795.819238:0:19501:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787560795.819249:0:19501:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4642c20bf2f35180 00010000:00010000:2.0:1787560795.828699:0:19501:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1787560795.829191:0:19501:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1787560795.831216:0:19501:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1787560795.834120:0:19501:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787560795.834139:0:19501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560795.834146:0:19501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560795.834148:0:19501:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787560795.834152:0:19501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560795.834156:0:19501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560795.834157:0:19501:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787560795.834160:0:19501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787560795.834162:0:19501:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787560795.834164:0:19501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560795.834166:0:19501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560795.834167:0:19501:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787560795.834169:0:19501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560795.834171:0:19501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560795.834172:0:19501:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787560795.834175:0:19501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787560795.834205:0:19501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560795.834208:0:19501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560795.834209:0:19501:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787560795.834212:0:19501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1787560795.834860:0:19497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787560795.834892:0:19497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787560795.834914:0:19497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f3516b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35172 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560795.834927:0:19497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f3516b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35172 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560795.834936:0:19497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9caec231a000 from 1 10000000:01000000:3.0:1787560795.834939:0:19497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787560795.834977:0:19497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f35187 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560795.834985:0:19497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f35187 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560795.834997:0:19497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f35187 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560795.835021:0:19497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862885760:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787560795.835090:0:19497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560795.835133:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862885760 00000100:00100000:3.0:1787560795.835140:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862885760 00000100:00100000:3.0:1787560795.835179:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787560795.835187:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+22:19497:x1874392862885760:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787560795.835200:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560795.835211:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafda2f6000/0x4642c20bf2f3518e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f35187 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560795.835232:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafda2f6000/0x4642c20bf2f3518e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f35187 expref: 23 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560795.835255:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafda2f6000/0x4642c20bf2f3518e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f35187 expref: 23 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560795.835264:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f6000, rc 0) 00000100:00100000:3.0:1787560795.835294:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+23:19497:x1874392862885760:12345-0@lo:101:mount.lustre.0 Request processed in 108us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560795.835302:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787560795.836540:0:19497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caff5227600 going to sleep for 11 seconds 00000100:00100000:3.0:1787560795.836570:0:19497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862885760:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787560795.836589:0:19497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f35187 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3518e expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560795.836601:0:19497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f35187 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f3518e expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787560795.840954:0:19497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787560795.842117:0:19497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787560795.845162:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787560795.845227:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787560795.845252:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787560795.845258:0:19497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787560795.846128:0:19497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862885888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787560795.846199:0:19497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560795.846248:0:19497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caff5227b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787560795.846984:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862885888 00000100:00100000:2.0:1787560795.846993:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862885888 00000100:00100000:2.0:1787560795.847070:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787560795.847080:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4088050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+23:19497:x1874392862885888:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560795.847222:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4088050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+23:19497:x1874392862885888:12345-0@lo:501:mount.lustre.0 Request processed in 143us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560795.847230:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787560795.847344:0:19497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862885888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787560795.847383:0:19497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862886016:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787560795.848622:0:19497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560795.848665:0:19497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caff5227b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787560795.850145:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862886016 00000100:00100000:1.0:1787560795.850159:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862886016 00000100:00100000:1.0:1787560795.850224:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787560795.850234:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+23:19497:x1874392862886016:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787560795.852181:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+23:19497:x1874392862886016:12345-0@lo:503:mount.lustre.0 Request processed in 1939us (4742us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560795.852195:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787560795.854319:0:19497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862886016:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787560795.856991:0:19497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787560795.857158:0:19497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862886144:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787560795.857240:0:19497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560795.857337:0:19497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd1770000 going to sleep for 11 seconds 00000100:00100000:3.0:1787560795.857857:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862886144 00000100:00100000:3.0:1787560795.857865:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862886144 00000100:00100000:3.0:1787560795.857919:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787560795.857929:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+23:19497:x1874392862886144:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787560795.858079:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+23:19497:x1874392862886144:12345-0@lo:502:mount.lustre.0 Request processed in 152us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560795.858088:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787560795.858238:0:19497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862886144:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787560795.858842:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787560795.858874:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787560795.858888:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787560795.858901:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787560795.858913:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787560795.858944:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787560795.858957:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787560795.858968:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1787560795.858990:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787560795.859014:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1787560795.859026:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1787560795.859054:0:19497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862886272:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787560795.859097:0:19497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560795.859132:0:19497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caff3251180 going to sleep for 11 seconds 00000100:00100000:2.0:1787560795.859258:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862886272 00000100:00100000:2.0:1787560795.859264:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862886272 00000100:00100000:2.0:1787560795.859308:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787560795.859317:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+23:19497:x1874392862886272:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787560795.859421:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+23:19497:x1874392862886272:12345-0@lo:502:mount.lustre.0 Request processed in 104us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560795.859428:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787560795.859890:0:19497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862886272:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787560795.859940:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1787560795.859949:0:19497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787560795.860882:0:19505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560795.860892:0:19505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560795.860895:0:19505:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787560795.860902:0:19505:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9caec231a000 00000020:00000080:3.0:1787560795.860904:0:19505:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787560795.860912:0:19505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560795.860915:0:19505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560795.860916:0:19505:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787560795.860919:0:19505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560795.860921:0:19505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560795.860922:0:19505:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787560795.860925:0:19505:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9caec231a000 00000020:00000080:3.0:1787560795.860927:0:19505:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787560795.860992:0:19505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560795.861003:0:19505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560795.861005:0:19505:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787560795.861008:0:19505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560795.861010:0:19505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560795.861011:0:19505:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787560795.861015:0:19505:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9caec231a000 00000020:00000080:3.0:1787560795.861016:0:19505:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787560795.861033:0:19505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560795.861043:0:19505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560795.861044:0:19505:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787560795.861048:0:19505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560795.861050:0:19505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560795.861051:0:19505:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787560795.861055:0:19505:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9caec231a000 00000020:00000080:3.0:1787560795.861057:0:19505:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787560795.861080:0:19505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560795.861083:0:19505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560795.861084:0:19505:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787560795.861086:0:19505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1787560795.862106:0:19497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787560795.862139:0:19497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787560795.862161:0:19497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f35187 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3518e expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560795.862172:0:19497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f35187 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3518e expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560795.862231:0:19497:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787560795.862235:0:19497:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9caec231a000 10000000:01000000:0.0:1787560795.862238:0:19497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9caec231a000 10000000:01000000:0.0:1787560795.862242:0:19497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787560795.862248:0:19497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9caec231a000 from 1 10000000:01000000:0.0:1787560795.862251:0:19497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787560795.862288:0:19497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbffa00/0x4642c20bf2f35195 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560795.862296:0:19497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffcbffa00/0x4642c20bf2f35195 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560795.862308:0:19497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffcbffa00/0x4642c20bf2f35195 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560795.862419:0:19497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862886400:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787560795.862736:0:19497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560795.862884:0:19497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caff32513c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560795.863917:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862886400 00000100:00100000:3.0:1787560795.863929:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862886400 00000100:00100000:3.0:1787560795.863981:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787560795.863991:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+23:19497:x1874392862886400:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787560795.864420:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560795.864747:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafda2f7a00/0x4642c20bf2f3519c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f35195 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560795.865104:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafda2f7a00/0x4642c20bf2f3519c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f35195 expref: 24 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560795.865115:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafda2f7a00/0x4642c20bf2f3519c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f35195 expref: 24 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560795.865125:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f7a00, rc 0) 00000100:00100000:3.0:1787560795.865203:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:19497:x1874392862886400:12345-0@lo:101:mount.lustre.0 Request processed in 1212us (2466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560795.865210:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787560795.865306:0:19497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862886400:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787560795.865325:0:19497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffcbffa00/0x4642c20bf2f35195 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3519c expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560795.865535:0:19497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffcbffa00/0x4642c20bf2f35195 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f3519c expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787560795.869281:0:19497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1787560795.869705:0:19497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787560795.869902:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787560795.869926:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787560795.869941:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787560795.869954:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787560795.869968:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787560795.869982:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787560795.870005:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787560795.870019:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787560795.870031:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787560795.870042:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787560795.870054:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787560795.870086:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787560795.870101:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787560795.870114:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787560795.870126:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787560795.870138:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787560795.870148:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787560795.870172:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787560795.870187:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787560795.870197:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787560795.870209:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787560795.870219:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787560795.870231:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787560795.870243:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787560795.870257:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1787560795.870270:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1787560795.870284:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1787560795.870311:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1787560795.870326:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1787560795.870353:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1787560795.870367:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1787560795.870381:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1787560795.870394:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1787560795.870408:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1787560795.870421:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1787560795.870470:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1787560795.870484:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1787560795.870496:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1787560795.870508:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:0.0:1787560795.870520:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:0.0:1787560795.870531:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:0.0:1787560795.870543:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:0.0:1787560795.870554:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:0.0:1787560795.870579:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:0.0:1787560795.870593:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:0.0:1787560795.870605:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:0.0:1787560795.870623:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:0.0:1787560795.870628:0:19497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:0.0:1787560795.870716:0:19497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862886528:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787560795.870792:0:19497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560795.870854:0:19497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caff3251480 going to sleep for 11 seconds 00000100:00100000:1.0:1787560795.871248:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862886528 00000100:00100000:1.0:1787560795.871257:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862886528 00000100:00100000:1.0:1787560795.871309:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787560795.871319:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:19497:x1874392862886528:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787560795.871468:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:19497:x1874392862886528:12345-0@lo:501:mount.lustre.0 Request processed in 151us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560795.871476:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787560795.871886:0:19497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862886528:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787560795.871920:0:19497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862886656:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787560795.871960:0:19497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560795.871981:0:19497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caff3251480 going to sleep for 11 seconds 00000100:00100000:2.0:1787560795.872074:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862886656 00000100:00100000:2.0:1787560795.872079:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862886656 00000100:00100000:2.0:1787560795.872107:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787560795.872114:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:19497:x1874392862886656:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787560795.872187:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:19497:x1874392862886656:12345-0@lo:503:mount.lustre.0 Request processed in 73us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560795.872193:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787560795.875949:0:19497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862886656:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787560795.882565:0:19497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787560795.883954:0:19497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862886784:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787560795.884044:0:19497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560795.884092:0:19497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caff32513c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560795.884586:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862886784 00000100:00100000:3.0:1787560795.884601:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862886784 00000100:00100000:3.0:1787560795.884662:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787560795.884671:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:19497:x1874392862886784:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787560795.885024:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:19497:x1874392862886784:12345-0@lo:502:mount.lustre.0 Request processed in 351us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560795.885032:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787560795.886593:0:19497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862886784:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787560795.888506:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787560795.888546:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787560795.888558:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787560795.888569:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787560795.888579:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787560795.888590:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787560795.888600:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787560795.888624:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787560795.888637:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787560795.888647:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787560795.888672:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787560795.888683:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787560795.888693:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787560795.888703:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787560795.888714:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787560795.888731:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787560795.888741:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787560795.890930:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787560795.890979:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787560795.891403:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787560795.892402:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787560795.892970:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787560795.893410:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787560795.894590:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787560795.894644:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1787560795.894661:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1787560795.894694:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1787560795.894710:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1787560795.894725:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1787560795.894740:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1787560795.896179:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1787560795.896217:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1787560795.896229:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1787560795.896241:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1787560795.896252:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1787560795.896264:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1787560795.896277:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1787560795.896289:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1787560795.896301:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1787560795.896312:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1787560795.896324:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1787560795.896351:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1787560795.896384:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1787560795.896398:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1787560795.896409:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1787560795.896420:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1787560795.896462:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1787560795.896479:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1787560795.896550:0:19497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862886912:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787560795.902781:0:19497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560795.902871:0:19497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caff32513c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560795.903276:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862886912 00000100:00100000:2.0:1787560795.903287:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862886912 00000100:00100000:2.0:1787560795.903363:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787560795.903374:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:19497:x1874392862886912:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787560795.903583:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:19497:x1874392862886912:12345-0@lo:502:mount.lustre.0 Request processed in 211us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560795.903592:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787560795.903921:0:19497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862886912:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787560795.904294:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1787560795.904323:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1787560795.904371:0:19497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862887040:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787560795.904417:0:19497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560795.904944:0:19497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caff32513c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560795.909819:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862887040 00000100:00100000:2.0:1787560795.909844:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862887040 00000100:00100000:3.0:1787560795.910946:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787560795.910961:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:19497:x1874392862887040:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787560795.911147:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:19497:x1874392862887040:12345-0@lo:502:mount.lustre.0 Request processed in 190us (6729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560795.911155:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787560795.912745:0:19497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862887040:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787560795.912881:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1787560795.912897:0:19497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1787560795.919648:0:19510:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787560795.919666:0:19510:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9caff324cd28) 00000020:00000080:3.0:1787560795.919693:0:19510:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1787560795.919844:0:19510:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9caec231a000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787560795.919849:0:19510:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9caec231a000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787560795.919851:0:19510:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9caec231a000 3 00010000:00080000:3.0:1787560795.919896:0:19510:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9caec4299000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.129@tcp at head 00010000:00010000:3.0:1787560795.922992:0:19510:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1787560795.923196:0:19510:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787560795.923241:0:19510:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787560795.923256:0:19510:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x4642c20bf2f351aa 00000100:00080000:3.0:1787560795.923266:0:19510:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787560795.923271:0:19510:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9caec4299000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787560795.923307:0:19510:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caec3baea00 x1874392862887168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787560795.923345:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1874392862887168:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787560795.923420:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560795.923690:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862887168 00000100:00100000:3.0:1787560795.923697:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862887168 00000100:00100000:3.0:1787560795.923775:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787560795.923782:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3baf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1874392862887168:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787560795.923804:0:17174:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 515 last 0 00000020:00000080:3.0:1787560795.923847:0:17174:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4642c20bf2f351b1 00000004:00100000:3.0:1787560795.923860:0:17174:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787560795.923891:0:17174:0:(import.c:65:import_set_state_nolock()) ffff9caec429c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787560795.923936:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3baf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1874392862887168:12345-0@lo:38:llog_process_th.0 Request processed in 153us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560795.923942:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787560795.931572:0:19510:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787560795.931659:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560795.931664:0:15403:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787560795.931667:0:15403:0:(import.c:65:import_set_state_nolock()) ffff9caec32fd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787560795.931675:0:15403:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 513 00000100:00080000:2.0:1787560795.931680:0:15403:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787560795.931687:0:15403:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9caec32fd800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560795.931708:0:15403:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caec3be9f80 x1874392862887552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787560795.931743:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560795.931746:0:15403:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787560795.931758:0:15403:0:(import.c:65:import_set_state_nolock()) ffff9cafc5251800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787560795.931762:0:15403:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 513 00000100:00080000:2.0:1787560795.931765:0:15403:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787560795.931768:0:15403:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9cafc5251800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560795.931780:0:15403:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caec3bebb80 x1874392862888064/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787560795.931834:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862887808:0@lo:400:kworker.0 00000100:00100000:2.0:1787560795.931896:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560795.931928:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc52c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862888448:0@lo:400:kworker.0 00000100:00100000:2.0:1787560795.931968:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560795.936500:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787560795.936519:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862887680:0@lo:400:kworker.0 00000100:00100000:2.0:1787560795.936582:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560795.936843:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862888448 00000100:00100000:0.0:1787560795.936852:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862888448 00000100:00100000:0.0:1787560795.936872:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862887296:0@lo:400:kworker.0 00000100:00100000:0.0:1787560795.936909:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560795.936932:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3beb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862887936:0@lo:400:kworker.0 00000100:00100000:0.0:1787560795.936956:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560795.936976:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787560795.936982:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862887424:0@lo:400:kworker.0 00000100:00100000:0.0:1787560795.937005:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560795.937023:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862888192:0@lo:400:kworker.0 00000100:00100000:0.0:1787560795.937069:0:18389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862887808 00000100:00100000:0.0:1787560795.937074:0:18389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862887808 00000100:00100000:0.0:1787560795.937117:0:18389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862887296 00000100:00100000:0.0:1787560795.937120:0:18389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862887296 00000100:00100000:0.0:1787560795.937136:0:18389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787560795.937144:0:18389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862887808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560795.937199:0:18389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862887808:12345-0@lo:400:kworker.0 Request processed in 54us (5302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560795.937219:0:18389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787560795.937237:0:18389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787560795.937243:0:18389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862887296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560795.937278:0:18389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862887296:12345-0@lo:400:kworker.0 Request processed in 35us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560795.937284:0:18389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787560795.937302:0:19050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862887936 00000100:00100000:0.0:1787560795.937305:0:19050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862887936 00000100:00100000:0.0:1787560795.937330:0:19050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862887424 00000100:00100000:0.0:1787560795.937333:0:19050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862887424 00000100:00100000:0.0:1787560795.937358:0:19050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787560795.937365:0:19050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862887936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560795.937394:0:19050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862887936:12345-0@lo:400:kworker.0 Request processed in 30us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560795.937400:0:19050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787560795.937411:0:19050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787560795.937417:0:19050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2006680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862887424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560795.937547:0:19050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2006680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862887424:12345-0@lo:400:kworker.0 Request processed in 130us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560795.937553:0:19050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1787560795.937580:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560795.937621:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787560795.937628:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862888448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560795.937657:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862888448:12345-0@lo:400:kworker.0 Request processed in 30us (5688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560795.937663:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787560795.937787:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862887552:0@lo:8:kworker.0 00000100:00100000:3.0:1787560795.937820:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560795.937856:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862888064:0@lo:8:kworker.0 00000100:00100000:3.0:1787560795.937881:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787560795.937907:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec3baea00 x1874392862887168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787560805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560795.937918:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787560795.937928:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1787560795.937936:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787560795.937940:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787560795.937943:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec4299000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787560795.937949:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1874392862887168:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787560795.938975:0:19050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862887552 00000100:00100000:0.0:1787560795.938984:0:19050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862887552 00000100:00100000:0.0:1787560795.939008:0:19050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862888064 00000100:00100000:0.0:1787560795.939011:0:19050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862888064 00000100:00100000:0.0:1787560795.939026:0:19050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787560795.939033:0:19050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3baed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3622:x1874392862887552:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787560795.939100:0:19050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3baed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3622:x1874392862887552:12345-0@lo:8:kworker.0 Request processed in 67us (1278us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787560795.939107:0:19050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787560795.939119:0:19050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787560795.939123:0:19050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3badc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3622:x1874392862888064:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787560795.939153:0:19050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3badc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3622:x1874392862888064:12345-0@lo:8:kworker.0 Request processed in 28us (1271us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787560795.939159:0:19050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787560795.940584:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787560795.940602:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec32fd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787560795.940608:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787560795.940612:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862887552:0@lo:8:kworker.0 00000100:00100000:3.0:1787560795.940627:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787560795.940630:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafc5251800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787560795.940633:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787560795.940635:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862888064:0@lo:8:kworker.0 00000020:01000004:3.0:1787560795.941157:0:19510:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787560795.941171:0:19510:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9caff32499b8) 00000020:00000080:3.0:1787560795.941193:0:19510:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1787560795.941280:0:19510:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9caec231a000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787560795.941284:0:19510:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9caec231a000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787560795.941287:0:19510:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9caec231a000 3 00010000:00080000:3.0:1787560795.941315:0:19510:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9caffcbc5000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.129@tcp at head 00000100:00100000:2.0:1787560795.941912:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862888320:0@lo:400:kworker.0 00000100:00100000:2.0:1787560795.941964:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560795.942002:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862887808:0@lo:400:kworker.0 00010000:00080000:2.0:1787560795.942019:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cafc52c1f80 x1874392862888448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560795.942028:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc52c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862888448:0@lo:400:kworker.0 00000100:00100000:0.0:1787560795.942547:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862887680 00000100:00100000:0.0:1787560795.942555:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862887680 00000100:00100000:0.0:1787560795.942603:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862888320 00000100:00100000:0.0:1787560795.942606:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862888320 00000100:00100000:0.0:1787560795.942623:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787560795.942632:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862887680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560795.942695:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862887680:12345-0@lo:400:kworker.0 Request processed in 63us (6112us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560795.942701:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787560795.942716:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787560795.942722:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862888320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560795.943514:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862888320:12345-0@lo:400:kworker.0 Request processed in 27us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560795.943525:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787560795.943556:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560795.943603:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862887296:0@lo:400:kworker.0 00000100:00100000:0.0:1787560795.943617:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3beb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862887936:0@lo:400:kworker.0 00000100:00100000:0.0:1787560795.943640:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862887424:0@lo:400:kworker.0 00010000:00080000:0.0:1787560795.943665:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec3be8380 x1874392862887680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560795.943675:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862887680:0@lo:400:kworker.0 00010000:00080000:0.0:1787560795.943687:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec3be9500 x1874392862888320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560795.943695:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862888320:0@lo:400:kworker.0 00000100:00100000:0.0:1787560795.943714:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862888192 00000100:00100000:0.0:1787560795.943718:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862888192 00000100:00100000:0.0:1787560795.943745:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787560795.944531:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862888192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560795.944604:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862888192:12345-0@lo:400:kworker.0 Request processed in 853us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560795.944611:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1787560795.944863:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec3bea680 x1874392862888192/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560795.944875:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862888192:0@lo:400:kworker.0 00010000:00010000:3.0:1787560795.946963:0:19510:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1787560795.948092:0:19510:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1787560795.948140:0:19510:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787560795.948152:0:19510:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x4642c20bf2f351bf 00000100:00080000:3.0:1787560795.948164:0:19510:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787560795.948169:0:19510:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9caffcbc5000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787560795.948203:0:19510:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caec3baea00 x1874392862888576/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787560795.948238:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3622:1874392862888576:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787560795.948297:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787560795.948354:0:19510:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1787560795.949583:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862888576 00000100:00100000:1.0:1787560795.949595:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862888576 00000100:00100000:1.0:1787560795.949632:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787560795.949651:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1874392862888576:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787560795.949678:0:17175:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 515 last 0 00000020:00000080:1.0:1787560795.949720:0:17175:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x4642c20bf2f351c6 00000004:00100000:1.0:1787560795.949734:0:17175:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787560795.950220:0:17175:0:(import.c:65:import_set_state_nolock()) ffff9cafc58b8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787560795.950289:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1874392862888576:12345-0@lo:38:llog_process_th.0 Request processed in 648us (1991us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560795.950306:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787560795.950461:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec3baea00 x1874392862888576/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787560805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560795.950479:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787560795.950487:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1787560795.950494:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787560795.950498:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787560795.950501:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffcbc5000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787560795.950506:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3622:1874392862888576:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1787560795.950619:0:19510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1787560795.952570:0:19497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787560795.952630:0:19497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787560795.952650:0:19497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbffa00/0x4642c20bf2f35195 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3519c expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560795.952661:0:19497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffcbffa00/0x4642c20bf2f35195 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3519c expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787560795.952707:0:19497:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787560795.952709:0:19497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787560795.952711:0:19497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787560795.952712:0:19497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787560795.952713:0:19497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787560795.952715:0:19497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787560795.952716:0:19497:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787560795.952718:0:19497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787560795.952720:0:19497:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787560795.952724:0:19497:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1787560795.952726:0:19497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787560795.952728:0:19497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787560795.952729:0:19497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787560795.952730:0:19497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787560795.952731:0:19497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787560795.952732:0:19497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787560795.952738:0:19497:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787560795.952739:0:19497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787560795.952739:0:19497:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787560795.952908:0:19497:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787560795.952927:0:19497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3baea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862888704:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787560795.953005:0:19497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560795.953043:0:19497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc599d000 going to sleep for 11 seconds 00000100:00100000:2.0:1787560795.953555:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862888704 00000100:00100000:2.0:1787560795.953564:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862888704 00000100:00100000:2.0:1787560795.953673:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787560795.953683:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:19497:x1874392862888704:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787560795.953708:0:17166:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787560795.953721:0:17166:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787560795.956602:0:17166:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787560795.956617:0:17166:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787560795.956668:0:17189:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787560795.956673:0:17189:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787560795.956694:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f351cd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560795.956712:0:17189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caec3880e00/0x4642c20bf2f35076 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f3506f expref: 24 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560795.956720:0:17189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cafda2f6c00/0x4642c20bf2f35084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f3507d expref: 24 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560795.956741:0:17189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f351cd lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560795.957103:0:17189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cafda2f6c00/0x4642c20bf2f35084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f3507d expref: 24 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560795.957117:0:17189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cafda2f6c00/0x4642c20bf2f35084 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f3507d expref: 24 pid: 17168 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560795.957131:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc52c1f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17189:1874392862888832:0@lo:104: 00000100:00100000:2.0:1787560795.957194:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787560795.957240:0:17189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caec3880e00/0x4642c20bf2f35076 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f3506f expref: 24 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560795.957249:0:17189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9caec3880e00/0x4642c20bf2f35076 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f3506f expref: 24 pid: 17167 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560795.957257:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc52c0380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17189:1874392862888960:0@lo:104: 00000100:00100000:2.0:1787560795.957277:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560795.957293:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec3a6dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560795.957536:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862888832 00000100:00100000:2.0:1787560795.957544:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862888832 00000100:00100000:2.0:1787560795.957580:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862888960 00000100:00100000:2.0:1787560795.957583:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862888960 00000100:00100000:2.0:1787560795.957597:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787560795.957605:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+4:17189:x1874392862888832:12345-0@lo:104: 00010000:00010000:2.0:1787560795.957617:0:17157:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff800/0x4642c20bf2f3507d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f35084 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560795.957680:0:17157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787560795.957687:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+4:17189:x1874392862888832:12345-0@lo:104: Request processed in 83us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560795.957695:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787560795.957712:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787560795.957718:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+3:17189:x1874392862888960:12345-0@lo:104: 00010000:00010000:2.0:1787560795.957726:0:17157:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f3506f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f35076 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560795.958577:0:17157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787560795.958589:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+3:17189:x1874392862888960:12345-0@lo:104: Request processed in 869us (1309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560795.958597:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787560795.958687:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:19497:x1874392862888704:12345-0@lo:253:mount.lustre.0 Request processed in 5006us (5691us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560795.958697:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787560795.958747:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc52c1f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17189:1874392862888832:0@lo:104: 00000100:00100000:2.0:1787560795.959561:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc52c0380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17189:1874392862888960:0@lo:104: 00010000:00010000:2.0:1787560795.959584:0:17189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f351cd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560795.959608:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787560795.959614:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff800/0x4642c20bf2f3507d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f35084 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560795.959622:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ff800 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:2.0:1787560795.959639:0:17928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff800/0x4642c20bf2f3507d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f35084 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560795.959649:0:17928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff800/0x4642c20bf2f3507d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f35084 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560795.959657:0:17928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff800/0x4642c20bf2f3507d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f35084 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560795.959662:0:17928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787560795.959706:0:17928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff800/0x4642c20bf2f3507d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f35084 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560795.959712:0:17928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787560795.959742:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff800/0x4642c20bf2f3507d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f35084 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560795.959888:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff800/0x4642c20bf2f3507d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f35084 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560795.959903:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560795.959906:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f3506f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f35076 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560795.959911:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ffe00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:2.0:1787560795.959914:0:17928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f3506f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f35076 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560795.959920:0:17928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f3506f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f35076 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560795.959937:0:17928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f3506f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f35076 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560795.959943:0:17928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787560795.959958:0:17928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f3506f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f35076 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560795.959962:0:17928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787560795.959969:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f3506f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f35076 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560795.959975:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f3506f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f35076 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560795.959987:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560795.959989:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560795.959991:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560795.959997:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560795.960024:0:19497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3baea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f08f2f56-c18f-4579-88a9-05007f76ffc9:19497:1874392862888704:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787560795.960036:0:19497:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787560795.960039:0:19497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787560795.960041:0:19497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787560795.960042:0:19497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560795.960043:0:19497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560795.960045:0:19497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560795.960046:0:19497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560795.960048:0:19497:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787560795.960050:0:19497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560795.960051:0:19497:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787560795.960062:0:19497:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787560795.960797:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc52c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f08f2f56-c18f-4579-88a9-05007f76ffc9:3626:1874392862889216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787560795.960874:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560795.960916:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787560795.960922:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc52c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f08f2f56-c18f-4579-88a9-05007f76ffc9:3626:1874392862889088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787560795.960938:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560795.961268:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862889216 00000100:00100000:0.0:1787560795.961275:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862889216 00010000:00010000:0.0:1787560795.961385:0:17160:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caec3880e00/0x4642c20bf2f35076 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f3506f expref: 24 pid: 17167 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560795.961477:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862889088 00000100:00100000:0.0:1787560795.961481:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862889088 00010000:00010000:0.0:1787560795.961495:0:17160:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cafda2f6c00/0x4642c20bf2f35084 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f3507d expref: 25 pid: 17168 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560795.961540:0:17929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787560795.961550:0:17929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f08f2f56-c18f-4579-88a9-05007f76ffc9+25:3626:x1874392862889216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560795.961572:0:17929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560795.961579:0:17929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caec3880e00/0x4642c20bf2f35076 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f3506f expref: 25 pid: 17167 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560795.961589:0:17929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caec3880e00/0x4642c20bf2f35076 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f3506f expref: 25 pid: 17167 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560795.961606:0:17929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caec3880e00/0x4642c20bf2f35076 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f3506f expref: 25 pid: 17167 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560795.961629:0:17929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560795.961673:0:17929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:3626:x1874392862889216:12345-0@lo:103:ldlm_bl.0 Request processed in 125us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560795.961681:0:17929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787560795.961697:0:17929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787560795.961702:0:17929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f08f2f56-c18f-4579-88a9-05007f76ffc9+23:3626:x1874392862889088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560795.961709:0:17929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560795.961714:0:17929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cafda2f6c00/0x4642c20bf2f35084 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f3507d expref: 23 pid: 17168 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560795.961723:0:17929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cafda2f6c00/0x4642c20bf2f35084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f3507d expref: 23 pid: 17168 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560795.961733:0:17929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafda2f6c00/0x4642c20bf2f35084 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f3507d expref: 23 pid: 17168 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560795.961754:0:17929:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f351cd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560795.961763:0:17929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f351cd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787560795.961778:0:17929:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011267045s 00010000:00010000:1.0:1787560795.961783:0:17929:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f351cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560795.961789:0:17929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f351cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560795.961796:0:17929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f351cd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560795.961804:0:17929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f351cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560795.961810:0:17929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49e00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560795.961815:0:17929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f351cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560795.961833:0:17929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f351cd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560795.961855:0:17929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f351cd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560795.961865:0:17929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560795.961893:0:17929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f08f2f56-c18f-4579-88a9-05007f76ffc9+22:3626:x1874392862889088:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560795.961900:0:17929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787560795.962861:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc52c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f08f2f56-c18f-4579-88a9-05007f76ffc9:3626:1874392862889088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787560795.962871:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc52c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f08f2f56-c18f-4579-88a9-05007f76ffc9:3626:1874392862889216:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787560795.965539:0:17189:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f351cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560795.965555:0:17189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f351cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560795.965563:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f351cd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1787560795.972421:0:19497:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787560795.975938:0:19497:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787560795.975950:0:19497:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787560795.975989:0:19497:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787560795.976107:0:19497:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.129@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787560795.976127:0:19497:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1787560795.976145:0:19497:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1787560795.977125:0:19497:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787560795.977536:0:19497:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787560796.221169:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc52c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862889344:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787560796.221239:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560796.221340:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862889344 00000100:00100000:2.0:1787560796.221349:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862889344 00000100:00100000:2.0:1787560796.221411:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787560796.221422:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3badf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862889344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787560796.221555:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787560796.221602:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3badf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862889344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 182us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560796.221610:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787560796.221672:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787560796.221715:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc52c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862889344:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787560796.723834:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560796.724490:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862889472:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787560796.724560:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560796.724716:0:18389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862889472 00000100:00100000:3.0:1787560796.724725:0:18389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862889472 00000100:00100000:3.0:1787560796.724777:0:18389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787560796.724786:0:18389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862889472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787560796.724825:0:18389:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787560796.724872:0:18389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862889472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560796.724879:0:18389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787560796.725065:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862889472:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787560796.725998:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787560796.726015:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862889600:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787560796.726063:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560796.727506:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862889600 00000100:00100000:3.0:1787560796.727546:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862889600 00000100:00100000:3.0:1787560796.727632:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787560796.727645:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862889600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787560796.727693:0:17178:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787560796.728237:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862889600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 592us (2170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560796.728247:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787560796.730399:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862889600:0@lo:41:osp-pre-1-0.0 10000000:01000000:0.0:1787560796.983272:0:17170:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787560796.983283:0:17170:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cafc6f14000 from 10 10000000:01000000:0.0:1787560796.983290:0:17170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787560796.983349:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbfea00/0x4642c20bf2f351d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560796.983363:0:17170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffcbfea00/0x4642c20bf2f351d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560796.983377:0:17170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffcbfea00/0x4642c20bf2f351d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560796.983422:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3af0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862889728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787560796.983543:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560796.983592:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caff3251840 going to sleep for 11 seconds 00000100:00100000:2.0:1787560796.985347:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862889728 00000100:00100000:2.0:1787560796.985364:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862889728 00000100:00100000:2.0:1787560796.985469:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787560796.985482:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+22:17170:x1874392862889728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560796.985513:0:17168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560796.985538:0:17168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca48a00/0x4642c20bf2f351db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f351d4 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560796.985570:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca48a00/0x4642c20bf2f351db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f351d4 expref: 23 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560796.985582:0:17168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca48a00/0x4642c20bf2f351db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f351d4 expref: 23 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560796.985606:0:17168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca48a00, rc 0) 00000100:00100000:2.0:1787560796.985695:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+23:17170:x1874392862889728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 215us (2151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560796.985703:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787560796.987172:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3af0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862889728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787560796.987203:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffcbfea00/0x4642c20bf2f351d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f351db expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560796.987216:0:17170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffcbfea00/0x4642c20bf2f351d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f351db expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560796.987308:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3af0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862889856:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787560796.987372:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560796.987427:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caff3251840 going to sleep for 11 seconds 00000100:00100000:2.0:1787560796.987797:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862889856 00000100:00100000:2.0:1787560796.987805:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862889856 00000100:00100000:2.0:1787560796.987860:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787560796.987870:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+23:17170:x1874392862889856:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787560796.987893:0:17166:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787560796.987913:0:17166:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787560796.987916:0:17166:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1787560796.988028:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+23:17170:x1874392862889856:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 158us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560796.988036:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787560796.988051:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3af0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862889856:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787560796.988297:0:17170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787560796.988307:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbfea00/0x4642c20bf2f351d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f351db expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560796.988317:0:17170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffcbfea00/0x4642c20bf2f351d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f351db expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560796.988328:0:17170:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787560796.988331:0:17170:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9caffff56000 from 10 10000000:01000000:1.0:1787560796.988334:0:17170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787560796.988363:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f351e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560796.988371:0:17170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f351e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560796.988381:0:17170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f351e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560796.988396:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862889984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787560796.988462:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560796.988490:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe0bae780 going to sleep for 11 seconds 00000100:00100000:1.0:1787560796.988504:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862889984 00000100:00100000:1.0:1787560796.988508:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862889984 00000100:00100000:1.0:1787560796.989262:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787560796.989276:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+23:17170:x1874392862889984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787560796.989290:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560796.989308:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cb0021ff800/0x4642c20bf2f351e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f351e2 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560796.989336:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cb0021ff800/0x4642c20bf2f351e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f351e2 expref: 24 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560796.989348:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cb0021ff800/0x4642c20bf2f351e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f351e2 expref: 24 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560796.989357:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb0021ff800, rc 0) 00000100:00100000:1.0:1787560796.989405:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:17170:x1874392862889984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560796.989412:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787560796.989485:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862889984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787560796.989500:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f351e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f351e9 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560796.989510:0:17170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f351e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f351e9 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560796.990024:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862890112:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787560796.990673:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560796.990721:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe0bae780 going to sleep for 11 seconds 00000100:00100000:2.0:1787560796.990844:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862890112 00000100:00100000:2.0:1787560796.990853:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862890112 00000100:00100000:2.0:1787560796.990908:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787560796.990919:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:17170:x1874392862890112:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787560796.990952:0:17167:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787560796.990975:0:17167:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787560796.990979:0:17167:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1787560796.991091:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:17170:x1874392862890112:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 173us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560796.991098:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787560796.991254:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862890112:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787560796.991350:0:17170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787560796.991361:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f351e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f351e9 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560796.991373:0:17170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f351e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f351e9 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:3.0:1787560797.141218:0:19563:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787560797.141618:0:19563:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787560797.747767:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560798.259758:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787560798.259797:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862890240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560798.259878:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560798.260852:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862890240 00000100:00100000:3.0:1787560798.260864:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862890240 00000100:00100000:3.0:1787560798.260941:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787560798.260952:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862890240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787560798.260983:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00080000:0.0:1787560798.261256:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787560798.262915:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862890240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1956us (3028us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560798.262930:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787560798.265028:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862890240:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787560798.771527:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560799.795915:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560800.821144:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787560801.332857:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560801.332866:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787560801.332871:0:8:0:(import.c:65:import_set_state_nolock()) ffff9caec32fd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787560801.332889:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9caec32fd800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787560801.332922:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caec3bea680 x1874392862890752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787560801.332964:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560801.332968:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787560801.332970:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cafc5251800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787560801.332976:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9cafc5251800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787560801.333007:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caec3beb480 x1874392862891264/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787560801.333074:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f08f2f56-c18f-4579-88a9-05007f76ffc9:3623:1874392862890368:0@lo:400:kworker.0 00000100:00100000:3.0:1787560801.333169:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560801.333230:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862891008:0@lo:400:kworker.0 00000100:00100000:3.0:1787560801.333262:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560801.333284:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862891648:0@lo:400:kworker.0 00000100:00100000:3.0:1787560801.333778:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560801.334135:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787560801.334148:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862890496:0@lo:400:kworker.0 00000100:00100000:3.0:1787560801.334181:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560801.334210:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862891136:0@lo:400:kworker.0 00000100:00100000:3.0:1787560801.334236:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560801.334259:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874392862891776:0@lo:400:kworker.0 00000100:00100000:3.0:1787560801.334282:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560801.334390:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862891008 00000100:00100000:2.0:1787560801.334402:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862891008 00000100:00100000:2.0:1787560801.334470:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862890496 00000100:00100000:2.0:1787560801.334474:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862890496 00000100:00100000:2.0:1787560801.334492:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787560801.334503:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862891008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560801.334567:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862891008:12345-0@lo:400:kworker.0 Request processed in 65us (1303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560801.334575:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787560801.334594:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787560801.334600:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862890496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560801.334640:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862890496:12345-0@lo:400:kworker.0 Request processed in 40us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560801.334647:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787560801.334799:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862891008:0@lo:400:kworker.0 00000100:00100000:3.0:1787560801.334955:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862890496:0@lo:400:kworker.0 00000100:00100000:3.0:1787560801.334985:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862890624:0@lo:400:kworker.0 00000100:00100000:3.0:1787560801.335013:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560801.335042:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862891392:0@lo:400:kworker.0 00000100:00100000:3.0:1787560801.335066:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560801.335086:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874392862891904:0@lo:400:kworker.0 00000100:00100000:3.0:1787560801.335108:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560801.335147:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787560801.335154:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862890880:0@lo:400:kworker.0 00000100:00100000:3.0:1787560801.335178:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560801.335545:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862891136 00000100:00100000:2.0:1787560801.335552:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862891136 00000100:00100000:2.0:1787560801.335602:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862890624 00000100:00100000:2.0:1787560801.335605:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862890624 00000100:00100000:2.0:1787560801.335646:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787560801.335655:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862891136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560801.335707:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862891136:12345-0@lo:400:kworker.0 Request processed in 52us (1469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560801.335714:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787560801.335727:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787560801.335741:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862890624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560801.335773:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862890624:12345-0@lo:400:kworker.0 Request processed in 32us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560801.335779:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1787560801.335807:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787560801.336080:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862891520:0@lo:400:kworker.0 00000100:00100000:3.0:1787560801.336116:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560801.336133:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc52c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862892032:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787560801.336159:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560801.336189:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862890624:0@lo:400:kworker.0 00000100:00100000:3.0:1787560801.336224:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862890752:0@lo:8:kworker.0 00000100:00100000:3.0:1787560801.336251:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560801.336269:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3beb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862891264:0@lo:8:kworker.0 00000100:00100000:3.0:1787560801.336512:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560801.336559:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862890368 00000100:00100000:3.0:1787560801.336565:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862890368 00000100:00100000:3.0:1787560801.336607:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787560801.336691:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:3623:x1874392862890368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560801.336734:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:3623:x1874392862890368:12345-0@lo:400:kworker.0 Request processed in 119us (3565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560801.336741:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787560801.337151:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862891648 00000100:00100000:3.0:1787560801.337156:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862891648 00000100:00100000:3.0:1787560801.337196:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862891776 00000100:00100000:3.0:1787560801.337199:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862891776 00000100:00100000:3.0:1787560801.337214:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862891392 00000100:00100000:3.0:1787560801.337216:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862891392 00000100:00100000:3.0:1787560801.337227:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862891904 00000100:00100000:3.0:1787560801.337230:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862891904 00000100:00100000:3.0:1787560801.337260:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862890880 00000100:00100000:3.0:1787560801.337263:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862890880 00000100:00100000:3.0:1787560801.337275:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862891520 00000100:00100000:3.0:1787560801.337278:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862891520 00000100:00100000:3.0:1787560801.339634:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787560801.339662:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862891648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560801.339802:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862891648:12345-0@lo:400:kworker.0 Request processed in 155us (6023us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560801.339812:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787560801.340006:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862890752 00000100:00100000:2.0:1787560801.340018:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862890752 00000100:00100000:2.0:1787560801.340053:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862891264 00000100:00100000:2.0:1787560801.340058:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862891264 00000100:00100000:2.0:1787560801.340071:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787560801.340077:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3622:x1874392862890752:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787560801.340149:0:18685:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 520 last 0 00000020:00000080:2.0:1787560801.340189:0:18685:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4642c20bf2f351f0 00002000:00100000:2.0:1787560801.340208:0:18685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9caec2d3c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787560801.340213:0:18685:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787560801.340216:0:18685:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787560801.340490:0:18685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787560801.340524:0:18685:0:(import.c:65:import_set_state_nolock()) ffff9caec2d3e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787560801.340593:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3622:x1874392862890752:12345-0@lo:8:kworker.0 Request processed in 515us (4341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560801.340601:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787560801.340619:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787560801.340625:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3622:x1874392862891264:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787560801.340642:0:18685:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 520 last 0 00000020:00000080:2.0:1787560801.340660:0:18685:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4642c20bf2f351f7 00002000:00100000:2.0:1787560801.340667:0:18685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9caec2d3a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1787560801.340680:0:18685:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1787560801.340682:0:18685:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787560801.340707:0:18685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1787560801.340721:0:18685:0:(import.c:65:import_set_state_nolock()) ffff9caec2d39000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787560801.340753:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3622:x1874392862891264:12345-0@lo:8:kworker.0 Request processed in 127us (4240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560801.340760:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787560801.340970:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862891136:0@lo:400:kworker.0 00000100:00100000:2.0:1787560801.340986:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f08f2f56-c18f-4579-88a9-05007f76ffc9:3623:1874392862890368:0@lo:400:kworker.0 00010000:00080000:2.0:1787560801.341003:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3bebb80 x1874392862891648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560801.341014:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862891648:0@lo:400:kworker.0 00000100:00100000:2.0:1787560801.341059:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787560801.341069:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874392862891776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560801.341114:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874392862891776:12345-0@lo:400:kworker.0 Request processed in 47us (6831us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560801.341121:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787560801.341140:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787560801.341147:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862891392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560801.341183:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862891392:12345-0@lo:400:kworker.0 Request processed in 36us (6116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560801.341189:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787560801.341201:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787560801.341208:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874392862891904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560801.341246:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874392862891904:12345-0@lo:400:kworker.0 Request processed in 39us (6136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560801.341252:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787560801.341263:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787560801.341270:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862890880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560801.341296:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862890880:12345-0@lo:400:kworker.0 Request processed in 27us (6118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560801.341302:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787560801.341312:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787560801.341320:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862891520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560801.341349:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862891520:12345-0@lo:400:kworker.0 Request processed in 31us (5233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560801.341355:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1787560801.341402:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3be9f80 x1874392862891776/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560801.341414:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874392862891776:0@lo:400:kworker.0 00000100:00100000:3.0:1787560801.343033:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862892032 00000100:00100000:3.0:1787560801.343053:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862892032 00000100:00100000:3.0:1787560801.343105:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787560801.343115:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862892032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787560801.343155:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787560801.343247:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862892032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 133us (7085us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560801.343256:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1787560801.345414:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787560801.345452:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787560801.345561:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3bea680 x1874392862890752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787560826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787560801.345589:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787560801.345600:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787560801.345608:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787560801.345942:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec32fd800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787560801.345971:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787560801.345981:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862890752:0@lo:8:kworker.0 00010000:00080000:3.0:1787560801.346008:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3beb480 x1874392862891264/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787560826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787560801.346050:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787560801.346056:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787560801.346060:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787560801.346062:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafc5251800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787560801.346080:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787560801.346084:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3beb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862891264:0@lo:8:kworker.0 00010000:00080000:3.0:1787560801.346148:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3be9500 x1874392862890880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560801.346158:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862890880:0@lo:400:kworker.0 00010000:00080000:3.0:1787560801.346171:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3be9180 x1874392862891520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560801.346179:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862891520:0@lo:400:kworker.0 00000100:00100000:3.0:1787560801.346200:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc52c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862892032:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1787560801.346214:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3be8e00 x1874392862891392/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560801.346221:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862891392:0@lo:400:kworker.0 00010000:00080000:3.0:1787560801.346233:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec407ce00 x1874392862891904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560801.346241:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874392862891904:0@lo:400:kworker.0 00000004:00080000:3.0:1787560801.347476:0:17918:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1787560801.347516:0:17918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17918:1874392862892288:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1787560801.347618:0:17918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787560801.347758:0:17199:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787560801.347927:0:17199:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 520687494673ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787560801.347935:0:17199:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1787560801.347969:0:17917:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787560801.348019:0:17917:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 520687586928ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787560801.348023:0:17917:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787560801.348225:0:17918:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caff3251a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787560801.348246:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787560801.348261:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862892160:0@lo:13:osp-pre-1-1.0 00000004:00080000:2.0:1787560801.348473:0:17200:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1787560801.348494:0:17200:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc52c0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17200:1874392862892544:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787560801.348559:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862892288 00000100:00100000:0.0:1787560801.348569:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862892288 00000100:00100000:0.0:1787560801.348659:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787560801.348673:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17918:x1874392862892288:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1787560801.350079:0:17907:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00080000:0.0:1787560801.357812:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787560801.358277:0:17200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560801.358339:0:17200:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd86bc540 going to sleep for 11 seconds 00000100:00100000:0.0:1787560801.358515:0:19050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862892544 00000100:00100000:0.0:1787560801.358527:0:19050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862892544 00000100:00100000:0.0:1787560801.358603:0:19050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787560801.358618:0:19050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17200:x1874392862892544:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:2.0:1787560801.358813:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787560801.368852:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787560801.368898:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc52c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862892416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787560801.369005:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560801.370543:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862892416 00000100:00100000:2.0:1787560801.370561:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862892416 00000100:00100000:2.0:1787560801.370649:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787560801.370661:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3623:x1874392862892416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787560801.370706:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787560801.370819:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3623:x1874392862892416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 159us (1812us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560801.370839:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787560801.370901:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cafc52c2680 x1874392862892416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560817 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560801.370928:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc52c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862892416:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1787560801.371162:0:17153:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1787560801.371949:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560801.372003:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862892160 00000100:00100000:3.0:1787560801.372012:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862892160 00000100:00100000:3.0:1787560801.372060:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787560801.372070:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3624:x1874392862892160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787560801.372098:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787560801.372156:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3624:x1874392862892160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560801.372164:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787560801.372938:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcb09f80 x1874392862892160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560817 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560801.372966:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862892160:0@lo:13:osp-pre-1-1.0 00002000:00080000:1.0:1787560801.382542:0:18685:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1787560801.382562:0:18685:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1787560801.382735:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17918:x1874392862892288:12345-0@lo:7:osp-pre-1-1.0 Request processed in 34057us (35109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560801.382749:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1787560801.382849:0:17918:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcb0b480 x1874392862892288/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787560817 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560801.382867:0:17918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17918:1874392862892288:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1787560801.382884:0:17918:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1787560801.382949:0:17918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17918:1874392862892672:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1787560801.382989:0:17918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560801.383017:0:17918:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe0bae3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560801.383040:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862892672 00000100:00100000:1.0:1787560801.383048:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862892672 00000100:00100000:1.0:1787560801.383096:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787560801.383106:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17918:x1874392862892672:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1787560801.383142:0:18684:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1787560801.383176:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17918:x1874392862892672:12345-0@lo:5:osp-pre-1-1.0 Request processed in 70us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560801.383192:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1787560801.383225:0:17918:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cafffe4d500 x1874392862892672/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787560817 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560801.383235:0:17918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17918:1874392862892672:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1787560801.383244:0:17918:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1787560801.383268:0:17918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe4d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17918:1874392862892800:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1787560801.383305:0:17918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560801.383320:0:17918:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe0bae3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560801.383331:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862892800 00000100:00100000:1.0:1787560801.383334:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862892800 00000100:00100000:1.0:1787560801.383352:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787560801.383357:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17918:x1874392862892800:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1787560801.383386:0:18685:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00080000:1.0:1787560801.410306:0:19050:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1787560801.410344:0:19050:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1787560801.410357:0:19050:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00002000:00010000:1.0:1787560801.422474:0:19050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560801.422490:0:19050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba72076c/0x4642c20bf2f351fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.422514:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=520s v=(0 0) 00010000:00010000:1.0:1787560801.422520:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560801.422527:0:19050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba72076c/0x4642c20bf2f351fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.422562:0:19050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba72076c/0x4642c20bf2f351fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.422573:0:19050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba72076c/0x4642c20bf2f351fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.422580:0:19050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba72076c/0x4642c20bf2f351fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.422613:0:19050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787560801.423037:0:19050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560801.423044:0:19050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35205 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.423195:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=520s v=(0 0) 00010000:00010000:1.0:1787560801.423199:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560801.423204:0:19050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35205 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.423215:0:19050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35205 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.423224:0:19050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35205 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.423243:0:19050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35205 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.423260:0:19050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787560801.423272:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787560801.423279:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba72076c/0x4642c20bf2f351fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.423288:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021fe800 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560801.423294:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba72076c/0x4642c20bf2f351fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.423304:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba72076c/0x4642c20bf2f351fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.423326:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba72076c/0x4642c20bf2f351fe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.423333:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba72076c/0x4642c20bf2f351fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.423356:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560801.423360:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35205 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.423379:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ffc00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560801.423382:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35205 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.423390:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35205 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.423403:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35205 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.423410:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35205 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.423421:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560801.423426:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560801.423453:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560801.423456:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787560801.426214:0:19050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787560801.426229:0:19050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f69bc56/0x4642c20bf2f3520c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.426250:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=520s v=(0 0) 00010000:00010000:3.0:1787560801.426255:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560801.426262:0:19050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f69bc56/0x4642c20bf2f3520c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.426278:0:19050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f69bc56/0x4642c20bf2f3520c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.426779:0:19050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f69bc56/0x4642c20bf2f3520c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.426798:0:19050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f69bc56/0x4642c20bf2f3520c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.426883:0:19050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787560801.427130:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560801.427139:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f69bc56/0x4642c20bf2f3520c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.427148:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6a00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560801.427153:0:17928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f69bc56/0x4642c20bf2f3520c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.427165:0:17928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f69bc56/0x4642c20bf2f3520c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.427190:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f69bc56/0x4642c20bf2f3520c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.427198:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f69bc56/0x4642c20bf2f3520c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.427223:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560801.427225:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560801.427227:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787560801.428026:0:19050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787560801.428036:0:19050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f7c062b/0x4642c20bf2f35213 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.428051:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=520s v=(0 0) 00010000:00010000:3.0:1787560801.428056:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560801.428062:0:19050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f7c062b/0x4642c20bf2f35213 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.428075:0:19050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f7c062b/0x4642c20bf2f35213 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.428083:0:19050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f7c062b/0x4642c20bf2f35213 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.428091:0:19050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f7c062b/0x4642c20bf2f35213 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.428134:0:19050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787560801.428669:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560801.428679:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f7c062b/0x4642c20bf2f35213 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.428690:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6400 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560801.428694:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f7c062b/0x4642c20bf2f35213 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.428705:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f7c062b/0x4642c20bf2f35213 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.428744:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f7c062b/0x4642c20bf2f35213 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.428751:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f7c062b/0x4642c20bf2f35213 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.428773:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560801.428775:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560801.428777:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787560801.429985:0:19050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560801.429998:0:19050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f3521a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.430019:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=520s v=(0 0) 00010000:00010000:1.0:1787560801.430024:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560801.430031:0:19050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f3521a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.430045:0:19050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f3521a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.430056:0:19050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f3521a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.430065:0:19050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f3521a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.430101:0:19050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787560801.430896:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560801.430913:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f3521a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.430924:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ff400 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560801.430929:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f3521a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.430940:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f3521a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.430960:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f3521a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.430967:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f3521a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.430993:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560801.430995:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560801.430996:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787560801.435473:0:19050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787560801.435495:0:19050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000710cff71/0x4642c20bf2f35221 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.435520:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=520s v=(0 0) 00010000:00010000:0.0:1787560801.435527:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560801.435535:0:19050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000710cff71/0x4642c20bf2f35221 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.435570:0:19050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000710cff71/0x4642c20bf2f35221 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.435583:0:19050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000710cff71/0x4642c20bf2f35221 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.435593:0:19050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000710cff71/0x4642c20bf2f35221 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.436531:0:19050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787560801.436547:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560801.436558:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000710cff71/0x4642c20bf2f35221 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.436571:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbfe600 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560801.436578:0:17928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000710cff71/0x4642c20bf2f35221 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.436591:0:17928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000710cff71/0x4642c20bf2f35221 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.436618:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000710cff71/0x4642c20bf2f35221 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.437090:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000710cff71/0x4642c20bf2f35221 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.437133:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560801.437136:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560801.437139:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787560801.439139:0:19050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787560801.439156:0:19050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6ae3620/0x4642c20bf2f35228 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.439180:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=520s v=(0 0) 00010000:00010000:3.0:1787560801.439185:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560801.439193:0:19050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6ae3620/0x4642c20bf2f35228 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.439209:0:19050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6ae3620/0x4642c20bf2f35228 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.439220:0:19050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6ae3620/0x4642c20bf2f35228 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.439228:0:19050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6ae3620/0x4642c20bf2f35228 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.439251:0:19050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787560801.440112:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560801.440125:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6ae3620/0x4642c20bf2f35228 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.440139:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7200 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560801.440145:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6ae3620/0x4642c20bf2f35228 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.440156:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6ae3620/0x4642c20bf2f35228 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.440178:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6ae3620/0x4642c20bf2f35228 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.440186:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6ae3620/0x4642c20bf2f35228 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.440212:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560801.440214:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560801.440216:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787560801.445254:0:19050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787560801.445276:0:19050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab9165b8/0x4642c20bf2f3522f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.445299:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=520s v=(0 0) 00010000:00010000:3.0:1787560801.445315:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560801.445323:0:19050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab9165b8/0x4642c20bf2f3522f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.445347:0:19050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab9165b8/0x4642c20bf2f3522f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.445360:0:19050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab9165b8/0x4642c20bf2f3522f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.445369:0:19050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab9165b8/0x4642c20bf2f3522f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.445403:0:19050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787560801.447409:0:19050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787560801.447425:0:19050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bf181f6/0x4642c20bf2f35236 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.447474:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=520s v=(0 0) 00010000:00010000:3.0:1787560801.447478:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560801.447485:0:19050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bf181f6/0x4642c20bf2f35236 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.447500:0:19050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bf181f6/0x4642c20bf2f35236 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.447510:0:19050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bf181f6/0x4642c20bf2f35236 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.447525:0:19050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bf181f6/0x4642c20bf2f35236 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.447551:0:19050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787560801.448102:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787560801.448112:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab9165b8/0x4642c20bf2f3522f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.448123:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7600 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560801.448136:0:17928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab9165b8/0x4642c20bf2f3522f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.448146:0:17928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab9165b8/0x4642c20bf2f3522f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.448168:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab9165b8/0x4642c20bf2f3522f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.448176:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab9165b8/0x4642c20bf2f3522f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.448202:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560801.448207:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bf181f6/0x4642c20bf2f35236 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.448215:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6600 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560801.448219:0:17928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bf181f6/0x4642c20bf2f35236 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.448226:0:17928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bf181f6/0x4642c20bf2f35236 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.448236:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bf181f6/0x4642c20bf2f35236 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.448244:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bf181f6/0x4642c20bf2f35236 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.448267:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560801.448269:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560801.448271:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560801.448396:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787560801.449130:0:19050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560801.449141:0:19050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f3523d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.449156:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=520s v=(0 0) 00010000:00010000:1.0:1787560801.449161:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560801.449167:0:19050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f3523d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.449179:0:19050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f3523d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.449190:0:19050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f3523d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.449199:0:19050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f3523d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.449222:0:19050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787560801.449697:0:19050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560801.449705:0:19050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba72076c/0x4642c20bf2f35244 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.449735:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=520s v=(0 0) 00010000:00010000:1.0:1787560801.449739:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560801.449744:0:19050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba72076c/0x4642c20bf2f35244 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.449754:0:19050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba72076c/0x4642c20bf2f35244 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.449764:0:19050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba72076c/0x4642c20bf2f35244 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.449772:0:19050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba72076c/0x4642c20bf2f35244 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.449796:0:19050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787560801.449808:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787560801.449813:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f3523d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.450152:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560801.450160:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba72076c/0x4642c20bf2f35244 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.450169:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021fe800 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560801.450174:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba72076c/0x4642c20bf2f35244 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.450184:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba72076c/0x4642c20bf2f35244 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.450202:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba72076c/0x4642c20bf2f35244 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.450210:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba72076c/0x4642c20bf2f35244 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.450229:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560801.450231:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560801.450232:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560801.450321:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ffc00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560801.450326:0:17928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f3523d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.450336:0:17928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f3523d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.450361:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f3523d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.450368:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f3523d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.450383:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560801.450385:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560801.450387:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787560801.458094:0:19050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560801.458117:0:19050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f3524b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.458143:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=520s v=(0 0) 00010000:00010000:1.0:1787560801.458148:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560801.458156:0:19050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f3524b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.458174:0:19050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f3524b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.458187:0:19050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f3524b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.458196:0:19050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f3524b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.458237:0:19050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787560801.458254:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560801.458261:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f3524b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.458270:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ff400 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560801.458275:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f3524b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.458286:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f3524b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.458309:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f3524b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.458317:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b1f6e53/0x4642c20bf2f3524b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.458338:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560801.458340:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560801.458342:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787560801.460273:0:19050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560801.460294:0:19050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4a86590/0x4642c20bf2f35252 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.460316:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=520s v=(0 0) 00010000:00010000:1.0:1787560801.460340:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560801.460348:0:19050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4a86590/0x4642c20bf2f35252 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.460363:0:19050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4a86590/0x4642c20bf2f35252 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.460376:0:19050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4a86590/0x4642c20bf2f35252 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.460384:0:19050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4a86590/0x4642c20bf2f35252 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.460410:0:19050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787560801.461032:0:19050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560801.461041:0:19050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009eff725e/0x4642c20bf2f35259 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.461053:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=520s v=(0 0) 00010000:00010000:1.0:1787560801.461058:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560801.461063:0:19050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009eff725e/0x4642c20bf2f35259 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.461074:0:19050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009eff725e/0x4642c20bf2f35259 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.461083:0:19050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009eff725e/0x4642c20bf2f35259 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.461098:0:19050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009eff725e/0x4642c20bf2f35259 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.461123:0:19050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787560801.461140:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787560801.461147:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4a86590/0x4642c20bf2f35252 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.461154:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880e00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560801.461159:0:17928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4a86590/0x4642c20bf2f35252 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.461168:0:17928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4a86590/0x4642c20bf2f35252 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.461191:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4a86590/0x4642c20bf2f35252 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.461198:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4a86590/0x4642c20bf2f35252 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.461223:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560801.461226:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009eff725e/0x4642c20bf2f35259 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.461250:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881200 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560801.461253:0:17928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009eff725e/0x4642c20bf2f35259 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.461260:0:17928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009eff725e/0x4642c20bf2f35259 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.461271:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009eff725e/0x4642c20bf2f35259 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.461278:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009eff725e/0x4642c20bf2f35259 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.461293:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560801.461295:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560801.461297:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560801.461609:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787560801.464049:0:19050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560801.464069:0:19050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7b1ee9b/0x4642c20bf2f35260 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.464095:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=520s v=(0 0) 00010000:00010000:1.0:1787560801.464100:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560801.464108:0:19050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7b1ee9b/0x4642c20bf2f35260 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.464124:0:19050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7b1ee9b/0x4642c20bf2f35260 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.464152:0:19050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7b1ee9b/0x4642c20bf2f35260 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.464160:0:19050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7b1ee9b/0x4642c20bf2f35260 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.464189:0:19050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787560801.464210:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560801.464217:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7b1ee9b/0x4642c20bf2f35260 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.464226:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880800 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560801.464232:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7b1ee9b/0x4642c20bf2f35260 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.464242:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7b1ee9b/0x4642c20bf2f35260 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.464262:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7b1ee9b/0x4642c20bf2f35260 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.464270:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7b1ee9b/0x4642c20bf2f35260 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.464292:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560801.464300:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560801.464302:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787560801.467119:0:19050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560801.467139:0:19050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b786b935/0x4642c20bf2f35267 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.467165:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=520s v=(0 0) 00010000:00010000:1.0:1787560801.467171:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560801.467181:0:19050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b786b935/0x4642c20bf2f35267 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.467199:0:19050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b786b935/0x4642c20bf2f35267 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.467213:0:19050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b786b935/0x4642c20bf2f35267 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.467222:0:19050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b786b935/0x4642c20bf2f35267 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.467253:0:19050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787560801.475989:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560801.476012:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b786b935/0x4642c20bf2f35267 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.476030:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880c00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560801.476037:0:17928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b786b935/0x4642c20bf2f35267 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.476050:0:17928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b786b935/0x4642c20bf2f35267 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.476080:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b786b935/0x4642c20bf2f35267 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.476090:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b786b935/0x4642c20bf2f35267 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.476125:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560801.476127:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560801.476129:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787560801.476648:0:19050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787560801.476658:0:19050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000710cff71/0x4642c20bf2f3526e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.476688:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=520s v=(0 0) 00010000:00010000:0.0:1787560801.476694:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560801.476703:0:19050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000710cff71/0x4642c20bf2f3526e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.476716:0:19050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000710cff71/0x4642c20bf2f3526e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.476728:0:19050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000710cff71/0x4642c20bf2f3526e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.476737:0:19050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000710cff71/0x4642c20bf2f3526e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.476758:0:19050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787560801.477803:0:19050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560801.477817:0:19050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35275 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.477834:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=520s v=(0 0) 00010000:00010000:1.0:1787560801.477839:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560801.477845:0:19050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35275 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.477867:0:19050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35275 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.477878:0:19050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35275 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.477885:0:19050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35275 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.477909:0:19050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787560801.477922:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787560801.477928:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000710cff71/0x4642c20bf2f3526e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.477937:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbfe600 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560801.477942:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000710cff71/0x4642c20bf2f3526e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.477950:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000710cff71/0x4642c20bf2f3526e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.477970:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000710cff71/0x4642c20bf2f3526e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.477978:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000710cff71/0x4642c20bf2f3526e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.478004:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560801.478007:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35275 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.478014:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ffc00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560801.478018:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35275 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.478024:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35275 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.478033:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35275 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.478041:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35275 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.478054:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560801.478056:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560801.478058:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560801.478311:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787560801.484248:0:19050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787560801.484275:0:19050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d8ec592/0x4642c20bf2f3527c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.484302:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=520s v=(0 0) 00010000:00010000:2.0:1787560801.484308:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560801.484316:0:19050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d8ec592/0x4642c20bf2f3527c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.484336:0:19050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d8ec592/0x4642c20bf2f3527c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.484349:0:19050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d8ec592/0x4642c20bf2f3527c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.484359:0:19050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d8ec592/0x4642c20bf2f3527c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.484406:0:19050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787560801.484951:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560801.484961:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d8ec592/0x4642c20bf2f3527c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.484971:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca48600 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560801.484986:0:17928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d8ec592/0x4642c20bf2f3527c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.484997:0:17928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d8ec592/0x4642c20bf2f3527c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.485020:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d8ec592/0x4642c20bf2f3527c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.485027:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d8ec592/0x4642c20bf2f3527c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560801.485056:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560801.485059:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560801.485061:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787560801.486517:0:19050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787560801.486532:0:19050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022c582c0/0x4642c20bf2f35283 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.486549:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=520s v=(0 0) 00010000:00010000:2.0:1787560801.486554:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560801.486562:0:19050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022c582c0/0x4642c20bf2f35283 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.486575:0:19050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022c582c0/0x4642c20bf2f35283 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.486586:0:19050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022c582c0/0x4642c20bf2f35283 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.486594:0:19050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022c582c0/0x4642c20bf2f35283 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.486620:0:19050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787560801.488768:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560801.488803:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022c582c0/0x4642c20bf2f35283 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.488821:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca48800 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560801.488828:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022c582c0/0x4642c20bf2f35283 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.488841:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022c582c0/0x4642c20bf2f35283 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.488872:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022c582c0/0x4642c20bf2f35283 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560801.488887:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560801.488889:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560801.488891:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560801.489688:0:19050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022c582c0/0x4642c20bf2f35283 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787560801.492156:0:19050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787560801.492179:0:19050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004798767d/0x4642c20bf2f3528a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.492213:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=520s v=(0 0) 00010000:00010000:2.0:1787560801.492219:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560801.492227:0:19050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004798767d/0x4642c20bf2f3528a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.492244:0:19050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004798767d/0x4642c20bf2f3528a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.492256:0:19050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004798767d/0x4642c20bf2f3528a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.492264:0:19050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004798767d/0x4642c20bf2f3528a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.492295:0:19050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787560801.493806:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560801.493823:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004798767d/0x4642c20bf2f3528a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.493839:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca48200 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560801.493844:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004798767d/0x4642c20bf2f3528a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.493855:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004798767d/0x4642c20bf2f3528a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.493907:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004798767d/0x4642c20bf2f3528a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.493915:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004798767d/0x4642c20bf2f3528a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.493951:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560801.493954:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560801.493955:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787560801.494004:0:19050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787560801.494017:0:19050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc7bafae/0x4642c20bf2f35291 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.494033:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=520s v=(0 0) 00010000:00010000:2.0:1787560801.494037:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560801.494044:0:19050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc7bafae/0x4642c20bf2f35291 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.494057:0:19050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc7bafae/0x4642c20bf2f35291 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.494081:0:19050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc7bafae/0x4642c20bf2f35291 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.494089:0:19050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc7bafae/0x4642c20bf2f35291 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.494115:0:19050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787560801.494863:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560801.494873:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc7bafae/0x4642c20bf2f35291 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.494884:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49e00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560801.494889:0:17928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc7bafae/0x4642c20bf2f35291 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.494898:0:17928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc7bafae/0x4642c20bf2f35291 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.494913:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc7bafae/0x4642c20bf2f35291 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.494922:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc7bafae/0x4642c20bf2f35291 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.494957:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560801.494959:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560801.494961:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787560801.495113:0:19498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1787560801.495141:0:19498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1787560801.495146:0:19498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787560801.499279:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17918:x1874392862892800:12345-0@lo:5:osp-pre-1-1.0 Request processed in 115904us (115956us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787560801.499298:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787560801.499330:0:17918:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787560801.499346:0:17918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe4d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17918:1874392862892800:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1787560801.499368:0:17918:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1787560801.499427:0:17918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3af1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17918:1874392862892928:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1787560801.499523:0:17918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560801.499558:0:17918:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc46c8480 going to sleep for 11 seconds 00000100:00100000:0.0:1787560801.499591:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862892928 00000100:00100000:0.0:1787560801.499705:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862892928 00000100:00100000:0.0:1787560801.499774:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787560801.499793:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17918:x1874392862892928:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1787560801.499847:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17918:x1874392862892928:12345-0@lo:900:osp-pre-1-1.0 Request processed in 64us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560801.499854:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787560801.499883:0:17918:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3af1c00 x1874392862892928/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787560817 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560801.499895:0:17918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3af1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17918:1874392862892928:0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1787560801.503055:0:19050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787560801.503071:0:19050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000b5ae39/0x4642c20bf2f35298 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.503105:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=520s v=(0 0) 00010000:00010000:0.0:1787560801.503110:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560801.503117:0:19050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000b5ae39/0x4642c20bf2f35298 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.503131:0:19050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000b5ae39/0x4642c20bf2f35298 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.503142:0:19050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000b5ae39/0x4642c20bf2f35298 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.503149:0:19050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000b5ae39/0x4642c20bf2f35298 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.503180:0:19050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787560801.503224:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560801.503239:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000b5ae39/0x4642c20bf2f35298 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.503254:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbfe800 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:2.0:1787560801.503261:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000b5ae39/0x4642c20bf2f35298 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.503273:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000b5ae39/0x4642c20bf2f35298 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.503300:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000b5ae39/0x4642c20bf2f35298 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.503309:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000b5ae39/0x4642c20bf2f35298 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.503341:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560801.503360:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560801.503363:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787560801.505533:0:19050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787560801.505553:0:19050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008815fe9c/0x4642c20bf2f3529f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.505575:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=520s v=(0 0) 00010000:00010000:2.0:1787560801.505580:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560801.505588:0:19050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008815fe9c/0x4642c20bf2f3529f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.505604:0:19050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008815fe9c/0x4642c20bf2f3529f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.505617:0:19050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008815fe9c/0x4642c20bf2f3529f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.505634:0:19050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008815fe9c/0x4642c20bf2f3529f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.505662:0:19050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787560801.506482:0:19050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787560801.506491:0:19050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075ee660f/0x4642c20bf2f352a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.506505:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=520s v=(0 0) 00010000:00010000:2.0:1787560801.506509:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560801.506515:0:19050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075ee660f/0x4642c20bf2f352a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.506537:0:19050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075ee660f/0x4642c20bf2f352a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.506548:0:19050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075ee660f/0x4642c20bf2f352a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.506556:0:19050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075ee660f/0x4642c20bf2f352a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560801.506576:0:19050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787560801.506604:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787560801.506624:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008815fe9c/0x4642c20bf2f3529f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.506641:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49000 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560801.506647:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008815fe9c/0x4642c20bf2f3529f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.506659:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008815fe9c/0x4642c20bf2f3529f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.506701:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008815fe9c/0x4642c20bf2f3529f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.506718:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008815fe9c/0x4642c20bf2f3529f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.506750:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560801.506754:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075ee660f/0x4642c20bf2f352a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.506759:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49800 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560801.506763:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075ee660f/0x4642c20bf2f352a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.506769:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075ee660f/0x4642c20bf2f352a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.506778:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075ee660f/0x4642c20bf2f352a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.506793:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075ee660f/0x4642c20bf2f352a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.506816:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560801.506819:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560801.506830:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560801.506840:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787560801.511147:0:19050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787560801.511165:0:19050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027a3ec80/0x4642c20bf2f352ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.511184:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=520s v=(0 0) 00010000:00010000:0.0:1787560801.511189:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560801.511197:0:19050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027a3ec80/0x4642c20bf2f352ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.511213:0:19050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027a3ec80/0x4642c20bf2f352ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.511224:0:19050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027a3ec80/0x4642c20bf2f352ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.511233:0:19050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027a3ec80/0x4642c20bf2f352ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.511259:0:19050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787560801.512019:0:19050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787560801.512027:0:19050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004441d14/0x4642c20bf2f352b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.512038:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=520s v=(0 0) 00010000:00010000:0.0:1787560801.512042:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560801.512046:0:19050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004441d14/0x4642c20bf2f352b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.512069:0:19050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004441d14/0x4642c20bf2f352b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.512078:0:19050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004441d14/0x4642c20bf2f352b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.512085:0:19050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004441d14/0x4642c20bf2f352b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.512104:0:19050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787560801.512117:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787560801.512122:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027a3ec80/0x4642c20bf2f352ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.512130:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbfe400 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560801.512135:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027a3ec80/0x4642c20bf2f352ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.512143:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027a3ec80/0x4642c20bf2f352ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.512159:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027a3ec80/0x4642c20bf2f352ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.512167:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027a3ec80/0x4642c20bf2f352ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.512195:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560801.512199:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004441d14/0x4642c20bf2f352b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.512206:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbff400 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560801.512210:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004441d14/0x4642c20bf2f352b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.512217:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004441d14/0x4642c20bf2f352b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.512229:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004441d14/0x4642c20bf2f352b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.512236:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004441d14/0x4642c20bf2f352b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560801.512249:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560801.512250:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560801.512256:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787560801.512306:0:19050:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:0.0:1787560801.512413:0:19050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17200:x1874392862892544:12345-0@lo:5:osp-pre-1-0.0 Request processed in 153794us (154138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560801.512423:0:19050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1787560801.512534:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560801.512602:0:17200:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc52c0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17200:1874392862892544:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787560801.512638:0:17200:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1787560801.512702:0:17200:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc52c0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17200:1874392862893056:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787560801.512764:0:17200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560801.512815:0:17200:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc599d240 going to sleep for 11 seconds 00000100:00100000:0.0:1787560801.513342:0:19050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862893056 00000100:00100000:0.0:1787560801.513352:0:19050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862893056 00000100:00100000:0.0:1787560801.513412:0:19050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787560801.513422:0:19050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17200:x1874392862893056:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787560801.513565:0:19050:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:3.0:1787560801.526566:0:19050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17200:x1874392862893056:12345-0@lo:5:osp-pre-1-0.0 Request processed in 13133us (13789us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787560801.526587:0:19050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787560801.527323:0:17200:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc52c0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17200:1874392862893056:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787560801.527346:0:17200:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000100:00100000:2.0:1787560801.846119:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787560801.846151:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862893184:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787560801.846214:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560801.846368:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862893184 00000100:00100000:3.0:1787560801.846376:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862893184 00000100:00100000:3.0:1787560801.846453:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787560801.846464:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862893184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787560801.846514:0:17178:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787560801.846563:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862893184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560801.846570:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787560801.846617:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862893184:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787560801.846808:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560801.851427:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787560801.851463:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862893312:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787560801.851533:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560801.851581:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862893312 00000100:00100000:3.0:1787560801.851589:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862893312 00000100:00100000:3.0:1787560801.851639:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787560801.851649:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862893312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787560801.851681:0:17179:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787560801.851723:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862893312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560801.851730:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787560801.851772:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862893312:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1787560802.687637:0:17927:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787560802.898929:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787560803.347365:0:19853:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787560803.380181:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc52c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862893440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787560803.380272:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560803.380369:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862893440 00000100:00100000:2.0:1787560803.380379:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862893440 00000100:00100000:2.0:1787560803.380478:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787560803.380492:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862893440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787560803.380533:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787560803.380600:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862893440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560803.380608:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787560803.380669:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc52c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862893440:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787560803.385555:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787560803.898980:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787560804.532775:0:19905:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787560804.533031:0:19905:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787560804.917183:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787560805.558477:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:2.0:1787560805.721143:0:19955:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787560805.721622:0:19955:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787560805.929985:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560805.930118:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853366528 00000100:00100000:2.0:1787560805.930132:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853366528 00000100:00100000:2.0:1787560805.930199:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 121 00000100:00100000:2.0:1787560805.930213:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2401:x1874392853366528:12345-192.168.203.29@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787560805.930254:0:17167:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a6b1eeed-a176-422e-91d7-2f6f77b2967a@192.168.203.29@tcp t0 exp 0000000000000000 cur 525 last 0 00000020:00000080:2.0:1787560805.930307:0:17167:0:(genops.c:1385:class_connect()) connect: client a6b1eeed-a176-422e-91d7-2f6f77b2967a, cookie 0x4642c20bf2f352bb 00000100:00080000:2.0:1787560805.930619:0:17167:0:(import.c:65:import_set_state_nolock()) ffff9caec2d3d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787560805.930725:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b1eeed-a176-422e-91d7-2f6f77b2967a+5:2401:x1874392853366528:12345-192.168.203.29@tcp:250:mount.lustre.0 Request processed in 513us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560805.930734:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 121 00010000:00010000:1.0:1787560805.942923:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560805.947914:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560805.949794:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853366656 00000100:00100000:3.0:1787560805.949816:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853366656 00000100:00100000:3.0:1787560805.949957:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 122 00000100:00100000:3.0:1787560805.949971:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+5:14908:x1874392853366656:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787560805.949994:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560805.950019:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafda2f7c00/0x4642c20bf2f352c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x745b4bcf4606000a expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560805.950081:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafda2f7c00/0x4642c20bf2f352c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606000a expref: 6 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560805.950096:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafda2f7c00/0x4642c20bf2f352c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606000a expref: 6 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560805.950107:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f7c00, rc 0) 00000100:00100000:3.0:1787560805.950205:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+6:14908:x1874392853366656:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 237us (2304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560805.950604:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 122 00000100:00100000:1.0:1787560805.957966:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560805.959996:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853366784 00000100:00100000:2.0:1787560805.960018:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853366784 00000100:00100000:2.0:1787560805.960161:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 123 00000100:00100000:2.0:1787560805.960177:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b1eeed-a176-422e-91d7-2f6f77b2967a+6:14908:x1874392853366784:12345-192.168.203.29@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787560805.960655:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b1eeed-a176-422e-91d7-2f6f77b2967a+6:14908:x1874392853366784:12345-192.168.203.29@tcp:501:mount.lustre.0 Request processed in 479us (2705us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787560805.960666:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 123 00000100:00100000:1.0:1787560805.973266:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560805.973474:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853366912 00000100:00100000:0.0:1787560805.973489:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853366912 00000100:00100000:0.0:1787560805.973563:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 124 00000100:00100000:0.0:1787560805.973576:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+6:14908:x1874392853366912:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787560805.973598:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560805.973622:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffcbff000/0x4642c20bf2f352c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x745b4bcf46060011 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560805.973668:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffcbff000/0x4642c20bf2f352c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060011 expref: 7 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560805.973681:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffcbff000/0x4642c20bf2f352c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060011 expref: 7 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560805.973696:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbff000, rc 0) 00000100:00100000:0.0:1787560805.973768:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+7:14908:x1874392853366912:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 195us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560805.973775:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 124 00000100:00100000:1.0:1787560805.977256:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560805.977397:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853367040 00000100:00100000:2.0:1787560805.977413:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853367040 00000100:00100000:2.0:1787560805.977582:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 125 00000100:00100000:2.0:1787560805.977597:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b1eeed-a176-422e-91d7-2f6f77b2967a+7:14908:x1874392853367040:12345-192.168.203.29@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787560805.978147:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b1eeed-a176-422e-91d7-2f6f77b2967a+8:14908:x1874392853367040:12345-192.168.203.29@tcp:501:mount.lustre.0 Request processed in 551us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560805.978161:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 125 00000100:00100000:1.0:1787560805.981133:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560805.981241:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853367168 00000100:00100000:0.0:1787560805.981261:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853367168 00000100:00100000:0.0:1787560805.981353:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 126 00000100:00100000:0.0:1787560805.981375:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+8:14908:x1874392853367168:12345-192.168.203.29@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787560805.981632:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+8:14908:x1874392853367168:12345-192.168.203.29@tcp:503:mount.lustre.0 Request processed in 259us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560805.981640:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 126 00000100:00100000:1.0:1787560805.986013:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560805.986193:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853367296 00000100:00100000:2.0:1787560805.986207:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853367296 00000100:00100000:2.0:1787560805.986287:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 127 00000100:00100000:2.0:1787560805.986300:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff3165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b1eeed-a176-422e-91d7-2f6f77b2967a+8:14926:x1874392853367296:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787560805.986858:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff3165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b1eeed-a176-422e-91d7-2f6f77b2967a+8:14926:x1874392853367296:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 558us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560805.986869:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 127 00000100:00100000:1.0:1787560806.020770:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560806.020940:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853367424 00000100:00100000:3.0:1787560806.020954:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853367424 00000100:00100000:3.0:1787560806.021087:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 128 00000100:00100000:3.0:1787560806.021102:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4934050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b1eeed-a176-422e-91d7-2f6f77b2967a+8:14926:x1874392853367424:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787560806.021324:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4934050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b1eeed-a176-422e-91d7-2f6f77b2967a+8:14926:x1874392853367424:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 224us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560806.021333:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 128 00000100:00100000:1.0:1787560806.025306:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560806.026623:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853367552 00000100:00100000:2.0:1787560806.026641:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853367552 00000100:00100000:2.0:1787560806.027030:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 129 00000100:00100000:2.0:1787560806.027045:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4935450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b1eeed-a176-422e-91d7-2f6f77b2967a+8:14926:x1874392853367552:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787560806.027642:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4935450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b1eeed-a176-422e-91d7-2f6f77b2967a+8:14926:x1874392853367552:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 596us (2347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560806.027653:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 129 00000100:00100000:2.0:1787560806.033342:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560806.033504:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853367680 00000100:00100000:3.0:1787560806.033517:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853367680 00000100:00100000:3.0:1787560806.033582:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 130 00000100:00100000:3.0:1787560806.033593:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4934c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b1eeed-a176-422e-91d7-2f6f77b2967a+8:14908:x1874392853367680:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787560806.033615:0:17168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560806.033637:0:17168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f352d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x745b4bcf46060042 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560806.033674:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f352d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060042 expref: 9 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560806.033880:0:17168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f352d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060042 expref: 9 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560806.033894:0:17168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f6800, rc 0) 00000100:00100000:3.0:1787560806.034040:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4934c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b1eeed-a176-422e-91d7-2f6f77b2967a+9:14908:x1874392853367680:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 447us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560806.034048:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 130 00000100:00100000:1.0:1787560806.038975:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560806.039173:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853367808 00000100:00100000:0.0:1787560806.039187:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853367808 00000100:00100000:0.0:1787560806.039312:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 131 00000100:00100000:0.0:1787560806.039325:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4936450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+9:14908:x1874392853367808:12345-192.168.203.29@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787560806.039359:0:17166:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787560806.039390:0:17166:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787560806.039394:0:17166:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787560806.039397:0:17166:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787560806.039400:0:17166:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787560806.039402:0:17166:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1787560806.043384:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4936450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+9:14908:x1874392853367808:12345-192.168.203.29@tcp:256:mount.lustre.0 Request processed in 4044us (4407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560806.043405:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 131 00000100:00100000:1.0:1787560806.047297:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560806.047482:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853367936 00000100:00100000:3.0:1787560806.047496:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853367936 00000100:00100000:3.0:1787560806.047619:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 132 00000100:00100000:3.0:1787560806.047634:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4935850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b1eeed-a176-422e-91d7-2f6f77b2967a+9:14908:x1874392853367936:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787560806.047658:0:17168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560806.047693:0:17168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafda2f7800/0x4642c20bf2f352d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x745b4bcf46060049 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560806.047733:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafda2f7800/0x4642c20bf2f352d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060049 expref: 10 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560806.047746:0:17168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafda2f7800/0x4642c20bf2f352d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060049 expref: 10 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560806.047768:0:17168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f7800, rc 0) 00000100:00100000:3.0:1787560806.047855:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4935850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b1eeed-a176-422e-91d7-2f6f77b2967a+10:14908:x1874392853367936:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 224us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560806.047864:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 132 00000100:00100000:1.0:1787560806.053577:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560806.053796:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853368064 00000100:00100000:0.0:1787560806.053810:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853368064 00000100:00100000:0.0:1787560806.053894:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 133 00000100:00100000:0.0:1787560806.053907:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4936850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+10:14908:x1874392853368064:12345-192.168.203.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787560806.054126:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4936850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+10:14908:x1874392853368064:12345-192.168.203.29@tcp:501:mount.lustre.0 Request processed in 222us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560806.054135:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 133 00000100:00100000:1.0:1787560806.058382:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560806.058567:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853368192 00000100:00100000:3.0:1787560806.058607:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853368192 00000100:00100000:2.0:1787560806.058907:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 134 00000100:00100000:2.0:1787560806.058923:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4937850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b1eeed-a176-422e-91d7-2f6f77b2967a+10:14908:x1874392853368192:12345-192.168.203.29@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787560806.059157:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4937850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b1eeed-a176-422e-91d7-2f6f77b2967a+10:14908:x1874392853368192:12345-192.168.203.29@tcp:503:mount.lustre.0 Request processed in 236us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560806.059173:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 134 00000100:00100000:1.0:1787560806.062494:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560806.062562:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853368320 00000100:00100000:0.0:1787560806.062577:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853368320 00000100:00100000:0.0:1787560806.062683:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 135 00000100:00100000:0.0:1787560806.062696:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4936c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+10:14932:x1874392853368320:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787560806.062935:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4936c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+10:14932:x1874392853368320:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 241us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560806.062945:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 135 00000100:00100000:1.0:1787560806.065643:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560806.065733:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853368448 00000100:00100000:2.0:1787560806.065748:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853368448 00000100:00100000:2.0:1787560806.065836:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 136 00000100:00100000:2.0:1787560806.065849:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b1eeed-a176-422e-91d7-2f6f77b2967a+10:14932:x1874392853368448:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787560806.066299:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b1eeed-a176-422e-91d7-2f6f77b2967a+10:14932:x1874392853368448:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 450us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560806.066309:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 136 00000100:00100000:2.0:1787560806.073695:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560806.073824:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560806.074060:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853368576 00000100:00100000:3.0:1787560806.074073:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853368576 00000100:00100000:3.0:1787560806.074123:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853368832 00000100:00100000:3.0:1787560806.074126:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853368832 00000100:00100000:3.0:1787560806.074156:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:3.0:1787560806.074167:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1874392853368576:12345-192.168.203.29@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787560806.074211:0:17174:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a5945945-1487-49fd-bee0-0dcced27d086@192.168.203.29@tcp t0 exp 0000000000000000 cur 525 last 0 00000100:00100000:0.0:1787560806.074237:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:0.0:1787560806.074243:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1874392853368832:12345-192.168.203.29@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787560806.074264:0:18203:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from a5945945-1487-49fd-bee0-0dcced27d086@192.168.203.29@tcp t0 exp 0000000000000000 cur 525 last 0 00000020:00000080:3.0:1787560806.074280:0:17174:0:(genops.c:1385:class_connect()) connect: client a5945945-1487-49fd-bee0-0dcced27d086, cookie 0x4642c20bf2f352de 00000020:00000080:0.0:1787560806.074304:0:18203:0:(genops.c:1385:class_connect()) connect: client a5945945-1487-49fd-bee0-0dcced27d086, cookie 0x4642c20bf2f352e5 00000004:00100000:3.0:1787560806.074319:0:17174:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000004:00100000:0.0:1787560806.074319:0:18203:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000100:00080000:0.0:1787560806.074920:0:18203:0:(import.c:65:import_set_state_nolock()) ffff9caec4039000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787560806.075018:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5945945-1487-49fd-bee0-0dcced27d086+6:2401:x1874392853368832:12345-192.168.203.29@tcp:38:mount.lustre.0 Request processed in 772us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560806.075028:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00080000:3.0:1787560806.076108:0:17174:0:(import.c:65:import_set_state_nolock()) ffff9caec429f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787560806.076193:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5945945-1487-49fd-bee0-0dcced27d086+6:2401:x1874392853368576:12345-192.168.203.29@tcp:38:mount.lustre.0 Request processed in 2022us (2521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560806.076209:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:2.0:1787560806.087585:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560806.089913:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853368960 00000100:00100000:1.0:1787560806.089936:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853368960 00000100:00100000:3.0:1787560806.090015:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00080000:0.0:1787560806.090081:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787560806.090391:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560806.092297:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853368704 00000100:00100000:1.0:1787560806.092318:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853368704 00000100:00100000:1.0:1787560806.092442:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:1.0:1787560806.092458:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5945945-1487-49fd-bee0-0dcced27d086+6:0:x1874392853368960:12345-192.168.203.29@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787560806.092514:0:17175:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787560806.092731:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5945945-1487-49fd-bee0-0dcced27d086+6:0:x1874392853368960:12345-192.168.203.29@tcp:41:mount.lustre.0 Request processed in 275us (5163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560806.092740:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:1.0:1787560806.092775:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:1.0:1787560806.092783:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5945945-1487-49fd-bee0-0dcced27d086+6:0:x1874392853368704:12345-192.168.203.29@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787560806.092804:0:17175:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787560806.092996:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5945945-1487-49fd-bee0-0dcced27d086+6:0:x1874392853368704:12345-192.168.203.29@tcp:41:mount.lustre.0 Request processed in 214us (2990us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560806.093004:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00080000:1.0:1787560806.093035:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560806.099334:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853369088 00000100:00100000:2.0:1787560806.099358:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853369088 00000100:00100000:2.0:1787560806.099496:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:2.0:1787560806.099510:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3baea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5945945-1487-49fd-bee0-0dcced27d086+6:14908:x1874392853369088:12345-192.168.203.29@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787560806.099559:0:17173:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787560806.099915:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3baea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5945945-1487-49fd-bee0-0dcced27d086+6:14908:x1874392853369088:12345-192.168.203.29@tcp:41:mount.lustre.0 Request processed in 407us (9523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560806.099925:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:2.0:1787560806.105619:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560806.105924:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853369216 00000100:00100000:0.0:1787560806.105939:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853369216 00000100:00100000:0.0:1787560806.106015:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:0.0:1787560806.106026:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5945945-1487-49fd-bee0-0dcced27d086+6:14908:x1874392853369216:12345-192.168.203.29@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787560806.106208:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5945945-1487-49fd-bee0-0dcced27d086+6:14908:x1874392853369216:12345-192.168.203.29@tcp:40:mount.lustre.0 Request processed in 181us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560806.106217:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:2.0:1787560806.115336:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560806.115389:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560806.115426:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560806.115571:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853369344 00000100:00100000:3.0:1787560806.115590:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853369344 00000100:00100000:3.0:1787560806.115654:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853369472 00000100:00100000:3.0:1787560806.115658:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853369472 00000100:00100000:3.0:1787560806.115694:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:3.0:1787560806.115704:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2401:x1874392853369344:12345-192.168.203.29@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787560806.115761:0:18685:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a5945945-1487-49fd-bee0-0dcced27d086@192.168.203.29@tcp t0 exp 0000000000000000 cur 525 last 0 00000020:00000080:3.0:1787560806.115807:0:18685:0:(genops.c:1385:class_connect()) connect: client a5945945-1487-49fd-bee0-0dcced27d086, cookie 0x4642c20bf2f352ec 00002000:00100000:3.0:1787560806.115824:0:18685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a5945945-1487-49fd-bee0-0dcced27d086/ffff9caec429a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787560806.115850:0:18685:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:3.0:1787560806.116139:0:18685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787560806.116190:0:18685:0:(import.c:65:import_set_state_nolock()) ffff9caec429d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787560806.116289:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5945945-1487-49fd-bee0-0dcced27d086+6:2401:x1874392853369344:12345-192.168.203.29@tcp:8:mount.lustre.0 Request processed in 584us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560806.116300:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:3.0:1787560806.116326:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:3.0:1787560806.116331:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2401:x1874392853369472:12345-192.168.203.29@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787560806.116352:0:18685:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a5945945-1487-49fd-bee0-0dcced27d086@192.168.203.29@tcp t0 exp 0000000000000000 cur 525 last 0 00000020:00000080:3.0:1787560806.116379:0:18685:0:(genops.c:1385:class_connect()) connect: client a5945945-1487-49fd-bee0-0dcced27d086, cookie 0x4642c20bf2f352f3 00002000:00100000:3.0:1787560806.116386:0:18685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a5945945-1487-49fd-bee0-0dcced27d086/ffff9caec429b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787560806.116400:0:18685:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:3.0:1787560806.116588:0:18685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787560806.116609:0:18685:0:(import.c:65:import_set_state_nolock()) ffff9caec2fce800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787560806.116635:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5945945-1487-49fd-bee0-0dcced27d086+6:2401:x1874392853369472:12345-192.168.203.29@tcp:8:mount.lustre.0 Request processed in 302us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560806.116642:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:0.0:1787560806.117355:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853369600 00000100:00100000:0.0:1787560806.117368:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853369600 00000100:00100000:0.0:1787560806.117519:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:0.0:1787560806.117546:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a5945945-1487-49fd-bee0-0dcced27d086+6:14908:x1874392853369600:12345-192.168.203.29@tcp:900:mount.lustre.0 00000100:00100000:0.0:1787560806.117629:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a5945945-1487-49fd-bee0-0dcced27d086+6:14908:x1874392853369600:12345-192.168.203.29@tcp:900:mount.lustre.0 Request processed in 88us (2311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560806.117637:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:2.0:1787560806.126271:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560806.127883:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853369728 00000100:00100000:1.0:1787560806.127934:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853369728 00000100:00100000:1.0:1787560806.129470:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:1.0:1787560806.129507:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3be8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a5945945-1487-49fd-bee0-0dcced27d086+6:14908:x1874392853369728:12345-192.168.203.29@tcp:33:mount.lustre.0 00000004:00080000:1.0:1787560806.135157:0:17176:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5521us 00000004:00200000:2.0:1787560806.194231:0:17176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787560806.194505:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3be8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a5945945-1487-49fd-bee0-0dcced27d086+6:14908:x1874392853369728:12345-192.168.203.29@tcp:33:mount.lustre.0 Request processed in 65004us (68237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560806.194528:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:3.0:1787560806.366007:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560806.366868:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853369856 00000100:00100000:1.0:1787560806.366932:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853369856 00000100:00100000:2.0:1787560806.367222:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:2.0:1787560806.367239:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5945945-1487-49fd-bee0-0dcced27d086+6:14955:x1874392853369856:12345-192.168.203.29@tcp:101:mkdir.0 00010000:00010000:2.0:1787560806.367277:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560806.374880:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48800/0x4642c20bf2f352fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4606007a expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560806.374998:0:17175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49800/0x4642c20bf2f35301 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560806.375013:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49800/0x4642c20bf2f35301 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560806.375029:0:17175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49800/0x4642c20bf2f35301 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560806.375097:0:17175:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787560806.375102:0:17175:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787560806.375150:0:17175:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49800/0x4642c20bf2f35301 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560806.375189:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48800/0x4642c20bf2f352fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606007a expref: 8 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560806.375214:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49800/0x4642c20bf2f35301 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606007a expref: 7 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560806.375224:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafd8703100) 00010000:00010000:2.0:1787560806.375247:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787560806.375252:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca49800, rc 0) 00000100:00100000:2.0:1787560806.375368:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5945945-1487-49fd-bee0-0dcced27d086+7:14955:x1874392853369856:12345-192.168.203.29@tcp:101:mkdir.0 Request processed in 8132us (9380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560806.375380:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:3.0:1787560806.452935:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862893952:0@lo:400:kworker.0 00000100:00100000:3.0:1787560806.453063:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560806.453151:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4051c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862894464:0@lo:400:kworker.0 00000100:00100000:3.0:1787560806.453178:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560806.453199:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4051180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874392862894976:0@lo:400:kworker.0 00000100:00100000:2.0:1787560806.453217:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862893824:0@lo:400:kworker.0 00000100:00100000:3.0:1787560806.453238:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560806.453275:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1787560806.453284:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f08f2f56-c18f-4579-88a9-05007f76ffc9:3623:1874392862893568:0@lo:400:kworker.0 00000100:00100000:0.0:1787560806.454446:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862894976 00000100:00100000:0.0:1787560806.454461:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862894976 00000100:00100000:0.0:1787560806.454567:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787560806.454584:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874392862894976:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787560806.454951:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560806.454984:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787560806.455003:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3af3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862895488:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787560806.463141:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560806.463221:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560806.463240:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4052300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862894336:0@lo:400:kworker.0 00000100:00100000:3.0:1787560806.463320:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862894080:0@lo:400:kworker.0 00000100:00100000:2.0:1787560806.463331:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560806.463364:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4052680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874392862894848:0@lo:400:kworker.0 00000100:00100000:2.0:1787560806.465506:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560806.465622:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862895360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560806.465679:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560806.465703:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1787560806.466236:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560806.466410:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862893696:0@lo:400:kworker.0 00000100:00100000:3.0:1787560806.466418:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862894592:0@lo:400:kworker.0 00000100:00100000:2.0:1787560806.466498:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560806.466610:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560806.466630:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862895104:0@lo:400:kworker.0 00000100:00100000:3.0:1787560806.466655:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560806.466739:0:19050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862893952 00000100:00100000:3.0:1787560806.466762:0:19050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862893952 00000100:00100000:3.0:1787560806.466844:0:19050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862894464 00000100:00100000:3.0:1787560806.466849:0:19050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862894464 00000100:00100000:3.0:1787560806.466869:0:19050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862893824 00000100:00100000:3.0:1787560806.466873:0:19050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862893824 00000100:00100000:3.0:1787560806.466892:0:19050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862894336 00000100:00100000:3.0:1787560806.466895:0:19050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862894336 00000100:00100000:3.0:1787560806.466915:0:19050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787560806.466924:0:19050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4050700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3623:x1874392862893952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560806.467005:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862894848 00000100:00100000:3.0:1787560806.467012:0:19050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4050700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3623:x1874392862893952:12345-0@lo:400:kworker.0 Request processed in 87us (13949us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560806.467013:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862894848 00000100:00100000:3.0:1787560806.467023:0:19050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787560806.467050:0:19050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787560806.467055:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862894080 00000100:00100000:3.0:1787560806.467059:0:19050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4053480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862894464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560806.467061:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862894080 00000100:00100000:3.0:1787560806.467094:0:19050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4053480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862894464:12345-0@lo:400:kworker.0 Request processed in 37us (13915us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560806.467101:0:19050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787560806.467113:0:19050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787560806.467119:0:19050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3be9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862893824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560806.467169:0:19050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3be9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862893824:12345-0@lo:400:kworker.0 Request processed in 51us (4042us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560806.467176:0:19050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787560806.467188:0:19050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787560806.467195:0:19050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3beb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862894336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560806.467220:0:19050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3beb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862894336:12345-0@lo:400:kworker.0 Request processed in 27us (3892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560806.467226:0:19050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787560806.467347:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862894592 00000100:00100000:0.0:1787560806.467352:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862894592 00000100:00100000:0.0:1787560806.467365:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862895104 00000100:00100000:0.0:1787560806.467368:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862895104 00000100:00100000:0.0:1787560806.467385:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787560806.467394:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874392862894848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560806.467469:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874392862894848:12345-0@lo:400:kworker.0 Request processed in 76us (1975us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560806.467477:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787560806.467495:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787560806.467502:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862894080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560806.467538:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862894080:12345-0@lo:400:kworker.0 Request processed in 36us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560806.467544:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787560806.467556:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787560806.467572:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862894592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560806.467583:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560806.467611:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862894592:12345-0@lo:400:kworker.0 Request processed in 40us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560806.467619:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787560806.467636:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787560806.467642:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874392862895104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560806.467653:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862895360 00000100:00100000:1.0:1787560806.467660:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862895360 00000100:00100000:0.0:1787560806.467677:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874392862895104:12345-0@lo:400:kworker.0 Request processed in 35us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560806.467685:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787560806.467691:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862895488 00000100:00100000:1.0:1787560806.467695:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862895488 00000100:00100000:1.0:1787560806.467712:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787560806.467721:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3be9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1874392862895360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787560806.467744:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787560806.467793:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3be9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1874392862895360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (2114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560806.467799:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787560806.467813:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787560806.467819:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862895488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787560806.467827:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787560806.467862:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862895488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560806.467868:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787560806.467884:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874392862894976:12345-0@lo:400:kworker.0 Request processed in 13304us (14653us total) trans 0 rc 0/0 00000100:00080000:1.0:1787560806.467891:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787560806.467893:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1787560806.467906:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787560806.467909:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787560806.467948:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862893568 00000100:00100000:0.0:1787560806.467954:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862893568 00000100:00100000:3.0:1787560806.467984:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862893952:0@lo:400:kworker.0 00000100:00100000:0.0:1787560806.467992:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787560806.468002:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:3623:x1874392862893568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560806.468010:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4051c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862894464:0@lo:400:kworker.0 00000100:00100000:3.0:1787560806.468028:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4051180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874392862894976:0@lo:400:kworker.0 00000100:00100000:0.0:1787560806.468059:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:3623:x1874392862893568:12345-0@lo:400:kworker.0 Request processed in 57us (4843us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560806.468069:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787560806.468077:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f08f2f56-c18f-4579-88a9-05007f76ffc9:3623:1874392862893568:0@lo:400:kworker.0 00000100:00100000:3.0:1787560806.468100:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862894080:0@lo:400:kworker.0 00000100:00100000:3.0:1787560806.468130:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862894592:0@lo:400:kworker.0 00010000:00080000:3.0:1787560806.468156:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec4053100 x1874392862895104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560806.468173:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862895104:0@lo:400:kworker.0 00000100:00100000:2.0:1787560806.468188:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862894208:0@lo:400:kworker.0 00000100:00100000:2.0:1787560806.468279:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560806.468324:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862894720:0@lo:400:kworker.0 00000100:00100000:2.0:1787560806.468356:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560806.468360:0:18389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862893696 00000100:00100000:3.0:1787560806.468367:0:18389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862893696 00000100:00100000:2.0:1787560806.468390:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862895232:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787560806.468418:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560806.468496:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862895360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560806.468513:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862893824:0@lo:400:kworker.0 00000100:00100000:2.0:1787560806.468546:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4052300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862894336:0@lo:400:kworker.0 00010000:00080000:2.0:1787560806.468561:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec4052680 x1874392862894848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560806.468572:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4052680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874392862894848:0@lo:400:kworker.0 00000100:00100000:2.0:1787560806.468639:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862894208 00000100:00100000:2.0:1787560806.468648:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862894208 00000100:00100000:3.0:1787560806.468776:0:18389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787560806.468788:0:18389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862893696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560806.468858:0:18389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862893696:12345-0@lo:400:kworker.0 Request processed in 73us (2360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560806.468877:0:18389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787560806.468901:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3af3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862895488:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560806.468907:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862893696:0@lo:400:kworker.0 00000100:00100000:2.0:1787560806.469682:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787560806.469705:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3be9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862894208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560806.469817:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3be9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862894208:12345-0@lo:400:kworker.0 Request processed in 122us (1540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560806.469825:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787560806.469867:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862895232 00000100:00100000:2.0:1787560806.469875:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862895232 00000100:00100000:3.0:1787560806.469913:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862894720 00000100:00100000:0.0:1787560806.469914:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862894208:0@lo:400:kworker.0 00000100:00100000:3.0:1787560806.469923:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862894720 00000100:00100000:2.0:1787560806.469955:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787560806.469969:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862895232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787560806.469990:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787560806.470046:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862895232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (1626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560806.470053:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787560806.470097:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787560806.470110:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862894720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560806.470111:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862895232:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787560806.470173:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862894720:12345-0@lo:400:kworker.0 Request processed in 67us (1815us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560806.470180:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787560806.470190:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862894720:0@lo:400:kworker.0 00000100:00080000:1.0:1787560806.470235:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560806.964244:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560806.964313:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862895616:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787560806.964420:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560806.964533:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862895616 00000100:00100000:0.0:1787560806.964545:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862895616 00000100:00100000:0.0:1787560806.964616:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787560806.964627:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862895616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787560806.964679:0:17178:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787560806.964759:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862895616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560806.964767:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00010000:2.0:1787560806.965160:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560806.965162:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787560806.965184:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec38e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862895744:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787560806.965231:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560806.965574:0:18389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862895744 00000100:00100000:2.0:1787560806.965582:0:18389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862895744 00000100:00100000:2.0:1787560806.965631:0:18389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787560806.965640:0:18389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeabab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862895744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787560806.965670:0:18389:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787560806.965754:0:18389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeabab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862895744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560806.965769:0:18389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787560806.966256:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862895616:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787560806.966582:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec38e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862895744:0@lo:41:osp-pre-0-1.0 00000001:00100000:1.0:1787560807.485834:0:19498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a5945945-1487-49fd-bee0-0dcced27d086 00000001:00080000:1.0:1787560807.485859:0:19498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:3.0:1787560807.992378:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560808.266087:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560808.266344:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853369984 00000100:00100000:2.0:1787560808.266358:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853369984 00000100:00100000:2.0:1787560808.266509:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:2.0:1787560808.266540:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5945945-1487-49fd-bee0-0dcced27d086+7:15007:x1874392853369984:12345-192.168.203.29@tcp:41:lfs.0 00000004:00000024:2.0:1787560808.266607:0:17174:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787560808.266753:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5945945-1487-49fd-bee0-0dcced27d086+7:15007:x1874392853369984:12345-192.168.203.29@tcp:41:lfs.0 Request processed in 231us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560808.266762:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00080000:1.0:1787560808.271465:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560808.271891:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560808.272366:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853370112 00000100:00100000:2.0:1787560808.272381:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853370112 00000100:00100000:2.0:1787560808.272562:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00100000:2.0:1787560808.272579:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5945945-1487-49fd-bee0-0dcced27d086+6:15007:x1874392853370112:12345-192.168.203.29@tcp:41:lfs.0 00000004:00000024:2.0:1787560808.272652:0:17173:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787560808.272784:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5945945-1487-49fd-bee0-0dcced27d086+6:15007:x1874392853370112:12345-192.168.203.29@tcp:41:lfs.0 Request processed in 210us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560808.272794:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00080000:1.0:1787560808.279772:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787560808.282640:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560808.284227:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853370240 00000100:00100000:1.0:1787560808.284253:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853370240 00000100:00100000:1.0:1787560808.284401:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:1.0:1787560808.284418:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a5945945-1487-49fd-bee0-0dcced27d086+6:15007:x1874392853370240:12345-192.168.203.29@tcp:13:lfs.0 00002000:00000024:1.0:1787560808.284511:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787560808.284857:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a5945945-1487-49fd-bee0-0dcced27d086+6:15007:x1874392853370240:12345-192.168.203.29@tcp:13:lfs.0 Request processed in 442us (2249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560808.284867:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00080000:2.0:1787560808.284964:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560808.293054:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560808.293200:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853370368 00000100:00100000:3.0:1787560808.293216:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853370368 00000100:00100000:3.0:1787560808.293325:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:3.0:1787560808.293339:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a5945945-1487-49fd-bee0-0dcced27d086+5:15007:x1874392853370368:12345-192.168.203.29@tcp:13:lfs.0 00002000:00000024:3.0:1787560808.293385:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787560808.293539:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a5945945-1487-49fd-bee0-0dcced27d086+5:15007:x1874392853370368:12345-192.168.203.29@tcp:13:lfs.0 Request processed in 203us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560808.293548:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00080000:2.0:1787560808.294017:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787560808.468814:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560808.471241:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853370496 00000100:00100000:2.0:1787560808.471268:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853370496 00000100:00100000:2.0:1787560808.471514:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 138 00000100:00100000:2.0:1787560808.471528:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2162850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b1eeed-a176-422e-91d7-2f6f77b2967a+10:15041:x1874392853370496:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787560808.471553:0:17168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560808.471600:0:17168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca48800/0x4642c20bf2f35308 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x745b4bcf46060081 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560808.471637:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca48800/0x4642c20bf2f35308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060081 expref: 11 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560808.471652:0:17168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca48800/0x4642c20bf2f35308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060081 expref: 11 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560808.471676:0:17168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca48800, rc 0) 00000100:00100000:2.0:1787560808.471785:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2162850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b1eeed-a176-422e-91d7-2f6f77b2967a+11:15041:x1874392853370496:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 260us (2992us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560808.471792:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 138 00000100:00100000:0.0:1787560808.483122:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560808.483698:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853370624 00000100:00100000:2.0:1787560808.483723:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853370624 00000100:00100000:2.0:1787560808.483834:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 139 00000100:00100000:2.0:1787560808.483854:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2162c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+11:15041:x1874392853370624:12345-192.168.203.29@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787560808.484120:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2162c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+11:15041:x1874392853370624:12345-192.168.203.29@tcp:501:mount.lustre.0 Request processed in 274us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560808.484130:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 139 00000100:00100000:3.0:1787560808.490322:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560808.491878:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853370752 00000100:00100000:2.0:1787560808.491902:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853370752 00000100:00100000:2.0:1787560808.492123:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 140 00000100:00100000:2.0:1787560808.492140:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b1eeed-a176-422e-91d7-2f6f77b2967a+11:15041:x1874392853370752:12345-192.168.203.29@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787560808.494165:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b1eeed-a176-422e-91d7-2f6f77b2967a+11:15041:x1874392853370752:12345-192.168.203.29@tcp:503:mount.lustre.0 Request processed in 2008us (3842us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560808.494185:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 140 00000100:00100000:0.0:1787560808.500021:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787560808.500477:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec38e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862895872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787560808.500597:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560808.500691:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862895872 00000100:00100000:3.0:1787560808.500707:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862895872 00000100:00100000:3.0:1787560808.500816:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787560808.500830:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862895872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787560808.500886:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787560808.500957:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862895872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560808.500966:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1787560808.501083:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560808.501314:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec38e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862895872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787560808.502009:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560808.502211:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853370880 00000100:00100000:0.0:1787560808.502219:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853370880 00000100:00100000:0.0:1787560808.502270:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 141 00000100:00100000:0.0:1787560808.502311:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b1eeed-a176-422e-91d7-2f6f77b2967a+11:15046:x1874392853370880:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787560808.503012:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b1eeed-a176-422e-91d7-2f6f77b2967a+11:15046:x1874392853370880:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 727us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560808.503039:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 141 00000100:00100000:1.0:1787560808.526332:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560808.526508:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853371008 00000100:00100000:3.0:1787560808.526527:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853371008 00000100:00100000:3.0:1787560808.526722:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 142 00000100:00100000:3.0:1787560808.526747:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b1eeed-a176-422e-91d7-2f6f77b2967a+11:15046:x1874392853371008:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787560808.526959:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b1eeed-a176-422e-91d7-2f6f77b2967a+11:15046:x1874392853371008:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 225us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560808.526969:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 142 00000100:00100000:3.0:1787560808.536262:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560808.536384:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853371136 00000100:00100000:0.0:1787560808.536405:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853371136 00000100:00100000:0.0:1787560808.536543:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 143 00000100:00100000:0.0:1787560808.536559:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2163450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b1eeed-a176-422e-91d7-2f6f77b2967a+11:15046:x1874392853371136:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787560808.536844:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2163450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b1eeed-a176-422e-91d7-2f6f77b2967a+11:15046:x1874392853371136:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 287us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560808.536855:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 143 00000100:00100000:1.0:1787560808.547765:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560808.547996:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853371264 00000100:00100000:3.0:1787560808.548019:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853371264 00000100:00100000:3.0:1787560808.548110:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 144 00000100:00100000:3.0:1787560808.548124:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b1eeed-a176-422e-91d7-2f6f77b2967a+11:15041:x1874392853371264:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787560808.548148:0:17168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560808.548174:0:17168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafda2f6600/0x4642c20bf2f3530f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x745b4bcf460600b2 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560808.548214:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafda2f6600/0x4642c20bf2f3530f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460600b2 expref: 12 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560808.548238:0:17168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafda2f6600/0x4642c20bf2f3530f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460600b2 expref: 12 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560808.548252:0:17168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f6600, rc 0) 00000100:00100000:3.0:1787560808.548556:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b1eeed-a176-422e-91d7-2f6f77b2967a+12:15041:x1874392853371264:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 434us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560808.548563:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 144 00000100:00100000:1.0:1787560808.554875:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560808.555073:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853371392 00000100:00100000:2.0:1787560808.555085:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853371392 00000100:00100000:2.0:1787560808.555182:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 145 00000100:00100000:2.0:1787560808.555211:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+12:15041:x1874392853371392:12345-192.168.203.29@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787560808.555249:0:17166:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787560808.555268:0:17166:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787560808.555272:0:17166:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787560808.555274:0:17166:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787560808.555276:0:17166:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1787560808.555278:0:17166:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1787560808.557780:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+12:15041:x1874392853371392:12345-192.168.203.29@tcp:256:mount.lustre.0 Request processed in 2548us (2903us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560808.557802:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 145 00000100:00100000:1.0:1787560808.568551:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560808.569423:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853371520 00000100:00100000:3.0:1787560808.569498:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853371520 00000100:00100000:3.0:1787560808.570066:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 146 00000100:00100000:3.0:1787560808.570081:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b1eeed-a176-422e-91d7-2f6f77b2967a+12:15041:x1874392853371520:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787560808.570106:0:17168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560808.570134:0:17168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f35316 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x745b4bcf460600b9 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560808.570175:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f35316 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460600b9 expref: 13 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560808.570188:0:17168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f35316 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460600b9 expref: 13 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560808.570200:0:17168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f7000, rc 0) 00000100:00100000:3.0:1787560808.570766:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b1eeed-a176-422e-91d7-2f6f77b2967a+13:15041:x1874392853371520:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 685us (2243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560808.570775:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 146 00000100:00100000:1.0:1787560808.573131:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560808.573244:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853371648 00000100:00100000:2.0:1787560808.573260:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853371648 00000100:00100000:2.0:1787560808.573338:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 147 00000100:00100000:2.0:1787560808.573353:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+13:15041:x1874392853371648:12345-192.168.203.29@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787560808.573719:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+13:15041:x1874392853371648:12345-192.168.203.29@tcp:501:mount.lustre.0 Request processed in 368us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560808.573728:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 147 00000100:00100000:1.0:1787560808.578304:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560808.578543:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853371776 00000100:00100000:0.0:1787560808.578559:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853371776 00000100:00100000:0.0:1787560808.578695:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 148 00000100:00100000:0.0:1787560808.578709:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b1eeed-a176-422e-91d7-2f6f77b2967a+13:15041:x1874392853371776:12345-192.168.203.29@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787560808.578942:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b1eeed-a176-422e-91d7-2f6f77b2967a+13:15041:x1874392853371776:12345-192.168.203.29@tcp:503:mount.lustre.0 Request processed in 235us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560808.579467:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 148 00000100:00100000:1.0:1787560808.586842:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560808.587010:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853371904 00000100:00100000:2.0:1787560808.587026:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853371904 00000100:00100000:2.0:1787560808.587102:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 149 00000100:00100000:2.0:1787560808.587115:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+13:15050:x1874392853371904:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787560808.587389:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+13:15050:x1874392853371904:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 275us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560808.587399:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 149 00000100:00100000:1.0:1787560808.593595:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560808.594850:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853372032 00000100:00100000:0.0:1787560808.594875:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853372032 00000100:00100000:0.0:1787560808.594989:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 150 00000100:00100000:0.0:1787560808.595126:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc2c81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b1eeed-a176-422e-91d7-2f6f77b2967a+13:15050:x1874392853372032:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787560808.595519:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc2c81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b1eeed-a176-422e-91d7-2f6f77b2967a+13:15050:x1874392853372032:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 396us (1939us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560808.595530:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 150 00000100:00100000:1.0:1787560808.601224:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560808.601277:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560808.601306:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560808.601347:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560808.601361:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853372160 00000100:00100000:3.0:1787560808.601380:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853372160 00000100:00100000:1.0:1787560808.601381:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560808.601396:0:19050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853373056 00000100:00100000:3.0:1787560808.601399:0:19050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853373056 00000100:00100000:1.0:1787560808.601409:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560808.601495:0:19050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853373184 00000100:00100000:3.0:1787560808.601499:0:19050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853373184 00000100:00100000:1.0:1787560808.601505:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:1.0:1787560808.601518:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeabab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5945945-1487-49fd-bee0-0dcced27d086+6:2402:x1874392853373056:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560808.601520:0:19050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:3.0:1787560808.601526:0:19050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeabaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5945945-1487-49fd-bee0-0dcced27d086+5:2402:x1874392853373184:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560808.601623:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853372416 00000100:00100000:0.0:1787560808.601623:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853372800 00000100:00100000:2.0:1787560808.601628:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853372416 00000100:00100000:0.0:1787560808.601628:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853372800 00000100:00100000:2.0:1787560808.601655:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853372928 00000100:00100000:2.0:1787560808.601657:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853372928 00000100:00100000:0.0:1787560808.601662:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 53 00000100:00100000:0.0:1787560808.601667:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5945945-1487-49fd-bee0-0dcced27d086+7:2402:x1874392853372800:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560808.601673:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 54 00000100:00100000:2.0:1787560808.601679:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeabaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5945945-1487-49fd-bee0-0dcced27d086+6:2402:x1874392853372928:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560808.601897:0:19050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeabaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5945945-1487-49fd-bee0-0dcced27d086+5:2402:x1874392853373184:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 369us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560808.601907:0:19050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:1.0:1787560808.601911:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeabab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5945945-1487-49fd-bee0-0dcced27d086+6:2402:x1874392853373056:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 398us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560808.601918:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:3.0:1787560808.601943:0:17175:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787560808.601943:0:18203:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787560808.601951:0:17175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1787560808.601954:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:1.0:1787560808.601959:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeabaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1874392853372416:12345-192.168.203.29@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787560808.601996:0:18203:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 1b0149ea-e230-42a7-990a-2401127b7ffb@192.168.203.29@tcp t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:1.0:1787560808.602042:0:18203:0:(genops.c:1385:class_connect()) connect: client 1b0149ea-e230-42a7-990a-2401127b7ffb, cookie 0x4642c20bf2f3531d 00000004:00100000:1.0:1787560808.602078:0:18203:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000100:00100000:0.0:1787560808.602186:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5945945-1487-49fd-bee0-0dcced27d086+7:2402:x1874392853372800:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 518us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560808.602194:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 53 00000100:00100000:0.0:1787560808.602208:0:17173:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787560808.602214:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:0.0:1787560808.602218:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1874392853372160:12345-192.168.203.29@tcp:38:mount.lustre.0 00000100:00080000:1.0:1787560808.602229:0:18203:0:(import.c:65:import_set_state_nolock()) ffff9cafc58bf800 : changing import state from RECOVER to FULL 00010000:00080000:0.0:1787560808.602230:0:17173:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 1b0149ea-e230-42a7-990a-2401127b7ffb@192.168.203.29@tcp t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:0.0:1787560808.602264:0:17173:0:(genops.c:1385:class_connect()) connect: client 1b0149ea-e230-42a7-990a-2401127b7ffb, cookie 0x4642c20bf2f35324 00000100:00100000:1.0:1787560808.602265:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeabaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b0149ea-e230-42a7-990a-2401127b7ffb+6:2401:x1874392853372416:12345-192.168.203.29@tcp:38:mount.lustre.0 Request processed in 304us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560808.602272:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:2.0:1787560808.602724:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeabaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5945945-1487-49fd-bee0-0dcced27d086+6:2402:x1874392853372928:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 1042us (1338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560808.602732:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 54 00000004:00100000:0.0:1787560808.602960:0:17173:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:0.0:1787560808.603471:0:17173:0:(import.c:65:import_set_state_nolock()) ffff9caec4038800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787560808.603678:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b0149ea-e230-42a7-990a-2401127b7ffb+6:2401:x1874392853372160:12345-192.168.203.29@tcp:38:mount.lustre.0 Request processed in 1456us (2475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560808.603688:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:0.0:1787560808.605769:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560808.605854:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853372544 00000100:00100000:2.0:1787560808.605866:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853372544 00000100:00100000:3.0:1787560808.605937:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:3.0:1787560808.606210:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b0149ea-e230-42a7-990a-2401127b7ffb+6:0:x1874392853372544:12345-192.168.203.29@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787560808.606255:0:17175:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787560808.606411:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b0149ea-e230-42a7-990a-2401127b7ffb+6:0:x1874392853372544:12345-192.168.203.29@tcp:41:mount.lustre.0 Request processed in 206us (653us total) trans 0 rc 0/0 00000100:00080000:0.0:1787560808.606463:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787560808.613625:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560808.613752:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560808.613884:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853372288 00000100:00100000:2.0:1787560808.613897:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853372288 00000100:00100000:2.0:1787560808.614018:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853372672 00000100:00100000:2.0:1787560808.614022:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853372672 00000100:00100000:2.0:1787560808.614045:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:2.0:1787560808.614058:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b0149ea-e230-42a7-990a-2401127b7ffb+7:0:x1874392853372288:12345-192.168.203.29@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787560808.614099:0:17173:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787560808.614183:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b0149ea-e230-42a7-990a-2401127b7ffb+7:0:x1874392853372288:12345-192.168.203.29@tcp:41:mount.lustre.0 Request processed in 127us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560808.614191:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:2.0:1787560808.614211:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:2.0:1787560808.614218:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeababb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b0149ea-e230-42a7-990a-2401127b7ffb+6:15041:x1874392853372672:12345-192.168.203.29@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787560808.614229:0:17173:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787560808.614252:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeababb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b0149ea-e230-42a7-990a-2401127b7ffb+6:15041:x1874392853372672:12345-192.168.203.29@tcp:41:mount.lustre.0 Request processed in 34us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560808.614259:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:3.0:1787560808.614603:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00080000:1.0:1787560808.615236:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560808.618844:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560808.618983:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853373312 00000100:00100000:2.0:1787560808.619030:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853373312 00000100:00100000:2.0:1787560808.619114:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:2.0:1787560808.619130:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b0149ea-e230-42a7-990a-2401127b7ffb+6:15041:x1874392853373312:12345-192.168.203.29@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787560808.619254:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b0149ea-e230-42a7-990a-2401127b7ffb+6:15041:x1874392853373312:12345-192.168.203.29@tcp:40:mount.lustre.0 Request processed in 127us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560808.619263:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:0.0:1787560808.625834:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560808.625951:0:19050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853373440 00000100:00100000:3.0:1787560808.625966:0:19050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853373440 00000100:00100000:3.0:1787560808.626248:0:19050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00100000:3.0:1787560808.626260:0:19050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1874392853373440:12345-192.168.203.29@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787560808.626306:0:19050:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1b0149ea-e230-42a7-990a-2401127b7ffb@192.168.203.29@tcp t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:3.0:1787560808.626346:0:19050:0:(genops.c:1385:class_connect()) connect: client 1b0149ea-e230-42a7-990a-2401127b7ffb, cookie 0x4642c20bf2f3532b 00002000:00100000:3.0:1787560808.626364:0:19050:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1b0149ea-e230-42a7-990a-2401127b7ffb/ffff9caec2fcd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787560808.626378:0:19050:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:3.0:1787560808.626617:0:19050:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787560808.626657:0:19050:0:(import.c:65:import_set_state_nolock()) ffff9caec2fcb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787560808.626755:0:19050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1b0149ea-e230-42a7-990a-2401127b7ffb+6:2401:x1874392853373440:12345-192.168.203.29@tcp:8:mount.lustre.0 Request processed in 495us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560808.626763:0:19050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00100000:0.0:1787560808.626881:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560808.627123:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853373568 00000100:00100000:1.0:1787560808.627131:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853373568 00000100:00100000:1.0:1787560808.627174:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 25 00000100:00100000:1.0:1787560808.627182:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc6b99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1874392853373568:12345-192.168.203.29@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787560808.627211:0:18683:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 1b0149ea-e230-42a7-990a-2401127b7ffb@192.168.203.29@tcp t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:1.0:1787560808.627236:0:18683:0:(genops.c:1385:class_connect()) connect: client 1b0149ea-e230-42a7-990a-2401127b7ffb, cookie 0x4642c20bf2f35332 00002000:00100000:1.0:1787560808.627245:0:18683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1b0149ea-e230-42a7-990a-2401127b7ffb/ffff9cafc58bd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787560808.627253:0:18683:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:1.0:1787560808.627323:0:18683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787560808.627343:0:18683:0:(import.c:65:import_set_state_nolock()) ffff9cafc58ba000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787560808.627384:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc6b99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1b0149ea-e230-42a7-990a-2401127b7ffb+6:2401:x1874392853373568:12345-192.168.203.29@tcp:8:mount.lustre.0 Request processed in 202us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560808.627393:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 25 00000100:00100000:0.0:1787560808.628313:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560808.628394:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853373696 00000100:00100000:1.0:1787560808.628402:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853373696 00000100:00100000:1.0:1787560808.628566:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:1.0:1787560808.628577:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1b0149ea-e230-42a7-990a-2401127b7ffb+6:15041:x1874392853373696:12345-192.168.203.29@tcp:900:mount.lustre.0 00000100:00100000:1.0:1787560808.628657:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1b0149ea-e230-42a7-990a-2401127b7ffb+6:15041:x1874392853373696:12345-192.168.203.29@tcp:900:mount.lustre.0 Request processed in 82us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560808.628672:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:1.0:1787560808.630572:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560808.630801:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853373824 00000100:00100000:2.0:1787560808.630814:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853373824 00000100:00100000:2.0:1787560808.630928:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:2.0:1787560808.630944:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeabaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1b0149ea-e230-42a7-990a-2401127b7ffb+6:15041:x1874392853373824:12345-192.168.203.29@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787560808.631488:0:17177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787560808.631610:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeabaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1b0149ea-e230-42a7-990a-2401127b7ffb+6:15041:x1874392853373824:12345-192.168.203.29@tcp:33:mount.lustre.0 Request processed in 667us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560808.631619:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:2.0:1787560808.867392:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560808.867627:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853373952 00000100:00100000:0.0:1787560808.867644:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853373952 00000100:00100000:0.0:1787560808.867751:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:0.0:1787560808.867766:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1b0149ea-e230-42a7-990a-2401127b7ffb+6:15073:x1874392853373952:12345-192.168.203.29@tcp:101:mkdir.0 00010000:00010000:0.0:1787560808.867810:0:19968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560808.867870:0:19968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe400/0x4642c20bf2f35339 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf460600ea expref: -99 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560808.867984:0:19968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff400/0x4642c20bf2f35340 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560808.868013:0:19968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff400/0x4642c20bf2f35340 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560808.868032:0:19968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff400/0x4642c20bf2f35340 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560808.868099:0:19968:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787560808.868104:0:19968:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787560808.868257:0:19968:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff400/0x4642c20bf2f35340 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560808.868291:0:19968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe400/0x4642c20bf2f35339 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460600ea expref: 8 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560808.868315:0:19968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff400/0x4642c20bf2f35340 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460600ea expref: 7 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560808.868325:0:19968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafd8703100) 00010000:00010000:0.0:1787560808.868328:0:19968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787560808.868333:0:19968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbff400, rc 0) 00000100:00100000:0.0:1787560808.868532:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1b0149ea-e230-42a7-990a-2401127b7ffb+7:15073:x1874392853373952:12345-192.168.203.29@tcp:101:mkdir.0 Request processed in 767us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560808.868541:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 22 00010000:00010000:1.0:1787560809.014147:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560810.037080:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560811.060009:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560811.572294:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862896000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787560811.572393:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560811.572560:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862896000 00000100:00100000:3.0:1787560811.572571:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862896000 00000100:00100000:2.0:1787560811.572733:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787560811.572744:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec38e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862896128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560811.572785:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560811.572831:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862896128 00000100:00100000:2.0:1787560811.572837:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862896128 00000100:00100000:3.0:1787560811.572865:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787560811.572882:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862896000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787560811.572929:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787560811.573001:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862896000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560811.573011:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000001:00100000:3.0:1787560811.577048:0:18679:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1b0149ea-e230-42a7-990a-2401127b7ffb 00000001:00100000:3.0:1787560811.577060:0:18679:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a5945945-1487-49fd-bee0-0dcced27d086 00000100:00080000:0.0:1787560811.577155:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787560811.577163:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787560811.577189:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862896256:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787560811.577261:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560811.577337:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862896256 00000100:00100000:1.0:1787560811.577352:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862896256 00000100:00100000:1.0:1787560811.577418:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787560811.577427:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeabab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862896256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787560811.577470:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787560811.577516:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeabab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862896256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560811.577523:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787560811.578031:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862896256:0@lo:13:osp-pre-1-1.0 00000001:00100000:0.0:1787560811.578558:0:17153:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1b0149ea-e230-42a7-990a-2401127b7ffb 00000001:00100000:0.0:1787560811.578568:0:17153:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a5945945-1487-49fd-bee0-0dcced27d086 00000100:00080000:0.0:1787560811.578594:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787560811.578598:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560811.578981:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4051c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862896768:0@lo:400:kworker.0 00000100:00100000:0.0:1787560811.579029:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560811.579065:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787560811.579071:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862896384:0@lo:400:kworker.0 00000100:00100000:0.0:1787560811.579099:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560811.579139:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862896768 00000100:00100000:0.0:1787560811.579145:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862896768 00000100:00100000:0.0:1787560811.579187:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787560811.579196:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862896768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560811.579213:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4051180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862896640:0@lo:400:kworker.0 00000100:00100000:0.0:1787560811.579251:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862896768:12345-0@lo:400:kworker.0 Request processed in 55us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560811.579260:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560811.579264:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787560811.579292:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862896384 00000100:00100000:1.0:1787560811.579294:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787560811.579297:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862896384 00000100:00100000:1.0:1787560811.579304:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862896512:0@lo:400:kworker.0 00000100:00100000:0.0:1787560811.579327:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787560811.579339:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc2c83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:3625:x1874392862896384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560811.579340:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560811.579383:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc2c83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:3625:x1874392862896384:12345-0@lo:400:kworker.0 Request processed in 48us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560811.579389:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787560811.579416:0:19050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862896640 00000100:00100000:1.0:1787560811.579422:0:19050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862896640 00000100:00100000:0.0:1787560811.579458:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862896384:0@lo:400:kworker.0 00000100:00100000:1.0:1787560811.579490:0:19050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787560811.579492:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4051c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862896768:0@lo:400:kworker.0 00000100:00100000:1.0:1787560811.579502:0:19050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862896640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560811.579545:0:19050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862896640:12345-0@lo:400:kworker.0 Request processed in 48us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560811.579552:0:19050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787560811.579573:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862896512 00000100:00100000:1.0:1787560811.579577:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862896512 00000100:00100000:1.0:1787560811.579603:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787560811.579610:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862896512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560811.579643:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862896512:12345-0@lo:400:kworker.0 Request processed in 33us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560811.579917:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862896896:0@lo:400:kworker.0 00000100:00100000:3.0:1787560811.579949:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560811.579970:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862897408:0@lo:400:kworker.0 00000100:00100000:3.0:1787560811.579992:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560811.580011:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787560811.580017:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4051c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874392862897280:0@lo:400:kworker.0 00000100:00100000:3.0:1787560811.580040:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560811.580146:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862896896 00000100:00100000:0.0:1787560811.580151:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862896896 00000100:00100000:0.0:1787560811.580175:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787560811.580182:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862896896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560811.580621:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862896896:12345-0@lo:400:kworker.0 Request processed in 437us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560811.580629:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787560811.580653:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862897408 00000100:00100000:0.0:1787560811.580657:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862897408 00000100:00100000:0.0:1787560811.580689:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862897280 00000100:00100000:0.0:1787560811.580692:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862897280 00000100:00100000:0.0:1787560811.580711:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787560811.580735:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862897408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560811.580777:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862897408:12345-0@lo:400:kworker.0 Request processed in 46us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560811.580783:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787560811.580794:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787560811.580800:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874392862897280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560811.580960:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862896896:0@lo:400:kworker.0 00000100:00100000:3.0:1787560811.580972:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862897408:0@lo:400:kworker.0 00000100:00100000:0.0:1787560811.581018:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874392862897280:12345-0@lo:400:kworker.0 Request processed in 219us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560811.581024:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787560811.582664:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787560811.582808:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4050a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862897152:0@lo:400:kworker.0 00000100:00100000:1.0:1787560811.582901:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560811.583149:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787560811.583165:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862896128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787560811.583191:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787560811.583243:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862896128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (10457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560811.583262:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787560811.583289:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862897024:0@lo:400:kworker.0 00000100:00100000:2.0:1787560811.583321:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560811.583351:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4050700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862897536:0@lo:400:kworker.0 00000100:00100000:2.0:1787560811.583380:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560811.583415:0:3623:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1787560811.583473:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec38e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862896128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560811.583501:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862896000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787560811.584318:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862896512:0@lo:400:kworker.0 00000100:00100000:1.0:1787560811.584332:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4051180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862896640:0@lo:400:kworker.0 00000100:00100000:1.0:1787560811.584368:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862897152 00000100:00100000:1.0:1787560811.584374:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862897152 00000100:00100000:1.0:1787560811.584424:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862897024 00000100:00100000:1.0:1787560811.584428:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862897024 00000100:00100000:1.0:1787560811.584465:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862897536 00000100:00100000:1.0:1787560811.584468:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862897536 00000100:00100000:1.0:1787560811.584485:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787560811.584492:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862897152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560811.584545:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862897152:12345-0@lo:400:kworker.0 Request processed in 54us (1646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560811.584551:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787560811.584564:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787560811.584570:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862897024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560811.584600:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862897024:12345-0@lo:400:kworker.0 Request processed in 30us (1279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560811.584606:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787560811.584617:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787560811.584622:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874392862897536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560811.584648:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874392862897536:12345-0@lo:400:kworker.0 Request processed in 26us (1267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560811.584653:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787560811.584730:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4050a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862897152:0@lo:400:kworker.0 00000100:00080000:1.0:1787560811.584759:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787560811.584763:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787560811.584766:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1787560811.585605:0:17907:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1b0149ea-e230-42a7-990a-2401127b7ffb 00000001:00100000:1.0:1787560811.585614:0:17907:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a5945945-1487-49fd-bee0-0dcced27d086 00000100:00100000:2.0:1787560811.585920:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862897024:0@lo:400:kworker.0 00010000:00080000:2.0:1787560811.585939:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec4050700 x1874392862897536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560811.585949:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4050700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862897536:0@lo:400:kworker.0 00010000:00080000:3.0:1787560811.592684:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec4051c00 x1874392862897280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560811.592705:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4051c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874392862897280:0@lo:400:kworker.0 00010000:00010000:1.0:1787560812.085084:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560812.085203:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787560812.085232:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec38e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862897664:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787560812.085319:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560812.085801:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787560812.085822:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeaba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862897792:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787560812.085854:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560812.085926:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862897664 00000100:00100000:1.0:1787560812.085936:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862897664 00000100:00100000:1.0:1787560812.085995:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862897792 00000100:00100000:1.0:1787560812.085998:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862897792 00000100:00100000:1.0:1787560812.086014:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787560812.086023:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862897664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787560812.086063:0:17178:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787560812.086117:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862897664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560812.086125:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787560812.086146:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787560812.086151:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862897792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787560812.086168:0:17178:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787560812.086207:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862897792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560812.086212:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787560812.086253:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeaba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862897792:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787560812.086284:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec38e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862897664:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1787560812.093372:0:20054:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000040:00080000:0.0:1787560812.916766:0:17927:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787560813.116473:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560813.620149:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787560813.625900:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec38eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862897920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787560813.626051:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560813.626962:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862897920 00000100:00100000:1.0:1787560813.626977:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862897920 00000100:00100000:1.0:1787560813.627073:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787560813.627087:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862897920:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787560813.627513:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787560813.627757:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787560813.627865:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862897920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 779us (1812us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560813.627875:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787560813.628032:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec38eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862897920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560814.084136:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560814.084175:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560814.084200:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560814.084223:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560814.084241:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560814.084257:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560814.084275:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560814.084289:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560814.084322:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560814.084353:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853374464 00000100:00100000:2.0:1787560814.084362:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853374464 00000100:00100000:2.0:1787560814.084422:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853374592 00000100:00100000:2.0:1787560814.084425:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853374592 00000100:00100000:2.0:1787560814.084458:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853375104 00000100:00100000:2.0:1787560814.084461:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853375104 00000100:00100000:2.0:1787560814.084471:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853374976 00000100:00100000:2.0:1787560814.084473:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853374976 00000100:00100000:2.0:1787560814.084488:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:2.0:1787560814.084497:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5945945-1487-49fd-bee0-0dcced27d086+5:2405:x1874392853374464:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560814.084575:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5945945-1487-49fd-bee0-0dcced27d086+5:2405:x1874392853374464:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 79us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560814.084583:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:2.0:1787560814.084599:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:2.0:1787560814.084606:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5945945-1487-49fd-bee0-0dcced27d086+5:2404:x1874392853374592:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560814.084633:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5945945-1487-49fd-bee0-0dcced27d086+5:2404:x1874392853374592:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 28us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560814.084639:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:2.0:1787560814.084650:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:2.0:1787560814.084656:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1b0149ea-e230-42a7-990a-2401127b7ffb+6:2404:x1874392853375104:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560814.084676:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1b0149ea-e230-42a7-990a-2401127b7ffb+6:2404:x1874392853375104:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 22us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560814.084682:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:2.0:1787560814.084693:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:2.0:1787560814.084712:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1b0149ea-e230-42a7-990a-2401127b7ffb+5:2405:x1874392853374976:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560814.084745:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1b0149ea-e230-42a7-990a-2401127b7ffb+5:2405:x1874392853374976:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 34us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560814.084753:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:2.0:1787560814.084771:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853374208 00000100:00100000:2.0:1787560814.084775:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853374208 00000100:00100000:2.0:1787560814.084803:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853374720 00000100:00100000:2.0:1787560814.084807:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853374720 00000100:00100000:2.0:1787560814.084819:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853374336 00000100:00100000:2.0:1787560814.084821:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853374336 00000100:00100000:2.0:1787560814.084832:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853374848 00000100:00100000:2.0:1787560814.084834:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853374848 00000100:00100000:2.0:1787560814.084847:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 61 00000100:00100000:2.0:1787560814.084853:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5945945-1487-49fd-bee0-0dcced27d086+6:2405:x1874392853374208:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560814.084881:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5945945-1487-49fd-bee0-0dcced27d086+6:2405:x1874392853374208:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 28us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560814.084887:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 61 00000100:00100000:2.0:1787560814.084898:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 62 00000100:00100000:2.0:1787560814.084904:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b0149ea-e230-42a7-990a-2401127b7ffb+6:2405:x1874392853374720:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560814.084924:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b0149ea-e230-42a7-990a-2401127b7ffb+6:2405:x1874392853374720:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 20us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560814.084930:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 62 00000100:00100000:2.0:1787560814.084940:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 63 00000100:00100000:2.0:1787560814.084946:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5945945-1487-49fd-bee0-0dcced27d086+5:2404:x1874392853374336:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560814.085112:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5945945-1487-49fd-bee0-0dcced27d086+5:2404:x1874392853374336:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 22us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560814.085131:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 63 00000100:00100000:2.0:1787560814.085145:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 64 00000100:00100000:2.0:1787560814.085152:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b0149ea-e230-42a7-990a-2401127b7ffb+5:2404:x1874392853374848:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560814.085180:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b0149ea-e230-42a7-990a-2401127b7ffb+5:2404:x1874392853374848:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 28us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560814.085187:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 64 00000100:00100000:2.0:1787560814.085212:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853374080 00000100:00100000:2.0:1787560814.085216:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853374080 00000100:00100000:2.0:1787560814.085252:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 152 00000100:00100000:2.0:1787560814.085259:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc2c80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+13:2404:x1874392853374080:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560814.085281:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc2c80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+13:2404:x1874392853374080:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 23us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560814.085288:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 152 00000100:00080000:2.0:1787560814.085336:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787560814.085341:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787560814.085343:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787560814.085346:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787560814.144097:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787560814.652944:0:19498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1b0149ea-e230-42a7-990a-2401127b7ffb 00010000:00010000:1.0:1787560815.157306:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787560815.799135:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787560816.181161:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787560816.355048:0:20201:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffccdf66f80 20000000:00000080:2.0:1787560816.355065:0:20201:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9caff3149000 uarg=0000000000000000 20000000:01000000:2.0:1787560816.355108:0:20201:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787560816.355114:0:20201:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787560816.355118:0:20201:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787560816.355708:0:20202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1787560816.356051:0:20201:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787560816.365402:0:20201:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787560816.366250:0:20201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cafda2f7600/0x4642c20bf2f35347 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560816.366271:0:20201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caec3880400/0x4642c20bf2f34fdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f34fd5 expref: 23 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560816.366279:0:20201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cafda2f7400/0x4642c20bf2f34fea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f34fe3 expref: 23 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560816.366287:0:20201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caec2168400/0x4642c20bf2f35029 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f35022 expref: 23 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560816.366293:0:20201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cafda2f6000/0x4642c20bf2f3518e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f35187 expref: 23 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560816.366302:0:20201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cafda2f7800/0x4642c20bf2f352d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060049 expref: 12 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560816.366309:0:20201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f35316 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460600b9 expref: 12 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560816.366315:0:20201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cafda2f7600/0x4642c20bf2f35347 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560816.367021:0:20201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f35316 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460600b9 expref: 12 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560816.367059:0:20201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f35316 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460600b9 expref: 12 pid: 17168 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560816.367074:0:20201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4050380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20201:1874392862898048:192.168.203.29@tcp:104: 00010000:00010000:3.0:1787560816.367180:0:20201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cafda2f7800/0x4642c20bf2f352d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060049 expref: 12 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560816.367188:0:20201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cafda2f7800/0x4642c20bf2f352d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060049 expref: 12 pid: 17168 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560816.367197:0:20201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4050000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20201:1874392862898176:192.168.203.29@tcp:104: 00010000:00010000:3.0:1787560816.367223:0:20201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cafda2f6000/0x4642c20bf2f3518e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f35187 expref: 23 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560816.367230:0:20201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cafda2f6000/0x4642c20bf2f3518e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f35187 expref: 23 pid: 17167 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560816.367240:0:20201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4052680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20201:1874392862898304:0@lo:104: 00000100:00100000:3.0:1787560816.367274:0:20201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787560816.367304:0:20201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caec2168400/0x4642c20bf2f35029 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f35022 expref: 23 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560816.367312:0:20201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9caec2168400/0x4642c20bf2f35029 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f35022 expref: 23 pid: 17168 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560816.367321:0:20201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4050700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20201:1874392862898432:0@lo:104: 00000100:00100000:3.0:1787560816.367337:0:20201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560816.367373:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862898304 00000100:00100000:3.0:1787560816.367380:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862898304 00000100:00100000:3.0:1787560816.367417:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862898432 00000100:00100000:3.0:1787560816.367421:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862898432 00000100:00100000:3.0:1787560816.367456:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787560816.367465:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4052300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+4:20201:x1874392862898304:12345-0@lo:104: 00010000:00010000:3.0:1787560816.367476:0:17157:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f35187 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f3518e expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560816.367519:0:17157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787560816.367526:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4052300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+4:20201:x1874392862898304:12345-0@lo:104: Request processed in 63us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560816.367532:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787560816.367548:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787560816.367554:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4053b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+3:20201:x1874392862898432:12345-0@lo:104: 00010000:00010000:3.0:1787560816.367561:0:17157:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffa00/0x4642c20bf2f35022 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f35029 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560816.367590:0:17157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1787560816.367933:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787560816.367941:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f35187 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f3518e expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560816.367948:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6e00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:1.0:1787560816.367953:0:17162:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f35187 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f3518e expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560816.367962:0:17162:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f35187 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f3518e expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560816.367968:0:17162:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f35187 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f3518e expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560816.367974:0:17162:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787560816.368004:0:17162:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f35187 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f3518e expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560816.368010:0:17162:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560816.368028:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f35187 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f3518e expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560816.368035:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f35187 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f3518e expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560816.368053:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560816.368056:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffa00/0x4642c20bf2f35022 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f35029 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560816.368061:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ffa00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:1.0:1787560816.368063:0:17162:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffa00/0x4642c20bf2f35022 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f35029 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560816.368069:0:17162:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffa00/0x4642c20bf2f35022 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f35029 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560816.368075:0:17162:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffa00/0x4642c20bf2f35022 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f35029 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560816.368080:0:17162:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787560816.368092:0:17162:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffa00/0x4642c20bf2f35022 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f35029 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560816.368098:0:17162:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560816.368104:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffa00/0x4642c20bf2f35022 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f35029 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560816.368111:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffa00/0x4642c20bf2f35022 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f35029 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560816.368118:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560816.368120:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560816.368122:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560816.368143:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeaba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f08f2f56-c18f-4579-88a9-05007f76ffc9:3623:1874392862898560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560816.368180:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560816.368212:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787560816.368218:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeaba8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f08f2f56-c18f-4579-88a9-05007f76ffc9:3623:1874392862898688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560816.368238:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560816.368266:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862898560 00000100:00100000:1.0:1787560816.368270:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862898560 00010000:00010000:1.0:1787560816.368291:0:17159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cafda2f6000/0x4642c20bf2f3518e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f35187 expref: 24 pid: 17167 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560816.368310:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862898688 00000100:00100000:1.0:1787560816.368312:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862898688 00010000:00010000:1.0:1787560816.368324:0:17159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caec2168400/0x4642c20bf2f35029 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f35022 expref: 25 pid: 17168 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560816.368341:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787560816.368348:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeabab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+25:3623:x1874392862898560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560816.368358:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560816.368363:0:17159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cafda2f6000/0x4642c20bf2f3518e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f35187 expref: 25 pid: 17167 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560816.368373:0:17159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cafda2f6000/0x4642c20bf2f3518e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f35187 expref: 25 pid: 17167 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560816.368389:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560816.368418:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeabab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+25:3623:x1874392862898560:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560816.368424:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787560816.368462:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787560816.368468:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeabaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:3623:x1874392862898688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560816.368482:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560816.368488:0:17159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caec2168400/0x4642c20bf2f35029 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f35022 expref: 24 pid: 17168 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560816.368496:0:17159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caec2168400/0x4642c20bf2f35029 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f35022 expref: 24 pid: 17168 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560816.368505:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560816.368526:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeabaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:3623:x1874392862898688:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560816.368533:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787560816.368573:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeaba8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f08f2f56-c18f-4579-88a9-05007f76ffc9:3623:1874392862898688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560816.368582:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeaba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f08f2f56-c18f-4579-88a9-05007f76ffc9:3623:1874392862898560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787560816.369229:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4053b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+3:20201:x1874392862898432:12345-0@lo:104: Request processed in 1674us (1889us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560816.369238:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1787560816.369259:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560816.369291:0:20201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cafda2f7400/0x4642c20bf2f34fea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f34fe3 expref: 23 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560816.369302:0:20201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cafda2f7400/0x4642c20bf2f34fea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f34fe3 expref: 23 pid: 17166 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560816.369312:0:20201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4050a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20201:1874392862898816:0@lo:104: 00000100:00100000:3.0:1787560816.369353:0:20201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787560816.369453:0:20201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caec3880400/0x4642c20bf2f34fdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f34fd5 expref: 23 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560816.369463:0:20201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9caec3880400/0x4642c20bf2f34fdc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f34fd5 expref: 23 pid: 17166 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560816.369471:0:20201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4052d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20201:1874392862898944:0@lo:104: 00000100:00100000:3.0:1787560816.369492:0:20201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560816.370082:0:20201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec40ca780 going to sleep for 11 seconds 00010000:00010000:3.0:1787560816.370104:0:20201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafda2f6000/0x4642c20bf2f3518e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f35187 expref: 23 pid: 17167 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560816.370119:0:20201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4052680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20201:1874392862898304:0@lo:104: 00010000:00010000:3.0:1787560816.370130:0:20201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caec2168400/0x4642c20bf2f35029 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f35022 expref: 22 pid: 17168 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560816.370137:0:20201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4050700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20201:1874392862898432:0@lo:104: 00000100:00100000:2.0:1787560816.370172:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862898816 00000100:00100000:2.0:1787560816.370179:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862898816 00000100:00100000:0.0:1787560816.370225:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862898944 00000100:00100000:0.0:1787560816.370229:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862898944 00000100:00100000:0.0:1787560816.370250:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787560816.370259:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4051180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+4:20201:x1874392862898816:12345-0@lo:104: 00010000:00010000:0.0:1787560816.370271:0:17157:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9caec3881400/0x4642c20bf2f34fe3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f34fea expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560816.370336:0:17157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787560816.370343:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4051180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+4:20201:x1874392862898816:12345-0@lo:104: Request processed in 85us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560816.370350:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787560816.370367:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787560816.370373:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4053100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+3:20201:x1874392862898944:12345-0@lo:104: 00010000:00010000:0.0:1787560816.370381:0:17157:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f34fd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f34fdc expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560816.370410:0:17157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787560816.370415:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4053100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+3:20201:x1874392862898944:12345-0@lo:104: Request processed in 44us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560816.370421:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787560816.370885:0:20201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4050a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20201:1874392862898816:0@lo:104: 00000100:00100000:3.0:1787560816.370895:0:20201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4052d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20201:1874392862898944:0@lo:104: 00010000:00010000:1.0:1787560816.371072:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787560816.371080:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caec3881400/0x4642c20bf2f34fe3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f34fea expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560816.371089:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881400 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:1.0:1787560816.371093:0:17161:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caec3881400/0x4642c20bf2f34fe3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f34fea expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560816.371103:0:17161:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caec3881400/0x4642c20bf2f34fe3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f34fea expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560816.371111:0:17161:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caec3881400/0x4642c20bf2f34fe3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f34fea expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560816.371118:0:17161:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787560816.371174:0:17161:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caec3881400/0x4642c20bf2f34fe3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f34fea expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560816.371180:0:17161:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560816.371210:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caec3881400/0x4642c20bf2f34fe3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f34fea expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560816.371216:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caec3881400/0x4642c20bf2f34fe3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f34fea expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560816.371228:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560816.371231:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f34fd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f34fdc expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560816.371236:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7e00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:1.0:1787560816.371239:0:17161:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f34fd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f34fdc expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560816.371245:0:17161:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f34fd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f34fdc expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560816.371250:0:17161:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f34fd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f34fdc expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560816.371255:0:17161:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787560816.371268:0:17161:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f34fd5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f34fdc expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560816.371274:0:17161:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560816.371278:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f34fd5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f34fdc expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560816.371294:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7e00/0x4642c20bf2f34fd5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f34fdc expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560816.371306:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560816.371308:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560816.371310:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560816.371323:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeaba8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f08f2f56-c18f-4579-88a9-05007f76ffc9:3626:1874392862899200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560816.371359:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560816.371393:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787560816.371399:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeaba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f08f2f56-c18f-4579-88a9-05007f76ffc9:3626:1874392862899072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560816.371421:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560816.371500:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862899200 00000100:00100000:1.0:1787560816.371506:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862899200 00010000:00010000:1.0:1787560816.371530:0:17160:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caec3880400/0x4642c20bf2f34fdc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f34fd5 expref: 22 pid: 17166 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560816.371550:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862899072 00000100:00100000:1.0:1787560816.371553:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862899072 00010000:00010000:1.0:1787560816.371563:0:17160:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cafda2f7400/0x4642c20bf2f34fea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f34fe3 expref: 23 pid: 17166 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560816.371581:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787560816.371588:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f08f2f56-c18f-4579-88a9-05007f76ffc9+23:3626:x1874392862899200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560816.371748:0:17160:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560816.371753:0:17160:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caec3880400/0x4642c20bf2f34fdc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f34fd5 expref: 23 pid: 17166 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560816.371763:0:17160:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caec3880400/0x4642c20bf2f34fdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f34fd5 expref: 23 pid: 17166 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560816.371783:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caec3880400/0x4642c20bf2f34fdc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f34fd5 expref: 23 pid: 17166 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560816.371806:0:17160:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560816.371837:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f08f2f56-c18f-4579-88a9-05007f76ffc9+22:3626:x1874392862899200:12345-0@lo:103:ldlm_bl.0 Request processed in 249us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560816.371844:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787560816.371974:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787560816.371981:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3989180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:3626:x1874392862899072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560816.371989:0:17160:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560816.371994:0:17160:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cafda2f7400/0x4642c20bf2f34fea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f34fe3 expref: 21 pid: 17166 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560816.372002:0:17160:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cafda2f7400/0x4642c20bf2f34fea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f34fe3 expref: 21 pid: 17166 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560816.372013:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafda2f7400/0x4642c20bf2f34fea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f34fe3 expref: 21 pid: 17166 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560816.372021:0:17160:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560816.372042:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3989180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f08f2f56-c18f-4579-88a9-05007f76ffc9+20:3626:x1874392862899072:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560816.372048:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787560816.372081:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeaba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f08f2f56-c18f-4579-88a9-05007f76ffc9:3626:1874392862899072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560816.372089:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeaba8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f08f2f56-c18f-4579-88a9-05007f76ffc9:3626:1874392862899200:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560816.372106:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560816.372729:0:20201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4050380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20201:1874392862898048:192.168.203.29@tcp:104: 00000100:00100000:3.0:1787560816.372739:0:20201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4050000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20201:1874392862898176:192.168.203.29@tcp:104: 00010000:00010000:3.0:1787560816.372768:0:20201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cafda2f7600/0x4642c20bf2f35347 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560816.392283:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560816.392383:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560816.395140:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853375232 00000100:00100000:3.0:1787560816.395155:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853375232 00010000:00010000:3.0:1787560816.395197:0:17158:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f35316 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460600b9 expref: 13 pid: 17168 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560816.395251:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853375360 00000100:00100000:3.0:1787560816.395255:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853375360 00010000:00010000:3.0:1787560816.395268:0:17158:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cafda2f7800/0x4642c20bf2f352d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060049 expref: 14 pid: 17168 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560816.395298:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:3.0:1787560816.395307:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafefdc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+14:2405:x1874392853375232:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560816.395320:0:17158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560816.395326:0:17158:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f35316 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460600b9 expref: 14 pid: 17168 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560816.395337:0:17158:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f35316 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460600b9 expref: 14 pid: 17168 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560816.395356:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f35316 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460600b9 expref: 14 pid: 17168 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560816.395374:0:17158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560816.395427:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafefdc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+13:2405:x1874392853375232:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 120us (3152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560816.395476:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:3.0:1787560816.395520:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:3.0:1787560816.395526:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+12:2404:x1874392853375360:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560816.395535:0:17158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560816.395539:0:17158:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cafda2f7800/0x4642c20bf2f352d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060049 expref: 12 pid: 17168 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560816.395559:0:17158:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cafda2f7800/0x4642c20bf2f352d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060049 expref: 12 pid: 17168 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560816.395570:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafda2f7800/0x4642c20bf2f352d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060049 expref: 12 pid: 17168 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560816.395582:0:17158:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cafda2f7600/0x4642c20bf2f35347 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560816.395590:0:17158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafda2f7600/0x4642c20bf2f35347 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560816.395605:0:17158:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cafda2f7600/0x4642c20bf2f35347 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560816.395613:0:17158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cafda2f7600/0x4642c20bf2f35347 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560816.395620:0:17158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cafda2f7600/0x4642c20bf2f35347 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560816.395627:0:17158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cafda2f7600/0x4642c20bf2f35347 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560816.395633:0:17158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7600 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560816.395637:0:17158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cafda2f7600/0x4642c20bf2f35347 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560816.395645:0:17158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cafda2f7600/0x4642c20bf2f35347 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560816.395671:0:17158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cafda2f7600/0x4642c20bf2f35347 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560816.395691:0:17158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560816.395712:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+11:2404:x1874392853375360:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 186us (3329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560816.395719:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 14 00010000:00010000:3.0:1787560816.395796:0:20201:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cafda2f7600/0x4642c20bf2f35347 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560816.395804:0:20201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cafda2f7600/0x4642c20bf2f35347 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560816.395813:0:20201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafda2f7600/0x4642c20bf2f35347 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560816.691696:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787560816.691722:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec38e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862899328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787560816.691797:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560816.691849:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862899328 00000100:00100000:2.0:1787560816.691870:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862899328 00000100:00100000:2.0:1787560816.691936:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787560816.691946:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862899328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787560816.691976:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787560816.692020:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862899328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560816.692027:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1787560816.692051:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787560816.692092:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec38e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862899328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787560816.698863:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560816.698896:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec398b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862899456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787560816.698985:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560816.699049:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862899456 00000100:00100000:0.0:1787560816.699070:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862899456 00000100:00100000:0.0:1787560816.699134:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1787560816.699146:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787560816.699146:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862899456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787560816.699181:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787560816.699237:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862899456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560816.699244:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787560816.700173:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec398b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862899456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787560816.704766:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862899584:0@lo:400:kworker.0 00000100:00100000:3.0:1787560816.704843:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560816.704970:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4050a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862899968:0@lo:400:kworker.0 00000100:00100000:2.0:1787560816.705003:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560816.705034:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862900480:0@lo:400:kworker.0 00000100:00100000:2.0:1787560816.705055:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560816.705078:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787560816.705084:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862899840:0@lo:400:kworker.0 00000100:00100000:2.0:1787560816.705111:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560816.705127:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862900352:0@lo:400:kworker.0 00000100:00100000:2.0:1787560816.705160:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560816.705179:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3900a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874392862900864:0@lo:400:kworker.0 00000100:00100000:1.0:1787560816.705202:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862899712:0@lo:400:kworker.0 00000100:00100000:2.0:1787560816.705211:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560816.705230:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560816.705241:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862899968 00000100:00100000:2.0:1787560816.705248:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862899968 00000100:00100000:1.0:1787560816.705248:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4052680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862900224:0@lo:400:kworker.0 00000100:00100000:1.0:1787560816.705266:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560816.705280:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862900736:0@lo:400:kworker.0 00000100:00100000:2.0:1787560816.705284:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862900480 00000100:00100000:2.0:1787560816.705287:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862900480 00000100:00100000:1.0:1787560816.705302:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560816.705307:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862900352 00000100:00100000:2.0:1787560816.705310:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862900352 00000100:00100000:2.0:1787560816.705320:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862900864 00000100:00100000:2.0:1787560816.705323:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862900864 00000100:00100000:1.0:1787560816.705325:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862899712 00000100:00100000:1.0:1787560816.705327:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862899712 00000100:00100000:2.0:1787560816.705333:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862900736 00000100:00100000:2.0:1787560816.705335:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862900736 00000100:00100000:2.0:1787560816.705349:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787560816.705357:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862899968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560816.705362:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787560816.705367:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec398b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862899712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560816.705404:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862899968:12345-0@lo:400:kworker.0 Request processed in 47us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560816.705404:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec398b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862899712:12345-0@lo:400:kworker.0 Request processed in 35us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560816.705412:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787560816.705412:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787560816.705428:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787560816.705455:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862900480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560816.705479:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862899712:0@lo:400:kworker.0 00000100:00100000:2.0:1787560816.705481:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862900480:12345-0@lo:400:kworker.0 Request processed in 28us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560816.705486:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787560816.705497:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787560816.705503:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862900352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560816.705527:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862900352:12345-0@lo:400:kworker.0 Request processed in 25us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560816.705542:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787560816.705554:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787560816.705560:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874392862900864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560816.705586:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874392862900864:12345-0@lo:400:kworker.0 Request processed in 27us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560816.705592:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787560816.705602:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787560816.705608:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec398bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862900736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560816.705646:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec398bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862900736:12345-0@lo:400:kworker.0 Request processed in 39us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560816.705653:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787560816.705675:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862899840 00000100:00100000:2.0:1787560816.705688:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862899840 00000100:00100000:2.0:1787560816.705712:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862900224 00000100:00100000:2.0:1787560816.705715:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862900224 00000100:00100000:2.0:1787560816.705734:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787560816.705735:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862900736:0@lo:400:kworker.0 00000100:00100000:2.0:1787560816.705740:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862899840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560816.705769:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862899840:12345-0@lo:400:kworker.0 Request processed in 29us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560816.705774:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787560816.705785:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787560816.705791:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec398a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862900224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560816.705829:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec398a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862900224:12345-0@lo:400:kworker.0 Request processed in 37us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560816.705834:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1787560816.705887:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787560816.705891:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787560816.705894:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787560816.705894:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4052680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862900224:0@lo:400:kworker.0 00000100:00080000:2.0:1787560816.705896:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560816.705911:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862899840:0@lo:400:kworker.0 00000100:00100000:2.0:1787560816.705921:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862900352:0@lo:400:kworker.0 00010000:00080000:2.0:1787560816.705931:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3900a80 x1874392862900864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560816.705941:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3900a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874392862900864:0@lo:400:kworker.0 00000100:00100000:2.0:1787560816.705950:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4050a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862899968:0@lo:400:kworker.0 00000100:00100000:2.0:1787560816.705959:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862900480:0@lo:400:kworker.0 00000100:00100000:2.0:1787560816.706552:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862900992:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787560816.706602:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560816.707019:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4050700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862900096:0@lo:400:kworker.0 00000100:00100000:3.0:1787560816.707049:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560816.707069:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafffe1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862900608:0@lo:400:kworker.0 00000100:00100000:3.0:1787560816.707092:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560816.707125:0:18389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862900096 00000100:00100000:3.0:1787560816.707130:0:18389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862900096 00000100:00100000:3.0:1787560816.707164:0:18389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787560816.707173:0:18389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3900380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862900096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560816.707217:0:18389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3900380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862900096:12345-0@lo:400:kworker.0 Request processed in 44us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560816.707232:0:18389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787560816.707268:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4050700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862900096:0@lo:400:kworker.0 00000100:00100000:2.0:1787560816.708116:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862900608 00000100:00100000:2.0:1787560816.708123:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862900608 00000100:00100000:2.0:1787560816.708166:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787560816.708174:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3900e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862900608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560816.708225:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3900e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862900608:12345-0@lo:400:kworker.0 Request processed in 52us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560816.708231:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1787560816.708253:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787560816.708362:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cafffe1b480 x1874392862900608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560816.708374:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafffe1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862900608:0@lo:400:kworker.0 00000100:00100000:2.0:1787560816.708790:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862900992 00000100:00100000:2.0:1787560816.708796:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862900992 00000100:00100000:2.0:1787560816.708836:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787560816.708844:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862900992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787560816.708884:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787560816.708937:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862900992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (2334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560816.708943:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787560816.709077:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862900992:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560816.709253:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862899584 00000100:00100000:0.0:1787560816.709259:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862899584 00000100:00100000:0.0:1787560816.709295:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787560816.709302:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc2c82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+20:3625:x1874392862899584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560816.709392:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc2c82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+20:3625:x1874392862899584:12345-0@lo:400:kworker.0 Request processed in 90us (4548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560816.709398:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787560816.713339:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862899584:0@lo:400:kworker.0 00010000:00010000:3.0:1787560817.204693:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560817.204839:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec398b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862901120:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787560817.204920:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560817.204983:0:18389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862901120 00000100:00100000:1.0:1787560817.204990:0:18389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862901120 00000100:00100000:1.0:1787560817.205036:0:18389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787560817.205045:0:18389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862901120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787560817.205121:0:18389:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787560817.205169:0:18389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862901120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560817.205177:0:18389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787560817.205226:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec398b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862901120:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787560817.205381:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787560817.208427:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862901248:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787560817.208526:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560817.208585:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862901248 00000100:00100000:3.0:1787560817.208593:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862901248 00000100:00100000:3.0:1787560817.208641:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787560817.208649:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3903100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862901248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787560817.208696:0:17178:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787560817.208745:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3903100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862901248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560817.208752:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787560817.208812:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862901248:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787560817.731835:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560817.732039:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853375488 00000100:00100000:3.0:1787560817.732051:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853375488 00000100:00100000:3.0:1787560817.732194:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 154 00000100:00100000:3.0:1787560817.732207:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc2c82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+11:14922:x1874392853375488:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787560817.732244:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560817.732271:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafda2f7600/0x4642c20bf2f3534e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x745b4bcf460600f1 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560817.732305:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafda2f7600/0x4642c20bf2f3534e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460600f1 expref: 12 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560817.732318:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafda2f7600/0x4642c20bf2f3534e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460600f1 expref: 12 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560817.732329:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f7600, rc 0) 00000100:00100000:3.0:1787560817.732410:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc2c82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+12:14922:x1874392853375488:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 Request processed in 206us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560817.732418:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 154 00000100:00100000:1.0:1787560817.750583:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560817.753411:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853375616 00000100:00100000:0.0:1787560817.753442:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853375616 00000100:00100000:0.0:1787560817.753506:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 155 00000100:00100000:0.0:1787560817.753517:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc2c83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b1eeed-a176-422e-91d7-2f6f77b2967a+12:14922:x1874392853375616:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560817.753740:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc2c83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b1eeed-a176-422e-91d7-2f6f77b2967a+12:14922:x1874392853375616:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 Request processed in 223us (3168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560817.753749:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 155 00000100:00100000:0.0:1787560817.756333:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560817.756394:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853375744 00000100:00100000:3.0:1787560817.756403:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853375744 00000100:00100000:3.0:1787560817.758551:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 156 00000100:00100000:3.0:1787560817.758571:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc2c82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+12:14922:x1874392853375744:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787560817.758773:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc2c82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+12:14922:x1874392853375744:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 Request processed in 208us (2446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560817.758783:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 156 00000100:00100000:1.0:1787560817.772218:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560817.772464:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853375872 00000100:00100000:3.0:1787560817.772475:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853375872 00000100:00100000:3.0:1787560817.772526:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 157 00000100:00100000:3.0:1787560817.772536:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b1eeed-a176-422e-91d7-2f6f77b2967a+12:14922:x1874392853375872:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787560817.772553:0:17168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560817.772583:0:17168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafda2f7800/0x4642c20bf2f35355 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x745b4bcf460600f8 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560817.772630:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafda2f7800/0x4642c20bf2f35355 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460600f8 expref: 13 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560817.772643:0:17168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafda2f7800/0x4642c20bf2f35355 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460600f8 expref: 13 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560817.772653:0:17168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f7800, rc 0) 00000100:00100000:3.0:1787560817.772717:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b1eeed-a176-422e-91d7-2f6f77b2967a+13:14922:x1874392853375872:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 Request processed in 182us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560817.772723:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 157 00000100:00100000:1.0:1787560817.775778:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560817.775853:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853376000 00000100:00100000:3.0:1787560817.775863:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853376000 00000100:00100000:3.0:1787560817.775933:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 158 00000100:00100000:3.0:1787560817.775947:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+13:14922:x1874392853376000:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560817.776138:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+13:14922:x1874392853376000:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 Request processed in 194us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560817.776148:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 158 00000100:00100000:1.0:1787560817.781144:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560817.781985:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853376128 00000100:00100000:0.0:1787560817.781997:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853376128 00000100:00100000:0.0:1787560817.782054:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 159 00000100:00100000:0.0:1787560817.782067:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b1eeed-a176-422e-91d7-2f6f77b2967a+13:14922:x1874392853376128:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787560817.782228:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b1eeed-a176-422e-91d7-2f6f77b2967a+13:14922:x1874392853376128:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 Request processed in 163us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560817.782235:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 159 10000000:01000000:1.0:1787560817.993566:0:17170:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787560817.993573:0:17170:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9caec231a000 from 13 10000000:01000000:1.0:1787560817.993578:0:17170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787560817.993629:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffc00/0x4642c20bf2f3535c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560817.993642:0:17170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffc00/0x4642c20bf2f3535c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560817.993656:0:17170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffc00/0x4642c20bf2f3535c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560817.993691:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec398b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862901376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787560817.993766:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560818.001909:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862901376 00000100:00100000:2.0:1787560818.001923:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862901376 00000100:00100000:2.0:1787560818.001985:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787560818.001995:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+20:17170:x1874392862901376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560818.002011:0:17168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560818.002030:0:17168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca48e00/0x4642c20bf2f35363 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f3535c expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560818.002058:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca48e00/0x4642c20bf2f35363 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f3535c expref: 21 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560818.002068:0:17168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca48e00/0x4642c20bf2f35363 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f3535c expref: 21 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560818.002077:0:17168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca48e00, rc 0) 00000100:00100000:2.0:1787560818.002144:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:17170:x1874392862901376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (8377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560818.002151:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787560818.012242:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd7c29780 going to sleep for 10 seconds 00000100:00100000:1.0:1787560818.012286:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec398b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862901376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787560818.012313:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffc00/0x4642c20bf2f3535c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35363 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560818.012340:0:17170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffc00/0x4642c20bf2f3535c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35363 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560818.012427:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec398b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862901504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787560818.012531:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560818.012572:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862901504 00000100:00100000:1.0:1787560818.012578:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862901504 00000100:00100000:1.0:1787560818.012640:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787560818.012650:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:17170:x1874392862901504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787560818.012792:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:17170:x1874392862901504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560818.012799:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787560818.012835:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd7c29780 going to sleep for 11 seconds 00000100:00100000:1.0:1787560818.012846:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec398b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862901504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787560818.012871:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec398b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862901632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787560818.012908:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560818.012929:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862901632 00000100:00100000:1.0:1787560818.012933:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862901632 00000100:00100000:1.0:1787560818.012953:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787560818.012959:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:17170:x1874392862901632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787560818.013029:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:17170:x1874392862901632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560818.013036:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787560818.013066:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd7c29780 going to sleep for 11 seconds 00000100:00100000:1.0:1787560818.013081:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec398b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862901632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787560818.042172:0:20264:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787560818.042284:0:17170:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787560818.042305:0:17170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787560818.042315:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffc00/0x4642c20bf2f3535c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35363 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560818.042342:0:17170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffc00/0x4642c20bf2f3535c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35363 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560818.042353:0:17170:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787560818.042356:0:17170:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cafc68d7800 from 13 10000000:01000000:2.0:1787560818.042358:0:17170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787560818.042391:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49200/0x4642c20bf2f3536a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560818.042399:0:17170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffca49200/0x4642c20bf2f3536a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560818.042411:0:17170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffca49200/0x4642c20bf2f3536a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560818.042452:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862901760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787560818.042516:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560818.042549:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862901760 00000100:00100000:2.0:1787560818.042556:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862901760 00000100:00100000:2.0:1787560818.042592:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787560818.042602:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:17170:x1874392862901760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560818.042615:0:17168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560818.042627:0:17168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f35371 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f3536a expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560818.042647:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f35371 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f3536a expref: 22 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560818.042658:0:17168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f35371 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f3536a expref: 22 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560818.042683:0:17168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca49c00, rc 0) 00000100:00100000:2.0:1787560818.042715:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+22:17170:x1874392862901760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560818.042721:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787560818.042762:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc47a3540 going to sleep for 11 seconds 00000100:00100000:2.0:1787560818.042781:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862901760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560818.042796:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffca49200/0x4642c20bf2f3536a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35371 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560818.042805:0:17170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffca49200/0x4642c20bf2f3536a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35371 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560818.042850:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862901888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560818.042874:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560818.042895:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862901888 00000100:00100000:2.0:1787560818.042898:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862901888 00000100:00100000:2.0:1787560818.042921:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787560818.042927:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+22:17170:x1874392862901888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560818.043017:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+22:17170:x1874392862901888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560818.043024:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787560818.043045:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc47a3540 going to sleep for 11 seconds 00000100:00100000:2.0:1787560818.043055:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862901888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560818.043080:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862902016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560818.043123:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560818.043140:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862902016 00000100:00100000:2.0:1787560818.043144:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862902016 00000100:00100000:2.0:1787560818.043163:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787560818.043169:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+22:17170:x1874392862902016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560818.043233:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+22:17170:x1874392862902016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560818.043240:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787560818.043268:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc47a3540 going to sleep for 11 seconds 00000100:00100000:2.0:1787560818.043278:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862902016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787560818.060820:0:20265:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787560818.060923:0:17170:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787560818.060950:0:17170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787560818.060965:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49200/0x4642c20bf2f3536a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35371 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560818.060981:0:17170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffca49200/0x4642c20bf2f3536a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35371 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560818.061021:0:17170:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787560818.061024:0:17170:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cafc6f14000 from 13 10000000:01000000:3.0:1787560818.061029:0:17170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787560818.061077:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7000/0x4642c20bf2f35378 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560818.061085:0:17170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7000/0x4642c20bf2f35378 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560818.061096:0:17170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7000/0x4642c20bf2f35378 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560818.061129:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3902680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862902144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787560818.061218:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560818.061265:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec40cae40 going to sleep for 11 seconds 00000100:00100000:2.0:1787560818.061931:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862902144 00000100:00100000:2.0:1787560818.061941:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862902144 00000100:00100000:2.0:1787560818.061997:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787560818.062008:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+22:17170:x1874392862902144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560818.062022:0:17168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560818.062037:0:17168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca49000/0x4642c20bf2f3537f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f35378 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560818.062063:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca49000/0x4642c20bf2f3537f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f35378 expref: 23 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560818.062073:0:17168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca49000/0x4642c20bf2f3537f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f35378 expref: 23 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560818.062082:0:17168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca49000, rc 0) 00000100:00100000:2.0:1787560818.062133:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+23:17170:x1874392862902144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560818.062151:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787560818.064076:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3902680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862902144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560818.064101:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7000/0x4642c20bf2f35378 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3537f expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560818.064115:0:17170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7000/0x4642c20bf2f35378 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f3537f expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560818.064193:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862902272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560818.064241:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560818.064271:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862902272 00000100:00100000:2.0:1787560818.064276:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862902272 00000100:00100000:2.0:1787560818.064306:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787560818.064314:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4088c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+23:17170:x1874392862902272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560818.064416:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4088c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+23:17170:x1874392862902272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560818.064424:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787560818.064541:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc47a3480 going to sleep for 11 seconds 00000100:00100000:2.0:1787560818.064552:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862902272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560818.064575:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862902400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560818.064616:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560818.064635:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862902400 00000100:00100000:2.0:1787560818.064638:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862902400 00000100:00100000:2.0:1787560818.064658:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787560818.064664:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec408a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+23:17170:x1874392862902400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560818.064757:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec408a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+23:17170:x1874392862902400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560818.064764:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787560818.064793:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc47a3480 going to sleep for 11 seconds 00000100:00100000:2.0:1787560818.064805:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862902400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787560818.072183:0:20267:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787560818.072315:0:17170:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787560818.072339:0:17170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787560818.072351:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7000/0x4642c20bf2f35378 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3537f expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560818.072362:0:17170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7000/0x4642c20bf2f35378 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3537f expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560818.072372:0:17170:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787560818.072375:0:17170:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9caffff56000 from 13 10000000:01000000:2.0:1787560818.072377:0:17170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787560818.072411:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f35386 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560818.072419:0:17170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f35386 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560818.072455:0:17170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f35386 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560818.072477:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862902528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787560818.072534:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560818.072569:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc47a3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787560818.072693:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862902528 00000100:00100000:3.0:1787560818.072702:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862902528 00000100:00100000:3.0:1787560818.072742:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787560818.072750:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4088050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+23:17170:x1874392862902528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787560818.072762:0:17168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560818.072772:0:17168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafda2f6000/0x4642c20bf2f3538d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f35386 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560818.072793:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafda2f6000/0x4642c20bf2f3538d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f35386 expref: 24 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560818.072803:0:17168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafda2f6000/0x4642c20bf2f3538d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f35386 expref: 24 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560818.072816:0:17168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f6000, rc 0) 00000100:00100000:3.0:1787560818.072849:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4088050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:17170:x1874392862902528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560818.072855:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787560818.072920:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862902528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560818.072934:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f35386 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3538d expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560818.072943:0:17170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f35386 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f3538d expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560818.072988:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862902656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560818.073010:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560818.073032:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc47a3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787560818.073065:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862902656 00000100:00100000:3.0:1787560818.073069:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862902656 00000100:00100000:3.0:1787560818.073117:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787560818.073124:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:17170:x1874392862902656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560818.073213:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:17170:x1874392862902656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560818.073220:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787560818.073352:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862902656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560818.073374:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862902784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560818.073406:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560818.073617:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc47a3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787560818.074095:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862902784 00000100:00100000:3.0:1787560818.074100:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862902784 00000100:00100000:3.0:1787560818.074133:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787560818.074139:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:17170:x1874392862902784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787560818.074222:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:17170:x1874392862902784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560818.074229:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787560818.074293:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f08f2f56-c18f-4579-88a9-05007f76ffc9:17170:1874392862902784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787560818.086717:0:20269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787560818.086935:0:17170:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787560818.086957:0:17170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787560818.086968:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f35386 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3538d expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560818.086981:0:17170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f35386 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3538d expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560818.250464:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560818.751457:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862902912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787560818.751531:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560818.754754:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862902912 00000100:00100000:2.0:1787560818.754772:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862902912 00000100:00100000:2.0:1787560818.754849:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787560818.754862:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec398b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862902912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787560818.754900:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00080000:3.0:1787560818.755016:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787560818.761112:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec398b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862902912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6239us (9567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560818.761134:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787560818.761280:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862902912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787560819.202733:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560819.202782:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560819.202925:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853376384 00000100:00100000:2.0:1787560819.202936:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853376384 00000100:00100000:2.0:1787560819.203023:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 71 00000100:00100000:2.0:1787560819.203051:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3989180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5945945-1487-49fd-bee0-0dcced27d086+6:2404:x1874392853376384:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560819.203129:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3989180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5945945-1487-49fd-bee0-0dcced27d086+6:2404:x1874392853376384:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 83us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560819.203137:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 71 00000100:00100000:3.0:1787560819.203671:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853376640 00000100:00100000:3.0:1787560819.203677:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853376640 00000100:00100000:3.0:1787560819.203720:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:3.0:1787560819.203728:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5945945-1487-49fd-bee0-0dcced27d086+5:2404:x1874392853376640:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560819.203776:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5945945-1487-49fd-bee0-0dcced27d086+5:2404:x1874392853376640:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 49us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560819.203795:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00080000:0.0:1787560819.203977:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787560819.203982:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560819.205736:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560819.205827:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853376256 00000100:00100000:3.0:1787560819.205835:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853376256 00000100:00100000:3.0:1787560819.205890:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 172 00000100:00100000:3.0:1787560819.205903:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+13:2405:x1874392853376256:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560819.206097:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+13:2405:x1874392853376256:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 195us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560819.206105:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 172 00000100:00100000:1.0:1787560819.210135:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560819.211150:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853376512 00000100:00100000:2.0:1787560819.211161:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853376512 00000100:00100000:2.0:1787560819.211240:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 72 00000100:00100000:2.0:1787560819.211252:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a5945945-1487-49fd-bee0-0dcced27d086+5:2405:x1874392853376512:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560819.211325:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a5945945-1487-49fd-bee0-0dcced27d086+5:2405:x1874392853376512:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 76us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560819.211333:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 72 00000100:00080000:0.0:1787560819.212875:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787560819.228758:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560819.231754:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560819.231807:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560819.231878:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853377024 00000100:00100000:3.0:1787560819.231892:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853377024 00000100:00100000:3.0:1787560819.231990:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 73 00000100:00100000:3.0:1787560819.232001:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b0149ea-e230-42a7-990a-2401127b7ffb+5:2405:x1874392853377024:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560819.232081:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b0149ea-e230-42a7-990a-2401127b7ffb+5:2405:x1874392853377024:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 81us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560819.232090:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 73 00000100:00080000:1.0:1787560819.233326:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787560819.237254:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560819.237298:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560819.237356:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853376896 00000100:00100000:1.0:1787560819.237366:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853376896 00000100:00100000:1.0:1787560819.237427:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 74 00000100:00100000:1.0:1787560819.237449:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3beaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b0149ea-e230-42a7-990a-2401127b7ffb+6:2404:x1874392853376896:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560819.237515:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3beaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b0149ea-e230-42a7-990a-2401127b7ffb+6:2404:x1874392853376896:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 68us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560819.237522:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 74 00000100:00080000:1.0:1787560819.237542:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560819.245178:0:19050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853376768 00000100:00100000:2.0:1787560819.245195:0:19050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853376768 00000100:00100000:2.0:1787560819.245275:0:19050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853377280 00000100:00100000:2.0:1787560819.245279:0:19050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853377280 00000100:00100000:2.0:1787560819.245319:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:2.0:1787560819.245329:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5945945-1487-49fd-bee0-0dcced27d086+5:2405:x1874392853376768:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560819.245405:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5945945-1487-49fd-bee0-0dcced27d086+5:2405:x1874392853376768:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 77us (16659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560819.245412:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:2.0:1787560819.245447:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00100000:2.0:1787560819.245455:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1b0149ea-e230-42a7-990a-2401127b7ffb+5:2405:x1874392853377280:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560819.245479:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1b0149ea-e230-42a7-990a-2401127b7ffb+5:2405:x1874392853377280:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 25us (13673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560819.245486:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00080000:1.0:1787560819.245678:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787560819.253274:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853377152 00000100:00100000:2.0:1787560819.253291:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853377152 00000100:00100000:2.0:1787560819.253366:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 25 00000100:00100000:2.0:1787560819.253378:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3be8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1b0149ea-e230-42a7-990a-2401127b7ffb+5:2404:x1874392853377152:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560819.253476:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3be8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1b0149ea-e230-42a7-990a-2401127b7ffb+5:2404:x1874392853377152:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 100us (16177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560819.253484:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 25 00010000:00010000:1.0:1787560819.253573:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787560819.254283:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787560820.275940:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560820.485118:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560820.485295:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853377408 00000100:00100000:3.0:1787560820.485306:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853377408 00000100:00100000:3.0:1787560820.485395:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:3.0:1787560820.485406:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5945945-1487-49fd-bee0-0dcced27d086+6:15590:x1874392853377408:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787560820.485426:0:17173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560820.485484:0:17173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f35394 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf460600ff expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.485555:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f3539b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.485879:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f3539b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.485894:0:17173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f3539b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.485913:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.485920:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.485925:0:17173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.486016:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6c00/0x4642c20bf2f353a9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.486145:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6c00/0x4642c20bf2f353a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.486154:0:17173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6c00/0x4642c20bf2f353a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560820.486186:0:17173:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787560820.486189:0:17173:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787560820.486229:0:17173:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6c00/0x4642c20bf2f353a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.486240:0:17173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f3539b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.486257:0:17173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f3539b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.486263:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f3539b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.486268:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6400 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560820.486272:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f3539b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.486279:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f3539b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.486291:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafd8703100) 00010000:00010000:3.0:1787560820.486294:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560820.486298:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f3539b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.486304:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f3539b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.486316:0:17173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.486322:0:17173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.486328:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.486333:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6a00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560820.486343:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.486350:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353a2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.486358:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9cafe14b4400) 00010000:00010000:3.0:1787560820.486360:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560820.486363:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353a2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.486368:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.486416:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f35394 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460600ff expref: 8 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.486470:0:17173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6c00/0x4642c20bf2f353a9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460600ff expref: 7 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.486478:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cafe14b4f00) 00010000:00010000:3.0:1787560820.486480:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787560820.486483:0:17173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f6c00, rc 0) 00000100:00100000:3.0:1787560820.486549:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5945945-1487-49fd-bee0-0dcced27d086+7:15590:x1874392853377408:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 1144us (1440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560820.486556:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:1.0:1787560820.498746:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560820.499286:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853377536 00000100:00100000:2.0:1787560820.499300:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853377536 00000100:00100000:2.0:1787560820.499376:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:2.0:1787560820.499388:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a5945945-1487-49fd-bee0-0dcced27d086+7:15590:x1874392853377536:12345-192.168.203.29@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787560820.499544:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a5945945-1487-49fd-bee0-0dcced27d086+7:15590:x1874392853377536:12345-192.168.203.29@tcp:900:lhsmtool_posix.0 Request processed in 158us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560820.499553:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:0.0:1787560820.503331:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560820.503562:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853377792 00000100:00100000:3.0:1787560820.503571:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853377792 00000100:00100000:3.0:1787560820.503694:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00100000:3.0:1787560820.503706:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3be9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5945945-1487-49fd-bee0-0dcced27d086+7:15590:x1874392853377792:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787560820.503742:0:18203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560820.503761:0:18203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f353b0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf46060106 expref: -99 pid: 18203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.503843:0:18203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353b7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.503856:0:18203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.503866:0:18203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.503920:0:18203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f353be lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.503926:0:18203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f353be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.503933:0:18203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f353be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.504034:0:18203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7400/0x4642c20bf2f353c5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.504041:0:18203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7400/0x4642c20bf2f353c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.504048:0:18203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7400/0x4642c20bf2f353c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560820.504057:0:18203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1787560820.504197:0:18203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.504204:0:18203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353b7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.504210:0:18203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353b7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.504216:0:18203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6a00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560820.504220:0:18203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353b7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.504227:0:18203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353b7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.504238:0:18203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cafe14b4f00) 00010000:00010000:3.0:1787560820.504240:0:18203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560820.504244:0:18203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353b7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.504249:0:18203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353b7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.504262:0:18203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f353be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.504267:0:18203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f353be lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.504273:0:18203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f353be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.504288:0:18203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6400 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560820.504292:0:18203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f353be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.504297:0:18203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f353be lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.504304:0:18203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9cafe14b4400) 00010000:00010000:3.0:1787560820.504306:0:18203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560820.504309:0:18203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f353be lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.504314:0:18203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f353be lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.507824:0:18203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f353b0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060106 expref: 10 pid: 18203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.507860:0:18203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7400/0x4642c20bf2f353c5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060106 expref: 9 pid: 18203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.507870:0:18203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cafe14b4300) 00010000:00010000:3.0:1787560820.507873:0:18203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560820.507877:0:18203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f7400, rc 0) 00000100:00100000:3.0:1787560820.507975:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3be9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5945945-1487-49fd-bee0-0dcced27d086+9:15590:x1874392853377792:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 4271us (4652us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787560820.507985:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00100000:1.0:1787560820.517974:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560820.518188:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853377920 00000100:00100000:2.0:1787560820.518200:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853377920 00000100:00100000:2.0:1787560820.518265:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 25 00000100:00100000:2.0:1787560820.518277:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a5945945-1487-49fd-bee0-0dcced27d086+9:15590:x1874392853377920:12345-192.168.203.29@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787560820.518389:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a5945945-1487-49fd-bee0-0dcced27d086+9:15590:x1874392853377920:12345-192.168.203.29@tcp:59:lhsmtool_posix.0 Request processed in 114us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560820.518397:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 25 00000100:00100000:0.0:1787560820.523369:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560820.523526:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853378048 00000100:00100000:3.0:1787560820.523550:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853378048 00000100:00100000:3.0:1787560820.523615:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 26 00000100:00100000:3.0:1787560820.523628:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5945945-1487-49fd-bee0-0dcced27d086+5:15590:x1874392853378048:12345-192.168.203.29@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1787560820.528404:0:17173:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4717us 00000100:00100000:3.0:1787560820.556765:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5945945-1487-49fd-bee0-0dcced27d086+5:15590:x1874392853378048:12345-192.168.203.29@tcp:59:lhsmtool_posix.0 Request processed in 33126us (33395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560820.556781:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 26 00000100:00100000:0.0:1787560820.577695:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560820.579514:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853378176 00000100:00100000:3.0:1787560820.579543:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853378176 00000100:00100000:3.0:1787560820.579745:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 27 00000100:00100000:3.0:1787560820.579762:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3be9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5945945-1487-49fd-bee0-0dcced27d086+9:15596:x1874392853378176:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1787560820.579801:0:18203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560820.579845:0:18203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f353d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4606010d expref: -99 pid: 18203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.580111:0:18203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f353da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.580132:0:18203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f353da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.580148:0:18203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f353da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.580167:0:18203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.580175:0:18203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.580182:0:18203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.580407:0:18203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f353da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.580416:0:18203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f353da lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.580423:0:18203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f353da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.580859:0:18203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6400 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560820.580867:0:18203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f353da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.580877:0:18203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f353da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.580895:0:18203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafd8703100) 00010000:00010000:3.0:1787560820.580898:0:18203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560820.580904:0:18203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f353da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.580910:0:18203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f353da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.581297:0:18203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.581308:0:18203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.581315:0:18203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.581336:0:18203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6a00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560820.581340:0:18203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.581347:0:18203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.581357:0:18203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cafe14b4400) 00010000:00010000:3.0:1787560820.581360:0:18203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560820.581363:0:18203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.581370:0:18203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.581474:0:18203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f353d3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606010d expref: 10 pid: 18203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.581490:0:18203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafd8703100) 00010000:00010000:3.0:1787560820.581493:0:18203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560820.581501:0:18203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f353d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606010d expref: 10 pid: 18203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.581516:0:18203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f7200, rc 0) 00000100:00100000:3.0:1787560820.581974:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3be9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5945945-1487-49fd-bee0-0dcced27d086+9:15596:x1874392853378176:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 2213us (4282us total) trans 0 rc 301/301 00000100:00100000:3.0:1787560820.581986:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 27 00000100:00100000:0.0:1787560820.587718:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560820.587856:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853378304 00000100:00100000:2.0:1787560820.587874:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853378304 00000100:00100000:2.0:1787560820.587960:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:2.0:1787560820.587972:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a5945945-1487-49fd-bee0-0dcced27d086+9:15596:x1874392853378304:12345-192.168.203.29@tcp:700:lfs.0 00000100:00100000:2.0:1787560820.588096:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a5945945-1487-49fd-bee0-0dcced27d086+9:15596:x1874392853378304:12345-192.168.203.29@tcp:700:lfs.0 Request processed in 127us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560820.588104:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:0.0:1787560820.591167:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560820.591364:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853378560 00000100:00100000:3.0:1787560820.591398:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853378560 00000100:00100000:3.0:1787560820.591533:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 28 00000100:00100000:3.0:1787560820.591547:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5945945-1487-49fd-bee0-0dcced27d086+9:15596:x1874392853378560:12345-192.168.203.29@tcp:36:lfs.0 00010000:00010000:3.0:1787560820.591659:0:17175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560820.591706:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49800/0x4642c20bf2f35301 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606007a expref: 9 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.591734:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafd8703100) 00010000:00010000:3.0:1787560820.591742:0:17175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787560820.591828:0:17175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f353e8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.591845:0:17175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff400/0x4642c20bf2f35340 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460600ea expref: 5 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.591856:0:17175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f353e8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.591902:0:17175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff400/0x4642c20bf2f35340 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460600ea expref: 5 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.591921:0:17175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff400/0x4642c20bf2f35340 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460600ea expref: 5 pid: 19968 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560820.591939:0:17175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3901880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17175:1874392862903040:192.168.203.29@tcp:104: 00000100:00100000:3.0:1787560820.592050:0:17175:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe0790a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787560820.596417:0:17175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3901880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17175:1874392862903040:192.168.203.29@tcp:104: 00010000:00010000:3.0:1787560820.596556:0:17175:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f353e8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560820.603385:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560820.603572:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853378688 00000100:00100000:3.0:1787560820.603590:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853378688 00010000:00010000:3.0:1787560820.603644:0:17158:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff400/0x4642c20bf2f35340 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460600ea expref: 6 pid: 19968 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560820.603692:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00100000:3.0:1787560820.603702:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1b0149ea-e230-42a7-990a-2401127b7ffb+6:2404:x1874392853378688:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560820.603716:0:17158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560820.603722:0:17158:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff400/0x4642c20bf2f35340 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460600ea expref: 6 pid: 19968 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.603735:0:17158:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff400/0x4642c20bf2f35340 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460600ea expref: 6 pid: 19968 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.603757:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff400/0x4642c20bf2f35340 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460600ea expref: 6 pid: 19968 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.603771:0:17158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafd8703100) 00010000:00010000:3.0:1787560820.603777:0:17158:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f353e8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.603786:0:17158:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f353e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.603794:0:17158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f353e8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.603837:0:17158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560820.603902:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1b0149ea-e230-42a7-990a-2401127b7ffb+5:2404:x1874392853378688:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 200us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560820.603910:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 15 00010000:00010000:2.0:1787560820.604178:0:17175:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f353e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.604187:0:17175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f353e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.604211:0:17175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f353ef lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.604221:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f353ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.604229:0:17175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f353ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.612640:0:17175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353f6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.612674:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.612687:0:17175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787560820.612729:0:17175:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a7b65f6 reply state 00000000d0aa963e transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.612742:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.612749:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cafe14b4400) 00010000:00010000:3.0:1787560820.612751:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787560820.612756:0:17175:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787560820.612762:0:17175:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787560820.612780:0:17175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f353e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.612787:0:17175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f353e8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.612793:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f353e8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.612799:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560820.612804:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f353e8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.613209:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f353e8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.613219:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafd8703100) 00010000:00010000:3.0:1787560820.613222:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560820.613226:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f353e8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.613232:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f353e8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787560820.613256:0:17175:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a7b65f6 reply state 00000000d0aa963e transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f353ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.613265:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f353ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.613271:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cafd8703400) 00010000:00010000:3.0:1787560820.613273:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787560820.613275:0:17175:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787560820.613388:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5945945-1487-49fd-bee0-0dcced27d086+10:15596:x1874392853378560:12345-192.168.203.29@tcp:36:lfs.0 Request processed in 21838us (22230us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787560820.613398:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 28 00000100:00100000:0.0:1787560820.745368:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560820.745775:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853378816 00000100:00100000:3.0:1787560820.745787:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853378816 00000100:00100000:3.0:1787560820.745861:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 29 00000100:00100000:3.0:1787560820.745873:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5945945-1487-49fd-bee0-0dcced27d086+10:15604:x1874392853378816:12345-192.168.203.29@tcp:101:lctl.0 00010000:00010000:3.0:1787560820.745898:0:17173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560820.745923:0:17173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f353fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf46060114 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.746021:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f35404 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.746037:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f35404 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.746054:0:17173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f35404 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560820.746109:0:17173:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787560820.746114:0:17173:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787560820.746175:0:17173:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f35404 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.746203:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f353fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060114 expref: 12 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.746224:0:17173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f35404 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060114 expref: 11 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.746233:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafe14b4800) 00010000:00010000:3.0:1787560820.746236:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787560820.746241:0:17173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f6400, rc 0) 00000100:00100000:3.0:1787560820.746322:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5945945-1487-49fd-bee0-0dcced27d086+11:15604:x1874392853378816:12345-192.168.203.29@tcp:101:lctl.0 Request processed in 451us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560820.746329:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 29 00000100:00100000:1.0:1787560820.770322:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560820.770408:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853378944 00000100:00100000:3.0:1787560820.770418:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853378944 00000100:00100000:2.0:1787560820.771417:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 30 00000100:00100000:2.0:1787560820.771455:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b0149ea-e230-42a7-990a-2401127b7ffb+5:15605:x1874392853378944:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1787560820.771550:0:18203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560820.771573:0:18203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48c00/0x4642c20bf2f3540b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4606011b expref: -99 pid: 18203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.771635:0:18203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48000/0x4642c20bf2f35412 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.771648:0:18203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48000/0x4642c20bf2f35412 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.771747:0:18203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48000/0x4642c20bf2f35412 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560820.771790:0:18203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787560820.771794:0:18203:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787560820.771950:0:18203:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48000/0x4642c20bf2f35412 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.771975:0:18203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48c00/0x4642c20bf2f3540b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606011b expref: 7 pid: 18203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.771994:0:18203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48000/0x4642c20bf2f35412 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606011b expref: 6 pid: 18203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.772003:0:18203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafe14b4800) 00010000:00010000:2.0:1787560820.772005:0:18203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787560820.772009:0:18203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca48000, rc 0) 00000100:00100000:2.0:1787560820.772216:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b0149ea-e230-42a7-990a-2401127b7ffb+6:15605:x1874392853378944:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 788us (1903us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560820.772223:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 30 00000100:00100000:1.0:1787560820.783721:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560820.783805:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853379072 00000100:00100000:3.0:1787560820.783889:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853379072 00000100:00100000:3.0:1787560820.783955:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 31 00000100:00100000:3.0:1787560820.783964:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b0149ea-e230-42a7-990a-2401127b7ffb+6:15605:x1874392853379072:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1787560820.783985:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560820.784004:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f35419 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf46060122 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.784068:0:17175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f35420 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.784082:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f35420 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.784093:0:17175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f35420 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.784105:0:17175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f35427 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.784112:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f35427 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.784118:0:17175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f35427 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.784187:0:17175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f3542e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.784196:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f3542e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.784219:0:17175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f3542e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560820.784254:0:17175:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787560820.784258:0:17175:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787560820.784276:0:17175:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f3542e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.784287:0:17175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f35420 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.784293:0:17175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f35420 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.784299:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f35420 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.784306:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7e00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560820.784310:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f35420 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.784317:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f35420 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.784329:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafe14b4800) 00010000:00010000:3.0:1787560820.784332:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560820.784336:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f35420 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.784342:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f35420 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.784366:0:17175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f35427 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.784373:0:17175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f35427 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.784379:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f35427 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.784384:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6e00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560820.784387:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f35427 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.784393:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f35427 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.784400:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cafd8703400) 00010000:00010000:3.0:1787560820.784403:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560820.784406:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f35427 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.784412:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f35427 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.786467:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f35419 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060122 expref: 8 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.786499:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f3542e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060122 expref: 7 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.786530:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cafe14b4400) 00010000:00010000:3.0:1787560820.786533:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787560820.786536:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb002176200, rc 0) 00000100:00100000:3.0:1787560820.786647:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b0149ea-e230-42a7-990a-2401127b7ffb+7:15605:x1874392853379072:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 2682us (2933us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560820.786666:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 31 00000100:00100000:0.0:1787560820.797739:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560820.798043:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853379200 00000100:00100000:2.0:1787560820.798060:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853379200 00000100:00100000:2.0:1787560820.798132:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:2.0:1787560820.798147:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1b0149ea-e230-42a7-990a-2401127b7ffb+5:15605:x1874392853379200:12345-192.168.203.29@tcp:900:lfs.0 00000100:00100000:2.0:1787560820.798255:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1b0149ea-e230-42a7-990a-2401127b7ffb+5:15605:x1874392853379200:12345-192.168.203.29@tcp:900:lfs.0 Request processed in 113us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560820.798263:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:1.0:1787560820.807171:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560820.807296:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853379456 00000100:00100000:2.0:1787560820.807309:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853379456 00000100:00100000:2.0:1787560820.807380:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 32 00000100:00100000:2.0:1787560820.807392:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1b0149ea-e230-42a7-990a-2401127b7ffb+7:15605:x1874392853379456:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1787560820.807413:0:19968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560820.807479:0:19968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48c00/0x4642c20bf2f35435 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf46060129 expref: -99 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560820.807603:0:19968:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787560820.807741:0:19968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48c00/0x4642c20bf2f35435 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060129 expref: 9 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.807755:0:19968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafe14b4800) 00010000:00010000:2.0:1787560820.807758:0:19968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787560820.807763:0:19968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48c00/0x4642c20bf2f35435 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060129 expref: 9 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.807780:0:19968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca48c00, rc 0) 00000100:00100000:2.0:1787560820.807848:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1b0149ea-e230-42a7-990a-2401127b7ffb+8:15605:x1874392853379456:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 458us (690us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1787560820.807855:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 32 00000100:00100000:1.0:1787560820.811982:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560820.812177:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853379712 00000100:00100000:2.0:1787560820.812188:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853379712 00000100:00100000:2.0:1787560820.812285:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 33 00000100:00100000:2.0:1787560820.812301:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b0149ea-e230-42a7-990a-2401127b7ffb+8:15605:x1874392853379712:12345-192.168.203.29@tcp:36:lfs.0 00010000:00010000:2.0:1787560820.812380:0:18203:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560820.812414:0:18203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f3542e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060122 expref: 8 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.812619:0:18203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cafe14b4400) 00010000:00010000:2.0:1787560820.812626:0:18203:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787560820.812664:0:18203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48400/0x4642c20bf2f35443 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.812677:0:18203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48400/0x4642c20bf2f35443 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.812687:0:18203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48400/0x4642c20bf2f35443 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787560820.812945:0:18203:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002612dc2c reply state 0000000034e38c71 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48400/0x4642c20bf2f35443 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.812960:0:18203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48400/0x4642c20bf2f35443 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.812967:0:18203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cafe14b4400) 00010000:00010000:2.0:1787560820.812969:0:18203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1787560820.812972:0:18203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787560820.812980:0:18203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787560820.813192:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b0149ea-e230-42a7-990a-2401127b7ffb+9:15605:x1874392853379712:12345-192.168.203.29@tcp:36:lfs.0 Request processed in 894us (1224us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787560820.813209:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 33 00000100:00100000:0.0:1787560820.827134:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560820.827228:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853379968 00000100:00100000:2.0:1787560820.827241:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853379968 00000100:00100000:2.0:1787560820.827311:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:2.0:1787560820.827323:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1b0149ea-e230-42a7-990a-2401127b7ffb+9:15605:x1874392853379968:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:2.0:1787560820.827589:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1b0149ea-e230-42a7-990a-2401127b7ffb+10:15605:x1874392853379968:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 255us (454us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787560820.827610:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:1.0:1787560820.830857:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560820.830986:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853380224 00000100:00100000:3.0:1787560820.831005:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853380224 00000100:00100000:3.0:1787560820.831097:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 34 00000100:00100000:3.0:1787560820.831111:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeabab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b0149ea-e230-42a7-990a-2401127b7ffb+10:15605:x1874392853380224:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1787560820.831159:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560820.831193:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f3544a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf46060130 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.831319:0:17175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f35451 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.831339:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f35451 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.831355:0:17175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f35451 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.831372:0:17175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f35458 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.831379:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f35458 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.831408:0:17175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f35458 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560820.831927:0:17175:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787560820.832030:0:17175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f35451 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.832038:0:17175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f35451 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.832045:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f35451 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.832049:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb002176600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560820.832054:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f35451 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.832060:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f35451 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.832076:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafe14b4800) 00010000:00010000:3.0:1787560820.832079:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560820.832084:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f35451 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.832090:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f35451 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.832107:0:17175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f35458 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.832127:0:17175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f35458 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.832132:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f35458 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.832137:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560820.832140:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f35458 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.832146:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f35458 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.832153:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cafd8703400) 00010000:00010000:3.0:1787560820.832157:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560820.832160:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f35458 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.832166:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f35458 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.832211:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f3544a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060130 expref: 12 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.832223:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafe14b4800) 00010000:00010000:3.0:1787560820.832226:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787560820.832230:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f3544a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060130 expref: 12 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.832254:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb002177800, rc 0) 00000100:00100000:3.0:1787560820.832522:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeabab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b0149ea-e230-42a7-990a-2401127b7ffb+11:15605:x1874392853380224:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 1413us (1681us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1787560820.832531:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 34 00000100:00100000:3.0:1787560820.838992:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560820.839115:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853380352 00000100:00100000:1.0:1787560820.839135:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853380352 00000100:00100000:3.0:1787560820.839292:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 35 00000100:00100000:3.0:1787560820.839308:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3901880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b0149ea-e230-42a7-990a-2401127b7ffb+11:15605:x1874392853380352:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1787560820.839353:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560820.839389:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f35466 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf46060137 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.841268:0:17174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f3546d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.841297:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f3546d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.841312:0:17174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f3546d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560820.841348:0:17174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787560820.841353:0:17174:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787560820.841381:0:17174:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f3546d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.841853:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f35466 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060137 expref: 13 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.841902:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f3546d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060137 expref: 12 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.841912:0:17174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cafe14b4400) 00010000:00010000:3.0:1787560820.841915:0:17174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787560820.841919:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f7e00, rc 0) 00000100:00100000:3.0:1787560820.842184:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3901880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b0149ea-e230-42a7-990a-2401127b7ffb+12:15605:x1874392853380352:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 2878us (3262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560820.842195:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 35 00000100:00100000:0.0:1787560820.847051:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560820.847140:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853380480 00000100:00100000:2.0:1787560820.847153:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853380480 00000100:00100000:2.0:1787560820.847251:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:2.0:1787560820.847263:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1b0149ea-e230-42a7-990a-2401127b7ffb+12:15605:x1874392853380480:12345-192.168.203.29@tcp:37:lfs.0 00000100:00100000:2.0:1787560820.856497:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1b0149ea-e230-42a7-990a-2401127b7ffb+12:15605:x1874392853380480:12345-192.168.203.29@tcp:37:lfs.0 Request processed in 9218us (9442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560820.856516:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:1.0:1787560820.860803:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560820.861084:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853380736 00000100:00100000:2.0:1787560820.861100:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853380736 00000100:00100000:2.0:1787560820.861187:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:2.0:1787560820.861201:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec325d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1b0149ea-e230-42a7-990a-2401127b7ffb+12:15605:x1874392853380736:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:2.0:1787560820.861546:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec325d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1b0149ea-e230-42a7-990a-2401127b7ffb+13:15605:x1874392853380736:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 347us (967us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787560820.861556:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 4 00000040:00080000:2.0:1787560820.916335:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787560820.918536:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560820.921140:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853380864 00000100:00100000:2.0:1787560820.921158:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853380864 00000100:00100000:2.0:1787560820.921246:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 36 00000100:00100000:2.0:1787560820.921843:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeabaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5945945-1487-49fd-bee0-0dcced27d086+11:15611:x1874392853380864:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:2.0:1787560820.921865:0:18203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560820.921889:0:18203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48c00/0x4642c20bf2f35474 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4606013e expref: -99 pid: 18203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.921954:0:18203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49a00/0x4642c20bf2f3547b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.921993:0:18203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49a00/0x4642c20bf2f3547b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.922006:0:18203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49a00/0x4642c20bf2f3547b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.922020:0:18203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35482 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.922026:0:18203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35482 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.922032:0:18203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35482 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.922111:0:18203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49800/0x4642c20bf2f35489 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.922120:0:18203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49800/0x4642c20bf2f35489 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.922127:0:18203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49800/0x4642c20bf2f35489 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560820.922161:0:18203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787560820.922165:0:18203:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787560820.922202:0:18203:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49800/0x4642c20bf2f35489 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.922215:0:18203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49a00/0x4642c20bf2f3547b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.922231:0:18203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49a00/0x4642c20bf2f3547b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.922237:0:18203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49a00/0x4642c20bf2f3547b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.922243:0:18203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49a00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560820.922247:0:18203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49a00/0x4642c20bf2f3547b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.922253:0:18203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49a00/0x4642c20bf2f3547b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.922264:0:18203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafe14b4800) 00010000:00010000:2.0:1787560820.922268:0:18203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560820.922272:0:18203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49a00/0x4642c20bf2f3547b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.922279:0:18203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49a00/0x4642c20bf2f3547b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.922293:0:18203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35482 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.922299:0:18203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35482 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.922305:0:18203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35482 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.922310:0:18203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560820.922318:0:18203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35482 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.922324:0:18203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35482 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.922332:0:18203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cafd8703400) 00010000:00010000:2.0:1787560820.922335:0:18203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560820.922338:0:18203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35482 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.922344:0:18203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35482 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.922371:0:18203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48c00/0x4642c20bf2f35474 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606013e expref: 13 pid: 18203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.922385:0:18203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49800/0x4642c20bf2f35489 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606013e expref: 12 pid: 18203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.922392:0:18203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cafe14b4400) 00010000:00010000:2.0:1787560820.922394:0:18203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787560820.922397:0:18203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca49800, rc 0) 00000100:00100000:2.0:1787560820.922514:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeabaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5945945-1487-49fd-bee0-0dcced27d086+12:15611:x1874392853380864:12345-192.168.203.29@tcp:101:bash.0 Request processed in 1257us (3986us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560820.922522:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 36 00000100:00100000:1.0:1787560820.926263:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560820.926385:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853380992 00000100:00100000:0.0:1787560820.926400:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853380992 00000100:00100000:0.0:1787560820.926535:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:0.0:1787560820.926549:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a5945945-1487-49fd-bee0-0dcced27d086+5:15611:x1874392853380992:12345-192.168.203.29@tcp:900:bash.0 00000100:00100000:0.0:1787560820.926677:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a5945945-1487-49fd-bee0-0dcced27d086+5:15611:x1874392853380992:12345-192.168.203.29@tcp:900:bash.0 Request processed in 131us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560820.926705:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:3.0:1787560820.931588:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560820.931734:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853381248 00000100:00100000:2.0:1787560820.931751:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853381248 00000100:00100000:2.0:1787560820.931864:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 37 00000100:00100000:2.0:1787560820.931880:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3903800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5945945-1487-49fd-bee0-0dcced27d086+12:15611:x1874392853381248:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:2.0:1787560820.931930:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560820.931959:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48c00/0x4642c20bf2f35490 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf46060145 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.932121:0:17175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35497 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.932141:0:17175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f3546d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060137 expref: 12 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.932152:0:17175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35497 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.932201:0:17175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f3546d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060137 expref: 12 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.932218:0:17175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f3546d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060137 expref: 12 pid: 17174 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560820.932237:0:17175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaaad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17175:1874392862903168:192.168.203.29@tcp:104: 00000100:00100000:2.0:1787560820.932353:0:17175:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd84bb900 going to sleep for 11 seconds 00000100:00100000:3.0:1787560820.940426:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560820.941471:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853381376 00000100:00100000:1.0:1787560820.941487:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853381376 00010000:00010000:1.0:1787560820.941557:0:17160:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f3546d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060137 expref: 13 pid: 17174 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560820.941819:0:17175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaaad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17175:1874392862903168:192.168.203.29@tcp:104: 00010000:00010000:2.0:1787560820.941851:0:17175:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35497 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560820.942153:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:3.0:1787560820.942173:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3900000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1b0149ea-e230-42a7-990a-2401127b7ffb+13:2405:x1874392853381376:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560820.942195:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560820.942205:0:17159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f3546d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060137 expref: 13 pid: 17174 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.942220:0:17159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f3546d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060137 expref: 13 pid: 17174 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.942542:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f3546d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060137 expref: 13 pid: 17174 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.942564:0:17159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cafe14b4400) 00010000:00010000:3.0:1787560820.942570:0:17159:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35497 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.942683:0:17159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35497 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.942693:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35497 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.942728:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560820.942809:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3900000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1b0149ea-e230-42a7-990a-2401127b7ffb+12:2405:x1874392853381376:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 640us (2397us total) trans 0 rc 0/0 00010000:00010000:2.0:1787560820.942840:0:17175:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35497 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.942850:0:17175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35497 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.942887:0:17175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49a00/0x4642c20bf2f3549e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.942898:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49a00/0x4642c20bf2f3549e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560820.942908:0:17175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49a00/0x4642c20bf2f3549e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560820.945111:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 16 00010000:00010000:0.0:1787560820.945995:0:17175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f354a5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560820.946019:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f354a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560820.946032:0:17175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f354a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560820.946046:0:17175:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787560820.946086:0:17175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35497 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560820.946094:0:17175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35497 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560820.946102:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35497 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560820.946109:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560820.946114:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35497 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560820.946122:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35497 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560820.946137:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cafe14b4400) 00010000:00010000:0.0:1787560820.946141:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560820.946146:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35497 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560820.946179:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35497 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787560820.946199:0:17175:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000347b125a reply state 00000000ed981e36 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49a00/0x4642c20bf2f3549e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560820.946212:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49a00/0x4642c20bf2f3549e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560820.946231:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9cafd8703500) 00010000:00010000:0.0:1787560820.946234:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787560820.946238:0:17175:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787560820.946285:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48c00/0x4642c20bf2f35490 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060145 expref: 15 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560820.946303:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f354a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060145 expref: 14 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560820.946311:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:0.0:1787560820.946314:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1787560820.946317:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbfee00, rc 0) 00000100:00100000:0.0:1787560820.946419:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3903800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5945945-1487-49fd-bee0-0dcced27d086+15:15611:x1874392853381248:12345-192.168.203.29@tcp:101:bash.0 Request processed in 14542us (14851us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1787560820.946450:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 37 00000100:00100000:1.0:1787560820.960555:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560820.960987:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853381504 00000100:00100000:3.0:1787560820.961002:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853381504 00000100:00100000:3.0:1787560820.961156:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 38 00000100:00100000:3.0:1787560820.961172:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5945945-1487-49fd-bee0-0dcced27d086+15:15611:x1874392853381504:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:3.0:1787560820.961211:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560820.961248:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f354b3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4606014c expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.961361:0:17174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f354ba lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.961380:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f354ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560820.961396:0:17174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f354ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560820.961544:0:17174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787560820.961550:0:17174:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787560820.961697:0:17174:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f354ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560820.961715:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f354ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560820.961765:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f354b3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606014c expref: 17 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560820.961792:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f354ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606014c expref: 16 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560820.961803:0:17174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:0.0:1787560820.961806:0:17174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787560820.961811:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f6e00, rc 0) 00000100:00100000:0.0:1787560820.961925:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5945945-1487-49fd-bee0-0dcced27d086+16:15611:x1874392853381504:12345-192.168.203.29@tcp:101:bash.0 Request processed in 756us (1384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560820.961932:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 38 00000100:00100000:1.0:1787560820.964554:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560820.964904:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853381760 00000100:00100000:2.0:1787560820.964920:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853381760 00000100:00100000:2.0:1787560820.965053:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:2.0:1787560820.965068:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a5945945-1487-49fd-bee0-0dcced27d086+16:15611:x1874392853381760:12345-192.168.203.29@tcp:35:bash.0 00000100:00100000:2.0:1787560820.965561:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a5945945-1487-49fd-bee0-0dcced27d086+17:15611:x1874392853381760:12345-192.168.203.29@tcp:35:bash.0 Request processed in 493us (1019us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1787560820.965570:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:1.0:1787560821.047806:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560821.047918:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853382016 00000100:00100000:2.0:1787560821.047934:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853382016 00000100:00100000:2.0:1787560821.048028:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 39 00000100:00100000:2.0:1787560821.048042:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeabaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a5945945-1487-49fd-bee0-0dcced27d086+17:15621:x1874392853382016:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1787560821.048086:0:19968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560821.048114:0:19968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48200/0x4642c20bf2f354c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf46060153 expref: -99 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560821.048239:0:19968:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787560821.048358:0:19968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48200/0x4642c20bf2f354c1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060153 expref: 19 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560821.048399:0:19968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafe14b4800) 00010000:00010000:2.0:1787560821.048402:0:19968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787560821.048407:0:19968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48200/0x4642c20bf2f354c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060153 expref: 19 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560821.048426:0:19968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca48200, rc 0) 00000100:00100000:2.0:1787560821.048558:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeabaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a5945945-1487-49fd-bee0-0dcced27d086+18:15621:x1874392853382016:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 519us (768us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1787560821.048567:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 39 00000100:00080000:0.0:1787560821.048659:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560821.059747:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560821.060046:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853382272 00000100:00100000:3.0:1787560821.060060:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853382272 00000100:00100000:3.0:1787560821.060248:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:3.0:1787560821.060260:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a5945945-1487-49fd-bee0-0dcced27d086+18:15621:x1874392853382272:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:3.0:1787560821.060659:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a5945945-1487-49fd-bee0-0dcced27d086+19:15621:x1874392853382272:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 392us (921us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787560821.060669:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:1.0:1787560821.104559:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560821.104950:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853382528 00000100:00100000:0.0:1787560821.104966:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853382528 00000100:00100000:0.0:1787560821.105052:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 40 00000100:00100000:0.0:1787560821.105156:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5945945-1487-49fd-bee0-0dcced27d086+19:15624:x1874392853382528:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:0.0:1787560821.105190:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560821.105219:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe600/0x4642c20bf2f354cf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4606015a expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560821.105708:0:17175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe800/0x4642c20bf2f354d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560821.105729:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe800/0x4642c20bf2f354d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560821.105743:0:17175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe800/0x4642c20bf2f354d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560821.105776:0:17175:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787560821.107774:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe600/0x4642c20bf2f354cf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606015a expref: 22 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787560821.109727:0:17927:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787560821.110269:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe800/0x4642c20bf2f354d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606015a expref: 21 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560821.110286:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:0.0:1787560821.110290:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787560821.110294:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbfe800, rc 0) 00000100:00100000:0.0:1787560821.110400:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5945945-1487-49fd-bee0-0dcced27d086+21:15624:x1874392853382528:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 5335us (5857us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787560821.110411:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 40 00000100:00100000:1.0:1787560821.121209:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560821.121268:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560821.121321:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853382656 00000100:00100000:0.0:1787560821.121347:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853382656 00000100:00100000:0.0:1787560821.121469:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 41 00000100:00100000:0.0:1787560821.121483:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2006d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5945945-1487-49fd-bee0-0dcced27d086+21:15624:x1874392853382656:12345-192.168.203.29@tcp:54:lfs.0 00010000:00010000:0.0:1787560821.121586:0:17174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe600/0x4642c20bf2f354e4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560821.121608:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe600/0x4642c20bf2f354e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560821.121622:0:17174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe600/0x4642c20bf2f354e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560821.121678:0:17174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe600/0x4642c20bf2f354e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560821.121704:0:17174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe600/0x4642c20bf2f354e4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560821.121712:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe600/0x4642c20bf2f354e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560821.121719:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbfe600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560821.121725:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe600/0x4642c20bf2f354e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560821.121733:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe600/0x4642c20bf2f354e4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560821.121750:0:17174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:0.0:1787560821.121753:0:17174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787560821.121759:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe600/0x4642c20bf2f354e4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560821.121766:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe600/0x4642c20bf2f354e4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560821.121863:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2006d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5945945-1487-49fd-bee0-0dcced27d086+21:15624:x1874392853382656:12345-192.168.203.29@tcp:54:lfs.0 Request processed in 382us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560821.121871:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 41 00000100:00100000:3.0:1787560821.122121:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853382784 00000100:00100000:3.0:1787560821.122128:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853382784 00000100:00100000:3.0:1787560821.122182:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:3.0:1787560821.122191:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2004380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5945945-1487-49fd-bee0-0dcced27d086+21:2405:x1874392853382784:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560821.122205:0:17158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560821.122640:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe800/0x4642c20bf2f354d6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606015a expref: 21 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560821.122668:0:17158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:3.0:1787560821.122673:0:17158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560821.122720:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2004380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5945945-1487-49fd-bee0-0dcced27d086+20:2405:x1874392853382784:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 530us (1450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560821.122728:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:1.0:1787560821.129787:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560821.134139:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853383040 00000100:00100000:2.0:1787560821.134376:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853383040 00000100:00100000:2.0:1787560821.134506:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:2.0:1787560821.134524:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a5945945-1487-49fd-bee0-0dcced27d086+20:15624:x1874392853383040:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:2.0:1787560821.134893:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a5945945-1487-49fd-bee0-0dcced27d086+21:15624:x1874392853383040:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 373us (5120us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1787560821.134903:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00010000:00010000:1.0:1787560821.299907:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560821.374315:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560821.374423:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853383296 00000100:00100000:3.0:1787560821.374526:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853383296 00000100:00100000:3.0:1787560821.374739:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 42 00000100:00100000:3.0:1787560821.374756:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5945945-1487-49fd-bee0-0dcced27d086+21:15655:x1874392853383296:12345-192.168.203.29@tcp:101:cat.0 00010000:00010000:3.0:1787560821.374798:0:17173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560821.374863:0:17173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f354eb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf46060161 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560821.375034:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f354f2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560821.375053:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f354f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560821.375068:0:17173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f354f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560821.375086:0:17173:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787560821.375259:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f354eb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060161 expref: 24 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560821.375284:0:17173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f354f2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060161 expref: 23 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560821.375294:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:3.0:1787560821.375298:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787560821.375303:0:17173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f7e00, rc 0) 00000100:00100000:3.0:1787560821.375399:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5945945-1487-49fd-bee0-0dcced27d086+23:15655:x1874392853383296:12345-192.168.203.29@tcp:101:cat.0 Request processed in 647us (1100us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1787560821.375408:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 42 00000100:00100000:1.0:1787560821.378756:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560821.379020:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853383424 00000100:00100000:2.0:1787560821.379034:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853383424 00000100:00100000:2.0:1787560821.379262:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:2.0:1787560821.379277:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3baed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5945945-1487-49fd-bee0-0dcced27d086+23:2403:x1874392853383424:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560821.379297:0:17160:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560821.379328:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f354f2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060161 expref: 23 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560821.379352:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:2.0:1787560821.379376:0:17160:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560821.379503:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3baed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5945945-1487-49fd-bee0-0dcced27d086+22:2403:x1874392853383424:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 229us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560821.379513:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:1.0:1787560821.380860:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560821.381349:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853383680 00000100:00100000:0.0:1787560821.381361:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853383680 00000100:00100000:0.0:1787560821.381732:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:0.0:1787560821.381746:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a5945945-1487-49fd-bee0-0dcced27d086+22:15655:x1874392853383680:12345-192.168.203.29@tcp:35:cat.0 00000100:00100000:0.0:1787560821.382525:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a5945945-1487-49fd-bee0-0dcced27d086+23:15655:x1874392853383680:12345-192.168.203.29@tcp:35:cat.0 Request processed in 777us (1679us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1787560821.382555:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:1.0:1787560821.465366:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560821.465514:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853383936 00000100:00100000:0.0:1787560821.465528:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853383936 00000100:00100000:0.0:1787560821.465617:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 43 00000100:00100000:0.0:1787560821.465634:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5945945-1487-49fd-bee0-0dcced27d086+23:15661:x1874392853383936:12345-192.168.203.29@tcp:101:dd.0 00010000:00010000:0.0:1787560821.465686:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560821.465714:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe600/0x4642c20bf2f35500 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf46060168 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560821.465888:0:17175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe400/0x4642c20bf2f35507 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560821.465912:0:17175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f354a5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060145 expref: 24 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560821.465922:0:17175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f354ba lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606014c expref: 24 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560821.465933:0:17175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe400/0x4642c20bf2f35507 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560821.465987:0:17175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f354ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606014c expref: 24 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560821.466005:0:17175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f354ba lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606014c expref: 24 pid: 17174 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560821.466022:0:17175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2351c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17175:1874392862903296:192.168.203.29@tcp:104: 00010000:00010000:0.0:1787560821.466176:0:17175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f354a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060145 expref: 24 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560821.466185:0:17175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f354a5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060145 expref: 24 pid: 17175 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560821.466194:0:17175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2352680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17175:1874392862903424:192.168.203.29@tcp:104: 00000100:00100000:0.0:1787560821.466220:0:17175:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc17c1900 going to sleep for 11 seconds 00000100:00100000:1.0:1787560821.471329:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560821.471387:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560821.471485:0:17929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853384064 00000100:00100000:1.0:1787560821.471501:0:17929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853384064 00010000:00010000:1.0:1787560821.471575:0:17929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f354ba lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606014c expref: 25 pid: 17174 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560821.471634:0:17929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853384192 00000100:00100000:1.0:1787560821.471638:0:17929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853384192 00010000:00010000:1.0:1787560821.471663:0:17929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f354a5 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060145 expref: 26 pid: 17175 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560821.471688:0:17929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:1.0:1787560821.471700:0:17929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5945945-1487-49fd-bee0-0dcced27d086+26:2405:x1874392853384064:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560821.471720:0:17929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560821.471728:0:17929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f354ba lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606014c expref: 26 pid: 17174 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.471744:0:17929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f354ba lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606014c expref: 26 pid: 17174 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.471783:0:17929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:1.0:1787560821.471791:0:17929:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe400/0x4642c20bf2f35507 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.471826:0:17929:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe400/0x4642c20bf2f35507 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.471834:0:17929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560821.471917:0:17929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5945945-1487-49fd-bee0-0dcced27d086+26:2405:x1874392853384064:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 218us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560821.471926:0:17929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:1.0:1787560821.471948:0:17929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:1.0:1787560821.471955:0:17929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafefdc9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5945945-1487-49fd-bee0-0dcced27d086+25:2405:x1874392853384192:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560821.471963:0:17929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560821.471969:0:17929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f354a5 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060145 expref: 25 pid: 17175 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.471979:0:17929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f354a5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060145 expref: 25 pid: 17175 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.471990:0:17929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:1.0:1787560821.471994:0:17929:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe400/0x4642c20bf2f35507 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.472003:0:17929:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe400/0x4642c20bf2f35507 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.472012:0:17929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe400/0x4642c20bf2f35507 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.472035:0:17929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560821.472056:0:17929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafefdc9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5945945-1487-49fd-bee0-0dcced27d086+25:2405:x1874392853384192:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 102us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560821.472069:0:17929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 18 00010000:00010000:0.0:1787560821.472192:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f354ba lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606014c expref: 24 pid: 17174 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560821.472213:0:17175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2351c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17175:1874392862903296:192.168.203.29@tcp:104: 00010000:00010000:0.0:1787560821.472226:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f354a5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060145 expref: 23 pid: 17175 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560821.472240:0:17175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2352680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17175:1874392862903424:192.168.203.29@tcp:104: 00010000:00010000:0.0:1787560821.472268:0:17175:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe400/0x4642c20bf2f35507 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560821.478258:0:17175:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe400/0x4642c20bf2f35507 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560821.478286:0:17175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe400/0x4642c20bf2f35507 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560821.478322:0:17175:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787560821.478828:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe600/0x4642c20bf2f35500 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060168 expref: 24 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560821.478867:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe400/0x4642c20bf2f35507 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060168 expref: 23 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560821.478878:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:2.0:1787560821.478882:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787560821.478887:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbfe400, rc 0) 00000100:00100000:2.0:1787560821.479284:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5945945-1487-49fd-bee0-0dcced27d086+23:15661:x1874392853383936:12345-192.168.203.29@tcp:101:dd.0 Request processed in 13651us (13930us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1787560821.479296:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 43 00000100:00100000:1.0:1787560821.482223:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560821.482371:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853384320 00000100:00100000:0.0:1787560821.482389:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853384320 00000100:00100000:2.0:1787560821.482836:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 44 00000100:00100000:2.0:1787560821.482855:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5945945-1487-49fd-bee0-0dcced27d086+23:15661:x1874392853384320:12345-192.168.203.29@tcp:101:dd.0 00010000:00010000:2.0:1787560821.482894:0:18203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560821.482939:0:18203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48200/0x4642c20bf2f35515 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4606016f expref: -99 pid: 18203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560821.483018:0:18203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48c00/0x4642c20bf2f3551c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560821.483034:0:18203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48c00/0x4642c20bf2f3551c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560821.483048:0:18203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48c00/0x4642c20bf2f3551c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560821.483213:0:18203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48200/0x4642c20bf2f35515 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606016f expref: 25 pid: 18203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560821.483235:0:18203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48c00/0x4642c20bf2f3551c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606016f expref: 24 pid: 18203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560821.483245:0:18203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:2.0:1787560821.483249:0:18203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787560821.483254:0:18203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca48c00, rc 0) 00000100:00100000:2.0:1787560821.483350:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5945945-1487-49fd-bee0-0dcced27d086+24:15661:x1874392853384320:12345-192.168.203.29@tcp:101:dd.0 Request processed in 501us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560821.483359:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 44 00000100:00100000:3.0:1787560821.486211:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560821.486356:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853384576 00000100:00100000:2.0:1787560821.486373:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853384576 00000100:00100000:2.0:1787560821.486541:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 45 00000100:00100000:2.0:1787560821.486555:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3902d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5945945-1487-49fd-bee0-0dcced27d086+24:15661:x1874392853384576:12345-192.168.203.29@tcp:36:dd.0 00010000:00010000:2.0:1787560821.486941:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35523 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560821.486982:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35523 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560821.487297:0:17173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35523 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787560821.487361:0:17173:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1787560821.487387:0:17173:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000042133436 reply state 00000000f3c2a6f8 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35523 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560821.487401:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35523 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560821.487409:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:2.0:1787560821.487413:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787560821.487417:0:17173:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787560821.487970:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3902d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5945945-1487-49fd-bee0-0dcced27d086+27:15661:x1874392853384576:12345-192.168.203.29@tcp:36:dd.0 Request processed in 1410us (1767us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1787560821.487982:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 45 00000020:00080000:2.0:1787560821.487989:0:17173:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787560821.491515:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560821.491724:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853384704 00000100:00100000:2.0:1787560821.491739:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853384704 00000100:00100000:2.0:1787560821.491837:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 46 00000100:00100000:2.0:1787560821.491853:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3901f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5945945-1487-49fd-bee0-0dcced27d086+27:15661:x1874392853384704:12345-192.168.203.29@tcp:101:dd.0 00010000:00010000:2.0:1787560821.491901:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560821.491949:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f3552a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf46060176 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560821.492057:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f3552a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060176 expref: 28 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560821.492105:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f3552a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060176 expref: 28 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560821.492136:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:2.0:1787560821.492140:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787560821.492146:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb002177800, rc 0) 00000100:00100000:2.0:1787560821.492242:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3901f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5945945-1487-49fd-bee0-0dcced27d086+28:15661:x1874392853384704:12345-192.168.203.29@tcp:101:dd.0 Request processed in 392us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560821.492251:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 46 00000100:00100000:0.0:1787560821.503232:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560821.503355:0:17929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853384960 00000100:00100000:1.0:1787560821.503370:0:17929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853384960 00000100:00100000:1.0:1787560821.503612:0:17929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:1.0:1787560821.503627:0:17929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2352680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5945945-1487-49fd-bee0-0dcced27d086+28:15661:x1874392853384960:12345-192.168.203.29@tcp:103:dd.0 00010000:00010000:1.0:1787560821.503655:0:17929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560821.503689:0:17929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f3552a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060176 expref: 28 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.503717:0:17929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:1.0:1787560821.503724:0:17929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560821.503806:0:17929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2352680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5945945-1487-49fd-bee0-0dcced27d086+27:15661:x1874392853384960:12345-192.168.203.29@tcp:103:dd.0 Request processed in 182us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560821.503814:0:17929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:3.0:1787560821.506219:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560821.506484:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853385088 00000100:00100000:0.0:1787560821.506498:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853385088 00000100:00100000:0.0:1787560821.506584:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 47 00000100:00100000:0.0:1787560821.506596:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3902300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a5945945-1487-49fd-bee0-0dcced27d086+27:15661:x1874392853385088:12345-192.168.203.29@tcp:58:dd.0 00010000:00010000:0.0:1787560821.506758:0:19968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f35531 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560821.506801:0:19968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f35531 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560821.507040:0:19968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f35531 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787560821.510206:0:19968:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787560821.511204:0:19968:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1787560821.511422:0:19968:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1787560821.512982:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3902300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a5945945-1487-49fd-bee0-0dcced27d086+27:15661:x1874392853385088:12345-192.168.203.29@tcp:58:dd.0 Request processed in 6365us (6753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560821.513010:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 47 00000100:00100000:3.0:1787560821.515863:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560821.516170:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853385216 00000100:00100000:1.0:1787560821.516185:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853385216 00000100:00100000:1.0:1787560821.516277:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 48 00000100:00100000:1.0:1787560821.516290:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3903480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5945945-1487-49fd-bee0-0dcced27d086+27:15661:x1874392853385216:12345-192.168.203.29@tcp:101:dd.0 00010000:00010000:1.0:1787560821.516322:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560821.516352:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff400/0x4642c20bf2f35538 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4606017d expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.516549:0:17174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f35531 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.516565:0:17174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff400/0x4642c20bf2f35538 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606017d expref: 28 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.516609:0:17174:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f35531 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.516627:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff400/0x4642c20bf2f35538 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606017d expref: 28 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.516653:0:17174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:1.0:1787560821.516657:0:17174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787560821.516662:0:17174:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff400/0x4642c20bf2f35538 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606017d expref: 28 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.516672:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb0021ff400, rc 0) 00000100:00100000:1.0:1787560821.516802:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3903480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5945945-1487-49fd-bee0-0dcced27d086+28:15661:x1874392853385216:12345-192.168.203.29@tcp:101:dd.0 Request processed in 514us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560821.516812:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 48 00000100:00100000:1.0:1787560821.812230:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560821.812251:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787560821.812263:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec38e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862903552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787560821.812263:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2351c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862903680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787560821.812539:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862904064:0@lo:400:kworker.0 00000100:00100000:0.0:1787560821.815208:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560821.815544:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862903808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787560821.815599:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560821.815693:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862904192:0@lo:400:kworker.0 00000100:00100000:1.0:1787560821.815742:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560821.815769:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862904704:0@lo:400:kworker.0 00000100:00100000:1.0:1787560821.815793:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560821.815812:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862905216:0@lo:400:kworker.0 00000100:00100000:1.0:1787560821.815839:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560821.815896:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862905216 00000100:00100000:1.0:1787560821.815908:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862905216 00000100:00100000:1.0:1787560821.816020:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787560821.816033:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3baed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862905216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560821.816104:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3baed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862905216:12345-0@lo:400:kworker.0 Request processed in 75us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560821.816111:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:1.0:1787560821.816158:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcaaaa00 x1874392862905216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560821.816175:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862905216:0@lo:400:kworker.0 00000100:00080000:1.0:1787560821.816214:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787560821.816235:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862904192 00000100:00100000:1.0:1787560821.816239:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862904192 00000100:00100000:1.0:1787560821.816273:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862904704 00000100:00100000:1.0:1787560821.816276:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862904704 00000100:00100000:1.0:1787560821.816311:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787560821.816317:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafffe4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862904192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560821.816356:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafffe4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862904192:12345-0@lo:400:kworker.0 Request processed in 40us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560821.816363:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787560821.816374:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787560821.816380:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862904704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560821.816407:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862904704:12345-0@lo:400:kworker.0 Request processed in 27us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560821.816413:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1787560821.816458:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787560821.816480:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862904192:0@lo:400:kworker.0 00000100:00100000:1.0:1787560821.816491:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862904704:0@lo:400:kworker.0 00000100:00100000:0.0:1787560821.817870:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862904320:0@lo:400:kworker.0 00000100:00100000:0.0:1787560821.817943:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560821.817967:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862904832:0@lo:400:kworker.0 00000100:00100000:0.0:1787560821.817991:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560821.818008:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862905344:0@lo:400:kworker.0 00000100:00100000:0.0:1787560821.818036:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560821.818085:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862904320 00000100:00100000:0.0:1787560821.818093:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862904320 00000100:00100000:0.0:1787560821.818143:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862904832 00000100:00100000:0.0:1787560821.818146:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862904832 00000100:00100000:0.0:1787560821.818189:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787560821.818198:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862904320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560821.818256:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862904320:12345-0@lo:400:kworker.0 Request processed in 59us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560821.818264:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787560821.818281:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787560821.818552:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862904832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560821.818589:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862904832:12345-0@lo:400:kworker.0 Request processed in 302us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560821.818596:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1787560821.818626:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787560821.818655:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560821.819261:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862903680 00000100:00100000:2.0:1787560821.819272:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862903680 00000100:00100000:2.0:1787560821.819320:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862903808 00000100:00100000:2.0:1787560821.819323:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862903808 00000100:00100000:2.0:1787560821.819343:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787560821.819353:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2353800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862903680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787560821.819391:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787560821.819719:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f08f2f56-c18f-4579-88a9-05007f76ffc9:3623:1874392862903936:0@lo:400:kworker.0 00000100:00100000:2.0:1787560821.820096:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2353800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862903680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 389us (6436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560821.820106:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787560821.820146:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862903552 00000100:00100000:2.0:1787560821.820151:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862903552 00000100:00100000:2.0:1787560821.820172:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787560821.820182:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2351500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862903808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787560821.820207:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787560821.820254:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2351500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862903808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (4655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560821.820281:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787560821.820295:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787560821.820301:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2351f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862903552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787560821.820311:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787560821.820342:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2351f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862903552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (1686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560821.820347:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787560821.820421:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862905344 00000100:00100000:2.0:1787560821.820427:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862905344 00000100:00100000:0.0:1787560821.820715:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560821.820875:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862904448:0@lo:400:kworker.0 00000100:00100000:0.0:1787560821.820916:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560821.821017:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862904960:0@lo:400:kworker.0 00000100:00100000:0.0:1787560821.821045:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560821.821070:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862905472:0@lo:400:kworker.0 00000100:00100000:0.0:1787560821.821101:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560821.821163:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec38e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862903552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787560821.821213:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862903936 00000100:00100000:0.0:1787560821.821218:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862903936 00000100:00100000:0.0:1787560821.821273:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787560821.821281:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:3623:x1874392862903936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560821.821343:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:3623:x1874392862903936:12345-0@lo:400:kworker.0 Request processed in 62us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560821.821349:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787560821.821530:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862904448 00000100:00100000:1.0:1787560821.821536:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862904448 00000100:00100000:1.0:1787560821.821568:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862904960 00000100:00100000:1.0:1787560821.821570:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862904960 00000100:00100000:1.0:1787560821.821582:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862905472 00000100:00100000:1.0:1787560821.821584:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862905472 00000100:00100000:1.0:1787560821.821610:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787560821.821617:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2350e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862904448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560821.821666:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2350e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862904448:12345-0@lo:400:kworker.0 Request processed in 49us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560821.821673:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787560821.821686:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787560821.821692:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862904960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560821.821719:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862904960:12345-0@lo:400:kworker.0 Request processed in 27us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560821.821725:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787560821.821887:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862903808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787560821.821901:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862904320:0@lo:400:kworker.0 00000100:00100000:0.0:1787560821.821913:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862904832:0@lo:400:kworker.0 00000100:00100000:0.0:1787560821.821927:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2351c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862903680:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787560821.822016:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787560821.822024:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874392862905472:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787560821.822062:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787560821.822070:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787560821.822089:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874392862905472:12345-0@lo:400:kworker.0 Request processed in 64us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560821.822096:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787560821.822106:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862905344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560821.822150:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862905344:12345-0@lo:400:kworker.0 Request processed in 45us (4112us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560821.822180:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f08f2f56-c18f-4579-88a9-05007f76ffc9:3623:1874392862903936:0@lo:400:kworker.0 00000100:00100000:0.0:1787560821.822192:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862904448:0@lo:400:kworker.0 00000100:00100000:0.0:1787560821.822203:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862904960:0@lo:400:kworker.0 00010000:00080000:0.0:1787560821.822217:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffcaa8700 x1874392862905472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560821.822228:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862905472:0@lo:400:kworker.0 00000100:00100000:0.0:1787560821.822261:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862905344:0@lo:400:kworker.0 00000100:00100000:3.0:1787560821.822395:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560821.822451:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862904576:0@lo:400:kworker.0 00000100:00100000:3.0:1787560821.822481:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560821.822483:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862904064 00000100:00100000:0.0:1787560821.822489:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862904064 00000100:00100000:3.0:1787560821.822503:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862904576 00000100:00100000:3.0:1787560821.822507:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862904576 00000100:00100000:0.0:1787560821.822522:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787560821.822534:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3900700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862904064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560821.822573:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3900700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862904064:12345-0@lo:400:kworker.0 Request processed in 44us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560821.822909:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787560821.822919:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3901c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862904576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560821.822957:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3901c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862904576:12345-0@lo:400:kworker.0 Request processed in 40us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560821.822964:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787560821.822999:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862904576:0@lo:400:kworker.0 00000100:00100000:3.0:1787560821.823007:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862905088:0@lo:400:kworker.0 00000100:00100000:3.0:1787560821.823033:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560821.823071:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862904064:0@lo:400:kworker.0 00000100:00100000:3.0:1787560821.823115:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862905088 00000100:00100000:0.0:1787560821.823118:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787560821.823120:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862905088 00000100:00080000:0.0:1787560821.823141:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560821.823522:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787560821.823534:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787560821.823594:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787560821.823606:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3901180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862905088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560821.823688:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3901180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862905088:12345-0@lo:400:kworker.0 Request processed in 86us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560821.823694:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787560821.823912:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862905088:0@lo:400:kworker.0 00000040:00080000:2.0:1787560821.939933:0:17206:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787560821.939946:0:17206:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787560821.939981:0:17206:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787560821.939993:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787560821.940179:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaabb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17206:1874392862905600:192.168.203.29@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787560821.943301:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd84bb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560821.947513:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaabb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17206:1874392862905600:192.168.203.29@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787560821.957499:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560821.957731:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853385344 00000100:00100000:2.0:1787560821.957745:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853385344 00000100:00100000:2.0:1787560821.957826:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 49 00000100:00100000:2.0:1787560821.957859:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5945945-1487-49fd-bee0-0dcced27d086+28:15663:x1874392853385344:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787560821.957906:0:17175:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787560821.958288:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5945945-1487-49fd-bee0-0dcced27d086+28:15663:x1874392853385344:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 Request processed in 430us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560821.958296:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 49 00000100:00100000:3.0:1787560821.963470:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560821.963942:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853385472 00000100:00100000:1.0:1787560821.963959:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853385472 00000100:00100000:1.0:1787560821.964089:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 50 00000100:00100000:1.0:1787560821.964102:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3903b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5945945-1487-49fd-bee0-0dcced27d086+28:15663:x1874392853385472:12345-192.168.203.29@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787560821.964206:0:17174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f3553f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.964257:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f3553f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.964275:0:17174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f3553f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.966791:0:17174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f35546 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.966819:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f35546 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.966833:0:17174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f35546 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.966947:0:17174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880400/0x4642c20bf2f3554d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.966959:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880400/0x4642c20bf2f3554d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.966966:0:17174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880400/0x4642c20bf2f3554d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560821.967037:0:17174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787560821.967043:0:17174:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787560821.967066:0:17174:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880400/0x4642c20bf2f3554d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.967079:0:17174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f3553f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.967106:0:17174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f3553f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.967113:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f3553f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.967121:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ffa00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560821.967127:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f3553f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.967135:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f3553f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.967152:0:17174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cafe14b4300) 00010000:00010000:1.0:1787560821.967155:0:17174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560821.967161:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f3553f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.967166:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f3553f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.967183:0:17174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f35546 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.967188:0:17174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f35546 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.967193:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f35546 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.967198:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021fe800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560821.967207:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f35546 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.967214:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f35546 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.967222:0:17174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9caec3206500) 00010000:00010000:1.0:1787560821.967225:0:17174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560821.967228:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f35546 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.967234:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe800/0x4642c20bf2f35546 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.967252:0:17174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880400/0x4642c20bf2f3554d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.967257:0:17174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880400/0x4642c20bf2f3554d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.967263:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880400/0x4642c20bf2f3554d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.967268:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880400 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560821.967271:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880400/0x4642c20bf2f3554d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.967277:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880400/0x4642c20bf2f3554d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.967283:0:17174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:1.0:1787560821.967286:0:17174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560821.967296:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880400/0x4642c20bf2f3554d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560821.967302:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880400/0x4642c20bf2f3554d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560821.970774:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3903b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5945945-1487-49fd-bee0-0dcced27d086+28:15663:x1874392853385472:12345-192.168.203.29@tcp:34:lhsmtool_posix.0 Request processed in 6658us (7343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560821.970793:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 50 00000100:00100000:1.0:1787560821.978850:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560821.979229:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853385728 00000100:00100000:3.0:1787560821.979250:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853385728 00000100:00100000:3.0:1787560821.979517:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 51 00000100:00100000:3.0:1787560821.979532:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5945945-1487-49fd-bee0-0dcced27d086+28:15663:x1874392853385728:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787560821.981074:0:18203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560821.981127:0:18203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f35554 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf46060184 expref: -99 pid: 18203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560821.981342:0:18203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f3555b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560821.981364:0:18203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f3555b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560821.981379:0:18203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f3555b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560821.981393:0:18203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787560821.981518:0:18203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f3555b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560821.981527:0:18203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f3555b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560821.981536:0:18203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f3555b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560821.981543:0:18203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6e00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560821.981549:0:18203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f3555b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560821.981558:0:18203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f3555b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560821.982323:0:18203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:3.0:1787560821.982347:0:18203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787560821.982356:0:18203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f3555b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560821.982364:0:18203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f3555b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560821.982593:0:18203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f35554 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060184 expref: 30 pid: 18203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560821.982606:0:18203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cafe14b4300) 00010000:00010000:3.0:1787560821.982609:0:18203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787560821.982613:0:18203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f35554 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060184 expref: 30 pid: 18203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560821.982624:0:18203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f7200, rc 0) 00000100:00100000:3.0:1787560821.982751:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5945945-1487-49fd-bee0-0dcced27d086+29:15663:x1874392853385728:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 3222us (3919us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1787560821.982763:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 51 00000100:00100000:0.0:1787560821.990892:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560821.991204:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853385856 00000100:00100000:2.0:1787560821.991218:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853385856 00000100:00100000:2.0:1787560821.991294:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 52 00000100:00100000:2.0:1787560821.991307:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5945945-1487-49fd-bee0-0dcced27d086+29:15663:x1874392853385856:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787560821.991354:0:17175:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787560821.992058:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5945945-1487-49fd-bee0-0dcced27d086+29:15663:x1874392853385856:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 Request processed in 747us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560821.992071:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 52 00000100:00100000:1.0:1787560821.998316:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560821.998492:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853386112 00000100:00100000:2.0:1787560821.998505:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853386112 00000100:00100000:2.0:1787560821.998592:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 53 00000100:00100000:2.0:1787560821.998604:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5945945-1487-49fd-bee0-0dcced27d086+29:15663:x1874392853386112:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787560821.998631:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560821.998677:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f35569 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4606018b expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787560821.999820:0:17174:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =28 00000004:00080000:2.0:1787560821.999831:0:17174:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+28 in llog 00000004:00080000:2.0:1787560821.999864:0:17174:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:2.0:1787560822.001349:0:17174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f35570 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.001396:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f35570 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.001412:0:17174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f35570 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.001535:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f35569 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606018b expref: 32 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.001566:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f35570 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606018b expref: 31 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.001577:0:17174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cafd8703d00) 00010000:00010000:2.0:1787560822.001580:0:17174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787560822.001585:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb002176200, rc 0) 00000100:00100000:2.0:1787560822.001728:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5945945-1487-49fd-bee0-0dcced27d086+31:15663:x1874392853386112:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 3123us (3428us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1787560822.001741:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 53 00000100:00100000:1.0:1787560822.011153:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560822.011523:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853386368 00000100:00100000:3.0:1787560822.011537:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853386368 00000100:00100000:3.0:1787560822.012691:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 54 00000100:00100000:3.0:1787560822.012719:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5945945-1487-49fd-bee0-0dcced27d086+31:15663:x1874392853386368:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787560822.012866:0:18203:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560822.012909:0:18203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f35570 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606018b expref: 31 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.013013:0:18203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cafd8703d00) 00010000:00010000:3.0:1787560822.013056:0:18203:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787560822.013096:0:18203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f3557e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.013116:0:18203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f3557e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.013129:0:18203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f3557e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.016844:0:18203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f35585 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd57a6405 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.016881:0:18203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f35585 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd57a6405 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.016903:0:18203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f35585 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd57a6405 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.017003:0:18203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f3557e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.017014:0:18203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f3557e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.017025:0:18203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f3557e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.017033:0:18203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560822.017039:0:18203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f3557e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.017050:0:18203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f3557e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.017093:0:18203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cafe14b4400) 00010000:00010000:3.0:1787560822.017098:0:18203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560822.017105:0:18203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f3557e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.017113:0:18203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7200/0x4642c20bf2f3557e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.017137:0:18203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f35585 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd57a6405 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.017146:0:18203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f35585 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd57a6405 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.017153:0:18203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f35585 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd57a6405 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.017160:0:18203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6e00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560822.017165:0:18203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f35585 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd57a6405 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.017173:0:18203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f35585 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd57a6405 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.017189:0:18203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd57a6405 (ffff9cafe14b4900) 00010000:00010000:3.0:1787560822.017192:0:18203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560822.017196:0:18203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f35585 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd57a6405 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.017201:0:18203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6e00/0x4642c20bf2f35585 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd57a6405 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560822.017351:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5945945-1487-49fd-bee0-0dcced27d086+30:15663:x1874392853386368:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 4640us (6214us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787560822.017360:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 54 00000100:00100000:3.0:1787560822.020361:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560822.020585:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853386496 00000100:00100000:2.0:1787560822.020599:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853386496 00000100:00100000:2.0:1787560822.020670:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 55 00000100:00100000:2.0:1787560822.020682:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3901500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5945945-1487-49fd-bee0-0dcced27d086+30:15663:x1874392853386496:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787560822.020713:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560822.020748:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f3558c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf46060192 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.020806:0:17175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f35593 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.020852:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f35593 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.020871:0:17175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f35593 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.021032:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f3558c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060192 expref: 32 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.021063:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f35593 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060192 expref: 31 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.021076:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cafd8703800) 00010000:00010000:2.0:1787560822.021080:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787560822.021085:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb002177800, rc 0) 00000100:00100000:2.0:1787560822.021181:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3901500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5945945-1487-49fd-bee0-0dcced27d086+31:15663:x1874392853386496:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 501us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560822.021189:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 55 00000100:00100000:1.0:1787560822.029996:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560822.030096:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853386752 00000100:00100000:0.0:1787560822.030108:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853386752 00000100:00100000:0.0:1787560822.030169:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 56 00000100:00100000:0.0:1787560822.030179:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a5945945-1487-49fd-bee0-0dcced27d086+31:15663:x1874392853386752:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787560822.030255:0:19968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3559a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.030274:0:19968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3559a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.030287:0:19968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3559a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787560822.030759:0:19968:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1787560822.030770:0:19968:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 541370338745ns, next at 542370336239ns, rc = 0 00000004:00010000:0.0:1787560822.030825:0:19968:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000009d7dc4c reply state 00000000b7d1ac54 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3559a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.030839:0:19968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3559a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.030847:0:19968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cafd8703800) 00010000:00010000:0.0:1787560822.030850:0:19968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787560822.030853:0:19968:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787560822.031018:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a5945945-1487-49fd-bee0-0dcced27d086+33:15663:x1874392853386752:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 838us (1030us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1787560822.031047:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 56 00000100:00100000:0.0:1787560822.033676:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560822.033841:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853386880 00000100:00100000:3.0:1787560822.033855:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853386880 00000100:00100000:3.0:1787560822.033958:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 57 00000100:00100000:3.0:1787560822.033973:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5945945-1487-49fd-bee0-0dcced27d086+33:15663:x1874392853386880:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787560822.034011:0:18203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560822.034040:0:18203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f355a1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf46060199 expref: -99 pid: 18203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.034375:0:18203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f355a1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060199 expref: 34 pid: 18203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.034395:0:18203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f355a1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060199 expref: 34 pid: 18203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.034419:0:18203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cafd8703800) 00010000:00010000:3.0:1787560822.034422:0:18203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787560822.034427:0:18203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f7e00, rc 0) 00000100:00100000:0.0:1787560822.036183:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5945945-1487-49fd-bee0-0dcced27d086+34:15663:x1874392853386880:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 2198us (2509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560822.036201:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 57 00000100:00100000:3.0:1787560822.038970:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560822.039472:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853387008 00000100:00100000:0.0:1787560822.039486:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853387008 00000100:00080000:2.0:1787560822.039676:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560822.039762:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 26 00000100:00100000:0.0:1787560822.039779:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3902a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5945945-1487-49fd-bee0-0dcced27d086+5:2405:x1874392853387008:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787560822.040160:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3902a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5945945-1487-49fd-bee0-0dcced27d086+6:2405:x1874392853387008:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 Request processed in 385us (1205us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1787560822.040170:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 26 00000100:00100000:1.0:1787560822.044420:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560822.044556:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853387264 00000100:00100000:3.0:1787560822.044569:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853387264 00000100:00100000:3.0:1787560822.044660:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:3.0:1787560822.044673:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a5945945-1487-49fd-bee0-0dcced27d086+34:15663:x1874392853387264:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787560822.045037:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a5945945-1487-49fd-bee0-0dcced27d086+35:15663:x1874392853387264:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 365us (628us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1787560822.045046:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:2.0:1787560822.050126:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560822.050220:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853387520 00000100:00100000:3.0:1787560822.050236:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853387520 00000100:00100000:3.0:1787560822.050329:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 58 00000100:00100000:3.0:1787560822.050344:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5945945-1487-49fd-bee0-0dcced27d086+35:15663:x1874392853387520:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787560822.050732:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5945945-1487-49fd-bee0-0dcced27d086+35:15663:x1874392853387520:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 389us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560822.050742:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 58 00000100:00100000:3.0:1787560822.056008:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560822.057190:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853387648 00000100:00100000:0.0:1787560822.057209:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853387648 00000100:00100000:0.0:1787560822.057370:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 59 00000100:00100000:0.0:1787560822.057394:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3900000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a5945945-1487-49fd-bee0-0dcced27d086+35:15663:x1874392853387648:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787560822.057426:0:19968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560822.057480:0:19968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f355a8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf460601a0 expref: -99 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.057584:0:19968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f355af lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.057601:0:19968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f355af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.057615:0:19968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f355af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560822.057716:0:19968:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787560822.058056:0:19968:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f355af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.058095:0:19968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff800/0x4642c20bf2f355a8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460601a0 expref: 37 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.058134:0:19968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f355af lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460601a0 expref: 36 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.058144:0:19968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cafd8703800) 00010000:00010000:0.0:1787560822.058147:0:19968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787560822.058151:0:19968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbfe200, rc 0) 00000100:00100000:0.0:1787560822.058255:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3900000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a5945945-1487-49fd-bee0-0dcced27d086+36:15663:x1874392853387648:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 873us (2262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560822.058264:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 59 00000100:00100000:2.0:1787560822.061720:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560822.064002:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853387776 00000100:00100000:0.0:1787560822.064022:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853387776 00000100:00100000:0.0:1787560822.064136:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 27 00000100:00100000:0.0:1787560822.064149:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5945945-1487-49fd-bee0-0dcced27d086+6:2404:x1874392853387776:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787560822.064176:0:18683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560822.064205:0:18683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000092a86a9/0x4642c20bf2f355b6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf460601a7 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787560822.064242:0:18683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c0375, blocks: 0x0 00010000:00010000:0.0:1787560822.064271:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=541s v=(0 0) 00010000:00010000:0.0:1787560822.064295:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560822.064308:0:18683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000092a86a9/0x4642c20bf2f355b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460601a7 expref: 7 pid: 18683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.064334:0:18683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000092a86a9/0x4642c20bf2f355b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460601a7 expref: 7 pid: 18683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.064352:0:18683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbff800, rc 0) 00000100:00100000:0.0:1787560822.064481:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5945945-1487-49fd-bee0-0dcced27d086+7:2404:x1874392853387776:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 334us (2777us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560822.064488:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 27 00000100:00100000:3.0:1787560822.070815:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560822.071141:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853388032 00000100:00100000:0.0:1787560822.071157:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853388032 00000100:00100000:0.0:1787560822.071248:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 60 00000100:00100000:0.0:1787560822.071261:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3902680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5945945-1487-49fd-bee0-0dcced27d086+36:15663:x1874392853388032:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787560822.071656:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3902680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5945945-1487-49fd-bee0-0dcced27d086+36:15663:x1874392853388032:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 377us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560822.071672:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 60 00000100:00100000:3.0:1787560822.077729:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560822.077949:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853388160 00000100:00100000:2.0:1787560822.077966:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853388160 00000100:00100000:2.0:1787560822.078268:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 61 00000100:00100000:2.0:1787560822.078281:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3900a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5945945-1487-49fd-bee0-0dcced27d086+36:15663:x1874392853388160:12345-192.168.203.29@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787560822.082492:0:17153:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1787560822.082585:0:17153:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:2.0:1787560822.082670:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f353ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.082706:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f353ef lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.082716:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f353ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.082722:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca48600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560822.082727:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f353ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.082735:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f353ef lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.082757:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cafd8703400) 00010000:00010000:2.0:1787560822.082760:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560822.082766:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f353ef lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.082773:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f353ef lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.082805:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.082813:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353f6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.082821:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.082826:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6a00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560822.082837:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.082845:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353f6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.082855:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cafe14b4400) 00010000:00010000:2.0:1787560822.082858:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560822.082862:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353f6 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.082868:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6a00/0x4642c20bf2f353f6 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.082887:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49a00/0x4642c20bf2f3549e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.082894:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49a00/0x4642c20bf2f3549e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.082901:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49a00/0x4642c20bf2f3549e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.082906:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49a00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560822.082909:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49a00/0x4642c20bf2f3549e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.082915:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49a00/0x4642c20bf2f3549e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.082923:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9cafd8703500) 00010000:00010000:2.0:1787560822.082926:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560822.082935:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49a00/0x4642c20bf2f3549e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787560822.083081:0:17153:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1787560822.083132:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1787560822.083155:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48400/0x4642c20bf2f35443 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560822.083156:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862905728:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1787560822.083171:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48400/0x4642c20bf2f35443 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.083178:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48400/0x4642c20bf2f35443 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560822.083261:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560822.083334:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862905728 00000100:00100000:1.0:1787560822.083344:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862905728 00010000:00010000:3.0:1787560822.083367:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca48400 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560822.083371:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48400/0x4642c20bf2f35443 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.083378:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48400/0x4642c20bf2f35443 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.083404:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cafe14b4400) 00010000:00010000:3.0:1787560822.083407:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1787560822.083411:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00010000:00010000:3.0:1787560822.083413:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48400/0x4642c20bf2f35443 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.083422:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48400/0x4642c20bf2f35443 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18203 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560822.083428:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862905728:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787560822.083684:0:18685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787560822.083688:0:18685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787560822.083690:0:18685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787560822.083693:0:18685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1787560821 -> 1787560821 00002000:00010000:1.0:1787560822.083696:0:18685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787560822.083757:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3623:x1874392862905728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 334us (496us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787560822.083766:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1787560822.084286:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49a00/0x4642c20bf2f3549e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.084318:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35523 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.084326:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35523 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.084333:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35523 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.084340:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560822.084344:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35523 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.084352:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35523 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.084367:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:2.0:1787560822.084370:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560822.084374:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35523 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.084379:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35523 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.084391:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3559a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.084412:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3559a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.084418:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3559a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.084422:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbfec00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560822.084502:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3559a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.084511:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3559a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.084520:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cafd8703800) 00010000:00010000:2.0:1787560822.084523:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787560822.084526:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3559a lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.084532:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfec00/0x4642c20bf2f3559a lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560822.084775:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3900a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5945945-1487-49fd-bee0-0dcced27d086+15:15663:x1874392853388160:12345-192.168.203.29@tcp:44:lhsmtool_posix.0 Request processed in 6492us (7059us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560822.084788:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 61 00000004:00080000:3.0:1787560822.084901:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9caec407ce00/2, rc 0, transno 8589934596 00000100:00100000:3.0:1787560822.084991:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862905728:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787560822.087821:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560822.087925:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853388288 00000100:00100000:0.0:1787560822.087939:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853388288 00000100:00100000:0.0:1787560822.088107:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 29 00000100:00100000:0.0:1787560822.088120:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5945945-1487-49fd-bee0-0dcced27d086+7:2405:x1874392853388288:12345-192.168.203.29@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787560822.088314:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5945945-1487-49fd-bee0-0dcced27d086+7:2405:x1874392853388288:12345-192.168.203.29@tcp:16:lhsmtool_posix.0 Request processed in 196us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560822.088345:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 29 00000100:00100000:0.0:1787560822.093782:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560822.094224:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853388544 00000100:00100000:2.0:1787560822.094245:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853388544 00000100:00100000:2.0:1787560822.094381:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 62 00000100:00100000:2.0:1787560822.094397:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a5945945-1487-49fd-bee0-0dcced27d086+15:15663:x1874392853388544:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787560822.094571:0:19968:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560822.094628:0:19968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe200/0x4642c20bf2f355af lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460601a0 expref: 15 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.094667:0:19968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cafd8703800) 00010000:00010000:2.0:1787560822.094679:0:19968:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787560822.094730:0:19968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f355bd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.094751:0:19968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f355bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.094764:0:19968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f355bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787560822.094982:0:19968:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006fc07357 reply state 00000000988b3e75 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f355bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.094997:0:19968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f355bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.095004:0:19968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cafd8703800) 00010000:00010000:2.0:1787560822.095007:0:19968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787560822.095011:0:19968:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787560822.095179:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a5945945-1487-49fd-bee0-0dcced27d086+16:15663:x1874392853388544:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 785us (1419us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1787560822.095188:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 62 00000100:00100000:3.0:1787560822.100258:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560822.100580:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853388672 00000100:00100000:1.0:1787560822.100605:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853388672 00000100:00100000:1.0:1787560822.100797:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 30 00000100:00100000:1.0:1787560822.100812:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5945945-1487-49fd-bee0-0dcced27d086+7:15663:x1874392853388672:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787560822.100840:0:18685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560822.100868:0:18685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4a86590/0x4642c20bf2f355c4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf460601ae expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560822.100916:0:18685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000092a86a9/0x4642c20bf2f355b6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460601a7 expref: 8 pid: 18683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560822.100925:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560822.100931:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560822.100936:0:18685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4a86590/0x4642c20bf2f355c4 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460601ae expref: 8 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560822.101100:0:18685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000092a86a9/0x4642c20bf2f355b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460601a7 expref: 8 pid: 18683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560822.101117:0:18685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000092a86a9/0x4642c20bf2f355b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460601a7 expref: 8 pid: 18683 timeout: 641 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560822.101137:0:18685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc52c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:18685:1874392862905856:192.168.203.29@tcp:104: 00000100:00100000:1.0:1787560822.101260:0:18685:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd7c29d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787560822.105572:0:18685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc52c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:18685:1874392862905856:192.168.203.29@tcp:104: 00010000:00010000:0.0:1787560822.105625:0:18685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d4a86590/0x4642c20bf2f355c4 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460601ae expref: 8 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.105661:0:18685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3880e00, rc 0) 00000100:00100000:0.0:1787560822.105788:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5945945-1487-49fd-bee0-0dcced27d086+8:15663:x1874392853388672:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 4978us (5552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560822.105800:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 30 00000100:00100000:0.0:1787560822.107023:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560822.107222:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853388800 00000100:00100000:1.0:1787560822.107235:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853388800 00010000:00010000:1.0:1787560822.107314:0:17159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000092a86a9/0x4642c20bf2f355b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460601a7 expref: 8 pid: 18683 timeout: 641 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560822.107660:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:2.0:1787560822.108117:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2353480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5945945-1487-49fd-bee0-0dcced27d086+8:2405:x1874392853388800:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560822.108148:0:17158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560822.108278:0:17158:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000092a86a9/0x4642c20bf2f355b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460601a7 expref: 8 pid: 18683 timeout: 641 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.108301:0:17158:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000092a86a9/0x4642c20bf2f355b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460601a7 expref: 8 pid: 18683 timeout: 641 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.108342:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000092a86a9/0x4642c20bf2f355b6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460601a7 expref: 8 pid: 18683 timeout: 641 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.108372:0:17158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560822.108716:0:17158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560822.108729:0:17158:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4a86590/0x4642c20bf2f355c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460601ae expref: 7 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.108744:0:17158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4a86590/0x4642c20bf2f355c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460601ae expref: 7 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.108813:0:17158:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d4a86590/0x4642c20bf2f355c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460601ae expref: 7 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560822.108834:0:17158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:17158:1874392862905984:192.168.203.29@tcp:105: 00000100:00100000:2.0:1787560822.108990:0:17158:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc81fed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787560822.112288:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560822.112471:0:17158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:17158:1874392862905984:192.168.203.29@tcp:105: 00010000:00010000:2.0:1787560822.112507:0:17158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560822.112603:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2353480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5945945-1487-49fd-bee0-0dcced27d086+7:2405:x1874392853388800:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 4931us (5586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560822.112649:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:0.0:1787560822.113758:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853388928 00000100:00100000:0.0:1787560822.113777:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853388928 00000100:00100000:1.0:1787560822.113953:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 31 00000100:00100000:1.0:1787560822.113968:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5945945-1487-49fd-bee0-0dcced27d086+7:2404:x1874392853388928:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787560822.114212:0:18683:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787560822.114217:0:18683:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1787560821 00002000:00010000:1.0:1787560822.114220:0:18683:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1787560820 00002000:00010000:1.0:1787560822.114222:0:18683:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1787560821 -> 1787560821 00002000:00010000:1.0:1787560822.114224:0:18683:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787560822.114306:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5945945-1487-49fd-bee0-0dcced27d086+8:2404:x1874392853388928:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 Request processed in 341us (2029us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787560822.114316:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 31 00000100:00100000:1.0:1787560822.118748:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560822.118947:0:19050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853389056 00000100:00100000:0.0:1787560822.118963:0:19050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853389056 00000100:00100000:0.0:1787560822.119046:0:19050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 32 00000100:00100000:0.0:1787560822.119060:0:19050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5945945-1487-49fd-bee0-0dcced27d086+8:2403:x1874392853389056:12345-192.168.203.29@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787560822.119131:0:19050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000710cff71/0x4642c20bf2f355cb lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.119159:0:19050:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4a86590/0x4642c20bf2f355c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460601ae expref: 8 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.119170:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560822.119175:0:19050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787560822.119199:0:19050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000710cff71/0x4642c20bf2f355cb lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.119251:0:19050:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d4a86590/0x4642c20bf2f355c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460601ae expref: 8 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.119269:0:19050:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d4a86590/0x4642c20bf2f355c4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460601ae expref: 8 pid: 18685 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560822.119288:0:19050:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2353b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19050:1874392862906112:192.168.203.29@tcp:104: 00000100:00100000:0.0:1787560822.119422:0:19050:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe06da6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560822.122910:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560822.123180:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853389184 00000100:00100000:3.0:1787560822.123193:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853389184 00010000:00010000:3.0:1787560822.123246:0:17160:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d4a86590/0x4642c20bf2f355c4 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460601ae expref: 9 pid: 18685 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560822.123299:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:3.0:1787560822.123311:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5945945-1487-49fd-bee0-0dcced27d086+9:2405:x1874392853389184:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560822.123333:0:17160:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560822.123361:0:17160:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d4a86590/0x4642c20bf2f355c4 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460601ae expref: 9 pid: 18685 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.123377:0:17160:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d4a86590/0x4642c20bf2f355c4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460601ae expref: 9 pid: 18685 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.123428:0:17160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787560822.123558:0:17160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787560822.123574:0:17160:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000710cff71/0x4642c20bf2f355cb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.123588:0:17160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000710cff71/0x4642c20bf2f355cb lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.123618:0:17160:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560822.123697:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5945945-1487-49fd-bee0-0dcced27d086+9:2405:x1874392853389184:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 387us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560822.123706:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 20 00010000:00010000:0.0:1787560822.123836:0:19050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4a86590/0x4642c20bf2f355c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460601ae expref: 8 pid: 18685 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560822.123857:0:19050:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2353b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19050:1874392862906112:192.168.203.29@tcp:104: 00010000:00010000:0.0:1787560822.123890:0:19050:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000710cff71/0x4642c20bf2f355cb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.123903:0:19050:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000710cff71/0x4642c20bf2f355cb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.123920:0:19050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000710cff71/0x4642c20bf2f355cb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.123948:0:19050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000710cff71/0x4642c20bf2f355cb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.123967:0:19050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000710cff71/0x4642c20bf2f355cb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.123977:0:19050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000710cff71/0x4642c20bf2f355cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.123985:0:19050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbfe600 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560822.123990:0:19050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000710cff71/0x4642c20bf2f355cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.124001:0:19050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000710cff71/0x4642c20bf2f355cb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.124015:0:19050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000710cff71/0x4642c20bf2f355cb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.124022:0:19050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000710cff71/0x4642c20bf2f355cb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560822.124075:0:19050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5945945-1487-49fd-bee0-0dcced27d086+7:2403:x1874392853389056:12345-192.168.203.29@tcp:1:lhsmtool_posix.0 Request processed in 5019us (5343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560822.124084:0:19050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 32 00000100:00100000:2.0:1787560822.127223:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560822.127336:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853389440 00000100:00100000:0.0:1787560822.127352:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853389440 00000100:00100000:0.0:1787560822.127491:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 63 00000100:00100000:0.0:1787560822.127530:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5945945-1487-49fd-bee0-0dcced27d086+16:15663:x1874392853389440:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787560822.127680:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f355d2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.127703:0:17173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48c00/0x4642c20bf2f3551c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606016f expref: 16 pid: 18203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.127715:0:17173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f355d2 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.127768:0:17173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48c00/0x4642c20bf2f3551c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606016f expref: 16 pid: 18203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.127787:0:17173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48c00/0x4642c20bf2f3551c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606016f expref: 16 pid: 18203 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560822.127805:0:17173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2353b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17173:1874392862906240:192.168.203.29@tcp:104: 00000100:00100000:0.0:1787560822.127936:0:17173:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe06da6c0 going to sleep for 11 seconds 00000040:00080000:3.0:1787560822.133121:0:17927:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787560822.133424:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560822.133780:0:17173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2353b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17173:1874392862906240:192.168.203.29@tcp:104: 00010000:00010000:1.0:1787560822.133827:0:17173:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f355d2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560822.135206:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853389568 00000100:00100000:3.0:1787560822.135224:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853389568 00010000:00010000:3.0:1787560822.135302:0:17159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48c00/0x4642c20bf2f3551c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606016f expref: 17 pid: 18203 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560822.135361:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:3.0:1787560822.135374:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaa8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5945945-1487-49fd-bee0-0dcced27d086+17:2404:x1874392853389568:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560822.135393:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560822.135401:0:17159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48c00/0x4642c20bf2f3551c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606016f expref: 17 pid: 18203 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.135417:0:17159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48c00/0x4642c20bf2f3551c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606016f expref: 17 pid: 18203 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.135507:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48c00/0x4642c20bf2f3551c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606016f expref: 17 pid: 18203 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.135529:0:17159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:3.0:1787560822.135536:0:17159:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff400/0x4642c20bf2f35538 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606017d expref: 16 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.135548:0:17159:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f355d2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.135557:0:17159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f355d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.135565:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f355d2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.135601:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560822.135692:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaa8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5945945-1487-49fd-bee0-0dcced27d086+16:2404:x1874392853389568:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 321us (2276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560822.135701:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 21 00010000:00010000:1.0:1787560822.136046:0:17173:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f355d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560822.136057:0:17173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f355d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560822.136360:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f355d9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560822.136375:0:17173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f355a1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060199 expref: 16 pid: 18203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560822.136391:0:17173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f355d9 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560822.136468:0:17173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f355a1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060199 expref: 16 pid: 18203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560822.136486:0:17173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f355a1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060199 expref: 16 pid: 18203 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560822.136505:0:17173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc52c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17173:1874392862906368:192.168.203.29@tcp:104: 00000100:00100000:1.0:1787560822.136608:0:17173:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd7c29780 going to sleep for 11 seconds 00000100:00100000:1.0:1787560822.141954:0:17173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc52c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17173:1874392862906368:192.168.203.29@tcp:104: 00010000:00010000:1.0:1787560822.141999:0:17173:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f355d9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560822.144221:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560822.144477:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853389696 00000100:00100000:3.0:1787560822.144491:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853389696 00010000:00010000:3.0:1787560822.144552:0:17160:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f355a1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060199 expref: 17 pid: 18203 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560822.144615:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:3.0:1787560822.144627:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5945945-1487-49fd-bee0-0dcced27d086+17:2402:x1874392853389696:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560822.144679:0:17160:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560822.144690:0:17160:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f355a1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060199 expref: 17 pid: 18203 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.144709:0:17160:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f355a1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060199 expref: 17 pid: 18203 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.144741:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f355a1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060199 expref: 17 pid: 18203 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.144764:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cafd8703800) 00010000:00010000:3.0:1787560822.144770:0:17160:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f355d9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.144784:0:17160:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f355d9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.144794:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f355d9 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.144846:0:17160:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560822.144942:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5945945-1487-49fd-bee0-0dcced27d086+16:2402:x1874392853389696:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 316us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560822.144952:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 22 00010000:00010000:0.0:1787560822.145042:0:17173:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f355d9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.145052:0:17173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f355d9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787560822.145213:0:17173:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1787560822.145361:0:17173:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1787560822.145405:0:17173:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1787560822.145557:0:17173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2353b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17173:1874392862906496:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787560822.145659:0:17173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560822.145728:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862906496 00000100:00100000:0.0:1787560822.145736:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862906496 00000100:00100000:0.0:1787560822.145786:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787560822.145796:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17173:x1874392862906496:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787560822.145885:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17173:x1874392862906496:12345-0@lo:1000:mdt00_000.0 Request processed in 91us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560822.145893:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787560822.145922:0:17173:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caff3251300 going to sleep for 11 seconds 00000100:00100000:0.0:1787560822.145955:0:17173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2353b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17173:1874392862906496:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1787560822.146137:0:17173:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1787560822.146189:0:17173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2353b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17173:1874392862906624:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787560822.146225:0:17173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560822.146254:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862906624 00000100:00100000:0.0:1787560822.146258:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862906624 00000100:00100000:0.0:1787560822.146285:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787560822.146292:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17173:x1874392862906624:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787560822.146478:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17173:x1874392862906624:12345-0@lo:1000:mdt00_000.0 Request processed in 185us (251us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1787560822.146485:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787560822.146508:0:17173:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caff3251a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787560822.146530:0:17173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2353b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17173:1874392862906624:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1787560822.146572:0:17173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f355d9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.146583:0:17173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f355d9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.146593:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f355d9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.146606:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880c00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560822.146613:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f355d9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.146623:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f355d9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.146655:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cafd8703800) 00010000:00010000:0.0:1787560822.146659:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787560822.146665:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f355d9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.146673:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3880c00/0x4642c20bf2f355d9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.146725:0:17173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f35531 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.146733:0:17173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f35531 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.146740:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f35531 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.146745:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbff600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560822.146749:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f35531 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.146755:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f35531 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.146775:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:0.0:1787560822.146778:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787560822.146786:0:17173:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff400/0x4642c20bf2f35538 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606017d expref: 19 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.146801:0:17173:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff400/0x4642c20bf2f35538 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606017d expref: 19 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.146811:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff400/0x4642c20bf2f35538 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606017d expref: 19 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.146886:0:17173:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff400/0x4642c20bf2f35538 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606017d expref: 19 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560822.146900:0:17173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec38e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17173:1874392862906752:192.168.203.29@tcp:105: 00000100:00100000:0.0:1787560822.146974:0:17173:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caff32519c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560822.150820:0:17173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec38e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17173:1874392862906752:192.168.203.29@tcp:105: 00010000:00010000:0.0:1787560822.150864:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f35531 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.150877:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f35531 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.150936:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe800/0x4642c20bf2f355e0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.150953:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe800/0x4642c20bf2f355e0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.150987:0:17173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe800/0x4642c20bf2f355e0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.151001:0:17173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe800/0x4642c20bf2f355e0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.151007:0:17173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe800/0x4642c20bf2f355e0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.151015:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe800/0x4642c20bf2f355e0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.151022:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbfe800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560822.151026:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe800/0x4642c20bf2f355e0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.151035:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe800/0x4642c20bf2f355e0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.151059:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:0.0:1787560822.151063:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560822.151067:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe800/0x4642c20bf2f355e0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.151072:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe800/0x4642c20bf2f355e0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.151084:0:17173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f355d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.151090:0:17173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f355d2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.151103:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f355d2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.151108:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbfee00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560822.151111:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f355d2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.151118:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f355d2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.151127:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:0.0:1787560822.151130:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787560822.151133:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f355d2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.151140:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f355d2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560822.151373:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5945945-1487-49fd-bee0-0dcced27d086+19:15663:x1874392853389440:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 23845us (24169us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1787560822.151386:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 63 00000020:00080000:0.0:1787560822.151394:0:17173:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787560822.153126:0:17206:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787560822.153136:0:17206:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787560822.153159:0:17206:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787560822.153166:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787560822.155079:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560822.155261:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853389824 00000100:00100000:3.0:1787560822.155275:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853389824 00000100:00100000:3.0:1787560822.155345:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:3.0:1787560822.155358:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec325d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a5945945-1487-49fd-bee0-0dcced27d086+19:15661:x1874392853389824:12345-192.168.203.29@tcp:49:dd.0 00000100:00100000:3.0:1787560822.155654:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec325d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a5945945-1487-49fd-bee0-0dcced27d086+19:15661:x1874392853389824:12345-192.168.203.29@tcp:49:dd.0 Request processed in 297us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560822.155664:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:1.0:1787560822.162944:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560822.163002:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560822.163703:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853390208 00000100:00100000:3.0:1787560822.163720:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853390208 00000100:00100000:3.0:1787560822.163793:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:3.0:1787560822.163806:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a5945945-1487-49fd-bee0-0dcced27d086+19:15663:x1874392853390208:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787560822.164585:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853389952 00000100:00100000:2.0:1787560822.164593:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853389952 00000100:00100000:2.0:1787560822.164656:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 64 00000100:00100000:2.0:1787560822.164666:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5945945-1487-49fd-bee0-0dcced27d086+20:15661:x1874392853389952:12345-192.168.203.29@tcp:101:dd.0 00010000:00010000:2.0:1787560822.164683:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560822.164712:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f355e7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf460601b5 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.164758:0:17174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48c00/0x4642c20bf2f355ee lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.164775:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48c00/0x4642c20bf2f355ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.164789:0:17174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48c00/0x4642c20bf2f355ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.164946:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f355e7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460601b5 expref: 22 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.164980:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48c00/0x4642c20bf2f355ee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460601b5 expref: 21 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.164992:0:17174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:2.0:1787560822.164995:0:17174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787560822.165000:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca48c00, rc 0) 00000004:00080000:3.0:1787560822.165767:0:17177:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787560822.165838:0:17177:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1787560822.165879:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f355f5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.165893:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f355f5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.165904:0:17177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f355f5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.165924:0:17177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f355f5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.165932:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f355f5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.165941:0:17177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f355f5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560822.165971:0:17177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787560822.166101:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560822.166111:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f355f5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.166119:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7e00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560822.166125:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f355f5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.166151:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f355f5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.166169:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cafd8703800) 00010000:00010000:0.0:1787560822.166171:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787560822.166176:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f355f5 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.166182:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7e00/0x4642c20bf2f355f5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.166196:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560822.166198:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560822.166200:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560822.166286:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5945945-1487-49fd-bee0-0dcced27d086+23:15661:x1874392853389952:12345-192.168.203.29@tcp:101:dd.0 Request processed in 1616us (3366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560822.166297:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 64 00000100:00100000:3.0:1787560822.167701:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a5945945-1487-49fd-bee0-0dcced27d086+22:15663:x1874392853390208:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 3885us (4684us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1787560822.167745:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 11 00000020:00080000:3.0:1787560822.167752:0:17177:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787560822.324288:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560822.326158:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862907008:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787560822.326267:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560822.326410:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787560822.326421:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862906880:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787560822.326497:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560822.326812:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862907008 00000100:00100000:2.0:1787560822.326824:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862907008 00000100:00100000:2.0:1787560822.326889:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862906880 00000100:00100000:2.0:1787560822.326893:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862906880 00000100:00100000:2.0:1787560822.326921:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787560822.326934:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec38e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862907008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787560822.326983:0:17179:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787560822.327046:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec38e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862907008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560822.327055:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787560822.327074:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787560822.327082:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862906880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787560822.327101:0:17179:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1787560822.327133:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862906880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560822.327161:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787560822.329404:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862906880:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787560822.329495:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862907008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787560822.346720:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560822.346977:0:18688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853390336 00000100:00100000:2.0:1787560822.346993:0:18688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853390336 00000100:00100000:2.0:1787560822.347097:0:18688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:2.0:1787560822.347112:0:18688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc52c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5945945-1487-49fd-bee0-0dcced27d086+7:2404:x1874392853390336:12345-192.168.203.29@tcp:4:dd.0 00002000:00010000:2.0:1787560822.347183:0:18688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a8c0375, atime: 0x6a8c0374, ctime: 0x6a8c0375, blocks: 0x0 00010000:00010000:2.0:1787560822.347196:0:18688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0ef4953/0x4642c20bf2f355fc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.347220:0:18688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=541s v=(0 0) 00010000:00010000:2.0:1787560822.347227:0:18688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560822.347236:0:18688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0ef4953/0x4642c20bf2f355fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560822.347256:0:18688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0ef4953/0x4642c20bf2f355fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560822.355616:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560822.356289:0:18690:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787560822.356305:0:18690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1787560822.357125:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853390464 00000100:00100000:1.0:1787560822.357142:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853390464 00000100:00100000:0.0:1787560822.358084:0:20317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:0.0:1787560822.358106:0:20317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5945945-1487-49fd-bee0-0dcced27d086+8:2404:x1874392853390464:12345-192.168.203.29@tcp:4:dd.0 00010000:00010000:0.0:1787560822.358164:0:20317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056a6fece/0x4642c20bf2f35603 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.358199:0:20317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560822.358204:0:20317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560822.358213:0:20317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056a6fece/0x4642c20bf2f35603 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.358234:0:20317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056a6fece/0x4642c20bf2f35603 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787560822.514783:0:18679:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:3.0:1787560822.514802:0:18679:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:0.0:1787560822.515124:0:18688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1787560822.515129:0:18688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1787560821 -> 1787560822 00002000:00010000:0.0:1787560822.515133:0:18688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1787560821 -> 1787560822 00002000:00010000:0.0:1787560822.515135:0:18688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:0.0:1787560822.515156:0:18688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0ef4953/0x4642c20bf2f355fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.515170:0:18688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0ef4953/0x4642c20bf2f355fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.515180:0:18688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0ef4953/0x4642c20bf2f355fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.515187:0:18688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca48400 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560822.515192:0:18688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0ef4953/0x4642c20bf2f355fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.515201:0:18688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0ef4953/0x4642c20bf2f355fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.515236:0:18688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0ef4953/0x4642c20bf2f355fc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560822.515243:0:18688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0ef4953/0x4642c20bf2f355fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560822.515353:0:18688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc52c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5945945-1487-49fd-bee0-0dcced27d086+7:2404:x1874392853390336:12345-192.168.203.29@tcp:4:dd.0 Request processed in 168239us (168648us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1787560822.515363:0:18688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 0 00000001:00080000:2.0:1787560822.567837:0:18679:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:1.0:1787560822.567999:0:20317:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:1.0:1787560822.568005:0:20317:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:1.0:1787560822.568023:0:20317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056a6fece/0x4642c20bf2f35603 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560822.568036:0:20317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056a6fece/0x4642c20bf2f35603 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560822.568059:0:20317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056a6fece/0x4642c20bf2f35603 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560822.568067:0:20317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbfee00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560822.568074:0:20317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056a6fece/0x4642c20bf2f35603 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560822.568083:0:20317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056a6fece/0x4642c20bf2f35603 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560822.568104:0:20317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056a6fece/0x4642c20bf2f35603 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560822.568111:0:20317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056a6fece/0x4642c20bf2f35603 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560822.568227:0:20317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5945945-1487-49fd-bee0-0dcced27d086+5:2404:x1874392853390464:12345-192.168.203.29@tcp:4:dd.0 Request processed in 210124us (212625us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787560822.568242:0:20317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 1 00010000:00010000:1.0:1787560823.347704:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560823.860448:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862907136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787560823.860616:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560823.860944:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862907136 00000100:00100000:2.0:1787560823.860955:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862907136 00000100:00100000:2.0:1787560823.861036:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787560823.861051:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862907136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787560823.861093:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00080000:1.0:1787560823.861217:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787560823.861350:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862907136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 302us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560823.861358:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787560823.864041:0:3623:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:1.0:1787560823.864057:0:3623:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9caec407ce00, transno 8589934596 00000004:00080000:1.0:1787560823.864098:0:3623:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:1.0:1787560823.864161:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862907136:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1787560824.229969:0:20355:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:2.0:1787560824.320047:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560824.320103:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560824.320138:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560824.320164:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560824.320185:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560824.320214:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560824.320252:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853390848 00000100:00100000:2.0:1787560824.320267:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853390848 00000100:00100000:2.0:1787560824.320347:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853391360 00000100:00100000:2.0:1787560824.320350:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853391360 00000100:00100000:2.0:1787560824.320369:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853390720 00000100:00100000:2.0:1787560824.320371:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853390720 00000100:00100000:2.0:1787560824.320392:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 81 00000100:00100000:2.0:1787560824.320404:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a5945945-1487-49fd-bee0-0dcced27d086+5:2404:x1874392853390848:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560824.320540:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a5945945-1487-49fd-bee0-0dcced27d086+5:2404:x1874392853390848:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 137us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560824.320549:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 81 00000100:00100000:2.0:1787560824.320574:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 82 00000100:00100000:2.0:1787560824.320581:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1b0149ea-e230-42a7-990a-2401127b7ffb+5:2404:x1874392853391360:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560824.320660:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1b0149ea-e230-42a7-990a-2401127b7ffb+5:2404:x1874392853391360:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 79us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560824.320667:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 82 00000100:00100000:2.0:1787560824.320681:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 83 00000100:00100000:2.0:1787560824.320687:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a5945945-1487-49fd-bee0-0dcced27d086+22:2404:x1874392853390720:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560824.320718:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a5945945-1487-49fd-bee0-0dcced27d086+22:2404:x1874392853390720:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 31us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560824.320736:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 83 00000100:00100000:2.0:1787560824.320760:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853391104 00000100:00100000:2.0:1787560824.320765:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853391104 00000100:00100000:2.0:1787560824.320797:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853391616 00000100:00100000:2.0:1787560824.320800:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853391616 00000100:00100000:2.0:1787560824.320822:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 30 00000100:00100000:2.0:1787560824.320829:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5945945-1487-49fd-bee0-0dcced27d086+5:2404:x1874392853391104:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560824.320861:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5945945-1487-49fd-bee0-0dcced27d086+5:2404:x1874392853391104:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 33us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560824.320868:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 30 00000100:00100000:2.0:1787560824.320879:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 31 00000100:00100000:2.0:1787560824.320886:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1b0149ea-e230-42a7-990a-2401127b7ffb+5:2404:x1874392853391616:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560824.320910:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1b0149ea-e230-42a7-990a-2401127b7ffb+5:2404:x1874392853391616:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 24us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560824.320916:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 31 00000100:00080000:2.0:1787560824.320949:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787560824.320955:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787560824.320957:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787560824.321295:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853390592 00000100:00100000:3.0:1787560824.321301:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853390592 00000100:00100000:3.0:1787560824.321389:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 174 00000100:00100000:3.0:1787560824.321398:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b1eeed-a176-422e-91d7-2f6f77b2967a+13:2404:x1874392853390592:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560824.321454:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b1eeed-a176-422e-91d7-2f6f77b2967a+13:2404:x1874392853390592:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 58us (1424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560824.321461:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 174 00000100:00100000:3.0:1787560824.321530:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560824.321598:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560824.321619:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560824.321650:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853390976 00000100:00100000:3.0:1787560824.321654:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853390976 00000100:00100000:3.0:1787560824.321729:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853391488 00000100:00100000:3.0:1787560824.321733:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853391488 00000100:00100000:3.0:1787560824.321757:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 32 00000100:00100000:3.0:1787560824.321764:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5945945-1487-49fd-bee0-0dcced27d086+5:2404:x1874392853390976:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560824.321803:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5945945-1487-49fd-bee0-0dcced27d086+5:2404:x1874392853390976:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 39us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560824.321810:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 32 00000100:00100000:3.0:1787560824.321835:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 33 00000100:00100000:3.0:1787560824.321841:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1b0149ea-e230-42a7-990a-2401127b7ffb+5:2404:x1874392853391488:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560824.321867:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1b0149ea-e230-42a7-990a-2401127b7ffb+5:2404:x1874392853391488:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 27us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560824.321872:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 33 00000100:00100000:3.0:1787560824.321943:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853391232 00000100:00100000:3.0:1787560824.321947:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853391232 00000100:00100000:3.0:1787560824.321972:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 84 00000100:00100000:3.0:1787560824.321978:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1b0149ea-e230-42a7-990a-2401127b7ffb+6:2404:x1874392853391232:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560824.322018:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1b0149ea-e230-42a7-990a-2401127b7ffb+6:2404:x1874392853391232:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 39us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560824.322025:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 84 00000100:00080000:2.0:1787560824.322324:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787560824.322330:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787560824.373520:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787560825.203861:0:17206:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787560825.203875:0:17206:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787560825.203906:0:17206:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787560825.203915:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1787560825.396076:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 42982 lines, 42982 kept, 0 dropped, 0 bad.